Oracle Database 11g CRS Release 11.1.0.7.0 - Production Copyright 1996, 2007 Oracle. All rights reserved. [ CSSD]2013-05-23 10:35:33.584 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac027240 [ CSSD]2013-05-23 10:35:33.584 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac027240) con(0x7f82ac015ad0) skgpid ospid 11891 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:35:34.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:34.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:34.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:36.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:36.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:36.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:37.963 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:35:37.963 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:35:38.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:38.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:38.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:40.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:40.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:40.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:40.942 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:35:42.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:42.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:42.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:42.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:35:42.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:35:44.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:44.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:44.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:45.342 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0174a0) allocated [ CSSD]2013-05-23 10:35:45.343 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:35:45.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0174a0 - 1,2,3 [ CSSD]2013-05-23 10:35:45.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024a10) proc(0x7f82ac0174a0) pid(12014) version 11:1:1:4 [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac0174a0), client(1/0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0171e0 with con 0x7f82ac016950, requested num -1 [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006fa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:35:45.350 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:35:45.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:45.357 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0171e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:35:45.357 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00ee80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:35:45.357 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00ee80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:35:45.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0174a0 [ CSSD]2013-05-23 10:35:45.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0174a0) con(0x7f82ac024a10) skgpid ospid 12014 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:35:46.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:46.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:46.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:47.969 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:35:47.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:35:48.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:48.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:48.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:48.623 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0174a0) allocated [ CSSD]2013-05-23 10:35:48.624 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:35:48.625 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0174a0 - 1,2,3 [ CSSD]2013-05-23 10:35:48.625 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024a10) proc(0x7f82ac0174a0) pid(12049) version 11:1:1:4 [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac0174a0), client(1/0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0171e0 with con 0x7f82ac016950, requested num -1 [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006fa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:35:48.631 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:35:48.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:48.638 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0171e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:35:48.638 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00ee80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:35:48.638 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00ee80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:35:48.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0174a0 [ CSSD]2013-05-23 10:35:48.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0174a0) con(0x7f82ac024a10) skgpid ospid 12049 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:35:50.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:50.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:50.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:50.932 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0174a0) allocated [ CSSD]2013-05-23 10:35:50.933 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:35:50.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0174a0 - 1,2,3 [ CSSD]2013-05-23 10:35:50.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024a10) proc(0x7f82ac0174a0) pid(11657/11657) version 11:1:1:4 [ CSSD]2013-05-23 10:35:50.951 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac0174a0), client(1/0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:50.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 10:35:50.951 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:35:50.951 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 10:35:50.963 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:35:52.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:52.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:52.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:52.972 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:35:52.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:35:54.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:54.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:54.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:56.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:56.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:56.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:35:57.974 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:35:57.974 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:35:58.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:35:58.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:35:58.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:00.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:00.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:00.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:00.989 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:01.596 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026860) allocated [ CSSD]2013-05-23 10:36:01.597 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:01.598 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026860 - 1,2,3 [ CSSD]2013-05-23 10:36:01.598 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016210) proc(0x7f82ac026860) pid(10790/10790) version 11:1:1:4 [ CSSD]2013-05-23 10:36:01.603 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac026860), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:36:01.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:36:01.603 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:01.603 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:36:02.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:02.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:02.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:02.977 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:02.977 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:03.874 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021570) allocated [ CSSD]2013-05-23 10:36:03.875 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:36:03.876 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021570 - 1,2,3 [ CSSD]2013-05-23 10:36:03.876 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac008810) proc(0x7f82ac021570) pid(12196) version 11:1:1:4 [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021570), client(1/0x7f82ac010940) [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac010940) [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac010940 with con 0x7f82ac021310, requested num -1 [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010ab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:36:03.893 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:36:03.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac010940) [ CSSD]2013-05-23 10:36:03.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac010940), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:36:03.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac010e80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:03.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac010e80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:36:04.104 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021570 [ CSSD]2013-05-23 10:36:04.104 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021570) con(0x7f82ac008810) skgpid ospid 12196 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:04.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:04.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:04.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:06.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:06.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:06.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:07.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:07.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:08.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:08.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:08.423 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a3b0) allocated [ CSSD]2013-05-23 10:36:08.424 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:08.424 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a3b0 - 1,2,3 [ CSSD]2013-05-23 10:36:08.424 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f010) proc(0x7f82ac00a3b0) pid(10788/10788) version 11:1:1:4 [ CSSD]2013-05-23 10:36:08.441 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac00a3b0), client(1/0x7f82ac010620) [ CSSD]2013-05-23 10:36:08.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac010620) [ CSSD]2013-05-23 10:36:08.442 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:08.442 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:36:08.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:10.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:10.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:10.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:11.010 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:11.370 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:36:11.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:11.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:36:11.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac010e30) proc(0x7f82ac01d8b0) pid(12299/12299) version 11:1:1:4 [ CSSD]2013-05-23 10:36:11.378 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac01d8b0), client(1/0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.378 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:11.378 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:36:11.439 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac010e30) skgpid 12299 ospid 12299 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:11.612 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:36:11.613 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:11.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:36:11.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac010e30) proc(0x7f82ac01d8b0) pid(12308/12308) version 11:1:1:4 [ CSSD]2013-05-23 10:36:11.619 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac01d8b0), client(1/0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.619 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:11.619 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:36:11.668 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac010e30) skgpid 12308 ospid 12308 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:12.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:12.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:12.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:12.983 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:12.983 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:14.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:14.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:14.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:15.367 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:36:15.367 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:15.368 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:36:15.368 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac010e30) proc(0x7f82ac01d8b0) pid(12332/12332) version 11:1:1:4 [ CSSD]2013-05-23 10:36:15.385 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac01d8b0), client(1/0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:15.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:15.385 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:15.385 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:36:15.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac010e30) skgpid 12332 ospid 12332 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:15.546 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:36:15.547 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:15.547 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:36:15.547 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac010e30) proc(0x7f82ac01d8b0) pid(12335/12335) version 11:1:1:4 [ CSSD]2013-05-23 10:36:15.564 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac01d8b0), client(1/0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:15.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:36:15.564 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:15.564 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:36:15.597 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01fe00) allocated [ CSSD]2013-05-23 10:36:15.598 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:15.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01fe00 - 1,2,3 [ CSSD]2013-05-23 10:36:15.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01e470) proc(0x7f82ac01fe00) pid(10778/10778) version 11:1:1:4 [ CSSD]2013-05-23 10:36:15.604 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac01fe00), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 10:36:15.604 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:36:15.604 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:15.604 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:36:16.182 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac0174a0), client(2/0x7f82ac004b40) [ CSSD]2013-05-23 10:36:16.182 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac004b40) [ CSSD]2013-05-23 10:36:16.182 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:36:16.182 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 10:36:16.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:16.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:16.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:17.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:17.985 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:18.445 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac00f0c0) [ CSSD]2013-05-23 10:36:18.445 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac00f0c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:36:18.445 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac00f0c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.445 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 10:36:18.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac016160) [ CSSD]2013-05-23 10:36:18.448 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac016160), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:36:18.448 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac016160), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.448 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ec50) [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ec50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ec50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0131f0 [ CSSD]2013-05-23 10:36:18.450 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0131f0) con(0x7f82ac00b350) skgpid 2666 ospid 2666 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:18.453 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac015c30) [ CSSD]2013-05-23 10:36:18.454 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac015c30), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:36:18.454 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac015c30), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.454 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac015cd0) [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac015cd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac015cd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00d1f0 [ CSSD]2013-05-23 10:36:18.455 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00d1f0) con(0x7f82ac00dba0) skgpid 4300 ospid 4300 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:18.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:18.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006d30) [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006d30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006d30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006de0 [ CSSD]2013-05-23 10:36:18.460 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006de0) con(0x7f82ac019110) skgpid 2668 ospid 2668 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:18.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:19.137 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01c840) allocated [ CSSD]2013-05-23 10:36:19.138 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:36:19.139 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01c840 - 1,2,3 [ CSSD]2013-05-23 10:36:19.139 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f0c0) proc(0x7f82ac01c840) pid(12364) version 11:1:1:4 [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01c840), client(1/0x7f82ac00afa0) [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00afa0) [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00afa0 with con 0x7f82ac020310, requested num -1 [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:36:19.145 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:36:19.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00afa0) [ CSSD]2013-05-23 10:36:19.152 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00afa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:36:19.152 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0131f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:19.153 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0131f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:36:19.355 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01c840 [ CSSD]2013-05-23 10:36:19.355 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01c840) con(0x7f82ac00f0c0) skgpid ospid 12364 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:20.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:20.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:20.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:21.034 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:22.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:22.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:22.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:22.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:22.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:24.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:24.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:24.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:26.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:26.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:26.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:26.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:26.990 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:36:27.323 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01c840) allocated [ CSSD]2013-05-23 10:36:27.324 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:27.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01c840 - 1,2,3 [ CSSD]2013-05-23 10:36:27.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f0c0) proc(0x7f82ac01c840) pid(12362/12362) version 11:1:1:4 [ CSSD]2013-05-23 10:36:27.341 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01c840), client(1/0x7f82ac0048d0) [ CSSD]2013-05-23 10:36:27.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0048d0) [ CSSD]2013-05-23 10:36:27.341 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:36:27.341 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:36:28.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:28.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:28.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:30.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:30.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:30.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:31.055 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:31.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:31.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:32.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:32.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:32.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:34.389 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:36:34.390 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:36:34.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:36:34.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016710) proc(0x7f82ac015770) pid(12516) version 11:1:1:4 [ CSSD]2013-05-23 10:36:34.396 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac015770), client(1/0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:34.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:34.396 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7e0 with con 0x7f82ac015d00, requested num -1 [ CSSD]2013-05-23 10:36:34.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:34.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:36:34.397 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:36:34.397 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:36:34.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:34.404 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:36:34.404 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:34.404 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:36:34.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:34.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:34.606 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:36:34.606 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac016710) skgpid ospid 12516 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:34.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:36.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:36.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:36.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:36.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:36.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:38.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:38.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:38.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:40.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:40.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:40.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:41.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:41.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:41.999 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:42.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:42.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:42.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:44.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:44.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:44.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:45.599 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:36:45.600 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:36:45.601 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:36:45.601 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016710) proc(0x7f82ac015770) pid(12627) version 11:1:1:4 [ CSSD]2013-05-23 10:36:45.617 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac015770), client(1/0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:45.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:45.617 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7e0 with con 0x7f82ac015d00, requested num -1 [ CSSD]2013-05-23 10:36:45.617 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:45.617 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:36:45.618 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:36:45.618 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:36:45.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:45.625 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:36:45.625 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:45.625 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:36:45.828 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:36:45.828 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac016710) skgpid ospid 12627 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:46.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:46.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:46.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:47.001 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:47.001 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:48.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:48.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:48.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:49.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:36:49.643 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:36:49.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:36:49.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016710) proc(0x7f82ac015770) pid(12662) version 11:1:1:4 [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac015770), client(1/0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7e0 with con 0x7f82ac015d00, requested num -1 [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:36:49.660 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:36:49.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:36:49.667 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:36:49.667 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:36:49.667 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:36:49.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:36:49.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac016710) skgpid ospid 12662 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:36:50.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:50.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:51.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:51.099 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:36:52.004 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:52.004 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:36:52.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:52.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:53.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:54.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:54.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:55.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:56.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:36:56.006 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:36:56.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:56.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:57.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:36:58.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:36:58.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:36:59.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:00.173 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:37:00.174 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:00.175 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:37:00.175 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016710) proc(0x7f82ac015770) pid(12774) version 11:1:1:4 [ CSSD]2013-05-23 10:37:00.181 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac015770), client(1/0x7f82ac00e7e0) [ CSSD]2013-05-23 10:37:00.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:37:00.181 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7e0 with con 0x7f82ac015d00, requested num -1 [ CSSD]2013-05-23 10:37:00.181 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:00.181 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:00.182 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:00.182 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:00.188 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7e0) [ CSSD]2013-05-23 10:37:00.188 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:00.188 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:00.188 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:00.391 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:37:00.391 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac016710) skgpid ospid 12774 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:00.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:00.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:01.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:01.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:01.126 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:01.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:02.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:02.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:03.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:04.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:04.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:04.904 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:37:04.905 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:37:04.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:37:04.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac015770) pid(12833) version 11:1:1:4 [ CSSD]2013-05-23 10:37:04.911 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac015770), client(1/0x7f82ac018fc0) [ CSSD]2013-05-23 10:37:04.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac018fc0) [ CSSD]2013-05-23 10:37:04.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac018fc0 with con 0x7f82ac0167e0, requested num -1 [ CSSD]2013-05-23 10:37:04.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:04.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:04.912 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:04.912 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:04.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac018fc0) [ CSSD]2013-05-23 10:37:04.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac018fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:04.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019130) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:04.918 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019130) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:05.120 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:37:05.120 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac020310) skgpid ospid 12833 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:05.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:06.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:06.012 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:06.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:06.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:07.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:08.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:08.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:09.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:10.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:10.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:11.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:11.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:11.150 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:11.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:11.353 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015770) allocated [ CSSD]2013-05-23 10:37:11.354 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:11.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015770 - 1,2,3 [ CSSD]2013-05-23 10:37:11.355 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac016710) proc(0x7f82ac015770) pid(12953) version 11:1:1:4 [ CSSD]2013-05-23 10:37:12.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:12.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:13.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:14.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:14.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:15.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:15.018 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:37:15.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:16.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:16.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:17.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:17.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a40105) incarnation(174631049) [ CSSD]2013-05-23 10:37:17.489 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:37:17.490 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:37:17.490 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 10:37:17.490 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 10:37:17.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a50105) incarnation(174631049) [ CSSD]2013-05-23 10:37:17.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:37:17.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:37:17.491 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:37:17.491 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:37:17.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a60105) incarnation(174631049) [ CSSD]2013-05-23 10:37:17.492 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:37:17.492 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:37:17.513 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:37:17.513 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:37:18.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:18.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:19.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:20.020 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:20.020 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:20.154 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0160d0) allocated [ CSSD]2013-05-23 10:37:20.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:37:20.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0160d0 - 1,2,3 [ CSSD]2013-05-23 10:37:20.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015d30) proc(0x7f82ac0160d0) pid(13314) version 11:1:1:4 [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0160d0), client(1/0x7f82ac012380) [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012380) [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012380 with con 0x7f82ac015fe0, requested num -1 [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0124f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:20.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:20.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012380) [ CSSD]2013-05-23 10:37:20.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:20.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0127f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:20.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0127f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:20.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0160d0 [ CSSD]2013-05-23 10:37:20.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0160d0) con(0x7f82ac015d30) skgpid ospid 13314 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:20.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:20.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:21.172 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:21.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:22.475 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0160d0) allocated [ CSSD]2013-05-23 10:37:22.476 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:22.476 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0160d0 - 1,2,3 [ CSSD]2013-05-23 10:37:22.476 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015d30) proc(0x7f82ac0160d0) pid(13372/13372) version 11:1:1:4 [ CSSD]2013-05-23 10:37:22.492 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0160d0), client(1/0x7f82ac015640) [ CSSD]2013-05-23 10:37:22.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac015640) [ CSSD]2013-05-23 10:37:22.492 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:37:22.492 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:37:22.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac015640) [ CSSD]2013-05-23 10:37:22.509 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac015640), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:37:22.509 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac015640), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:37:22.509 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:37:22.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0160d0 [ CSSD]2013-05-23 10:37:22.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0160d0) con(0x7f82ac015d30) skgpid 13372 ospid 13372 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:23.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:23.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:23.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:25.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:25.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:25.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:25.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:25.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:27.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:27.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:27.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:29.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:29.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:29.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:29.675 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0160d0) allocated [ CSSD]2013-05-23 10:37:29.676 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:29.676 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0160d0 - 1,2,3 [ CSSD]2013-05-23 10:37:29.676 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015d30) proc(0x7f82ac0160d0) pid(13416) version 11:1:1:4 [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0160d0), client(1/0x7f82ac012380) [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012380) [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012380 with con 0x7f82ac015fe0, requested num -1 [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0124f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:29.683 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:29.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012380) [ CSSD]2013-05-23 10:37:29.690 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:29.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0127f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:29.691 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0127f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:29.893 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0160d0 [ CSSD]2013-05-23 10:37:29.893 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0160d0) con(0x7f82ac015d30) skgpid ospid 13416 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:30.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:30.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:31.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:31.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:31.196 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:31.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:33.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:33.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:33.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:35.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:35.029 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:35.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:35.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:35.416 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0160d0) allocated [ CSSD]2013-05-23 10:37:35.417 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:37:35.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0160d0 - 1,2,3 [ CSSD]2013-05-23 10:37:35.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0160d0) pid(13473) version 11:1:1:4 [ CSSD]2013-05-23 10:37:35.424 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0160d0), client(1/0x7f82ac015650) [ CSSD]2013-05-23 10:37:35.424 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac015650) [ CSSD]2013-05-23 10:37:35.424 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac015650 with con 0x7f82ac015fe0, requested num -1 [ CSSD]2013-05-23 10:37:35.424 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:35.424 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012450/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:35.425 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:35.425 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:35.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac015650) [ CSSD]2013-05-23 10:37:35.432 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac015650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:35.432 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012750) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:35.432 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012750) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:35.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:35.634 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0160d0 [ CSSD]2013-05-23 10:37:35.634 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0160d0) con(0x7f82ac020310) skgpid ospid 13473 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01dd70) [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01dd70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:37:35.743 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac010e30) skgpid 12335 ospid 12335 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:37.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:37.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:37.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:39.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:39.032 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:37:39.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:39.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:39.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:41.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:41.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:41.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:42.517 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:42.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac027c60) [ CSSD]2013-05-23 10:37:42.913 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac027c60), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:37:42.913 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac027c60), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:37:42.913 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac024b60) [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac024b60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac024b60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0245c0 [ CSSD]2013-05-23 10:37:42.919 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0245c0) con(0x7f82ac0222f0) skgpid 5821 ospid 5821 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:43.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:43.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:43.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:44.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:44.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:45.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:45.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:45.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:45.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:37:45.869 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:45.869 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:37:45.869 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024b60) proc(0x7f82ac01d8b0) pid(13580) version 11:1:1:4 [ CSSD]2013-05-23 10:37:45.875 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01d8b0), client(1/0x7f82ac027590) [ CSSD]2013-05-23 10:37:45.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac027590) [ CSSD]2013-05-23 10:37:45.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac027590 with con 0x7f82ac021be0, requested num -1 [ CSSD]2013-05-23 10:37:45.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:45.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01d520/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:45.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:45.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:45.883 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac027590) [ CSSD]2013-05-23 10:37:45.883 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac027590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:45.883 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00e590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:45.883 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00e590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:46.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:37:46.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac024b60) skgpid ospid 13580 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:47.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:47.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:47.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:47.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015770 [ CSSD]2013-05-23 10:37:47.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015770) con(0x7f82ac016710) skgpid ospid 12953 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:49.037 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:49.037 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:49.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:49.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:49.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:50.670 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01d8b0) allocated [ CSSD]2013-05-23 10:37:50.671 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:37:50.672 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01d8b0 - 1,2,3 [ CSSD]2013-05-23 10:37:50.672 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ed30) proc(0x7f82ac01d8b0) pid(13624) version 11:1:1:4 [ CSSD]2013-05-23 10:37:50.678 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac01d8b0), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:37:50.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:37:50.678 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024c30 with con 0x7f82ac01de30, requested num -1 [ CSSD]2013-05-23 10:37:50.678 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:50.678 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:37:50.679 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:37:50.679 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:37:50.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:37:50.686 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:37:50.686 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013ff0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:37:50.686 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013ff0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:37:50.889 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01d8b0 [ CSSD]2013-05-23 10:37:50.889 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01d8b0) con(0x7f82ac00ed30) skgpid ospid 13624 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:51.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:51.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:51.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:52.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:37:53.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:53.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:53.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021b30) allocated [ CSSD]2013-05-23 10:37:53.579 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:53.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021b30 - 1,2,3 [ CSSD]2013-05-23 10:37:53.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac021b30) pid(13705/13705) version 11:1:1:4 [ CSSD]2013-05-23 10:37:53.587 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac021b30), client(1/0x7f82ac027d30) [ CSSD]2013-05-23 10:37:53.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:37:53.587 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:37:53.587 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:37:53.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:54.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:54.040 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac027d30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac027d30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021b30 [ CSSD]2013-05-23 10:37:54.166 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021b30) con(0x7f82ac020310) skgpid 13705 ospid 13705 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:37:55.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:55.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:55.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:57.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:57.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:57.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:37:59.033 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021700) allocated [ CSSD]2013-05-23 10:37:59.034 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:37:59.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021700 - 1,2,3 [ CSSD]2013-05-23 10:37:59.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ed30) proc(0x7f82ac021700) pid(13558/13558) version 11:1:1:4 [ CSSD]2013-05-23 10:37:59.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:37:59.043 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:37:59.051 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac021700), client(1/0x7f82ac027590) [ CSSD]2013-05-23 10:37:59.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac027590) [ CSSD]2013-05-23 10:37:59.052 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:37:59.052 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:37:59.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:37:59.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:37:59.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:01.360 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac021700), client(2/0x7f82ac024c30) [ CSSD]2013-05-23 10:38:01.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac024c30) [ CSSD]2013-05-23 10:38:01.360 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:38:01.360 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 10:38:01.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:01.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:01.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:02.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:03.045 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:03.045 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:38:03.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:03.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:03.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:05.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:05.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:05.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:05.923 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e590) allocated [ CSSD]2013-05-23 10:38:05.924 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:38:05.924 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e590 - 1,2,3 [ CSSD]2013-05-23 10:38:05.924 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0140e0) proc(0x7f82ac00e590) pid(13793) version 11:1:1:4 [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac00e590), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac024740, requested num -1 [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:05.931 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:05.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:05.937 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:38:05.937 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:05.937 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:06.140 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e590 [ CSSD]2013-05-23 10:38:06.140 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e590) con(0x7f82ac0140e0) skgpid ospid 13793 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:07.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:07.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:07.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:08.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:08.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:09.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:09.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:09.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:11.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:11.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:11.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:12.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:13.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:13.051 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:13.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:13.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:13.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:15.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:15.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:16.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:17.443 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e590) allocated [ CSSD]2013-05-23 10:38:17.444 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:38:17.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e590 - 1,2,3 [ CSSD]2013-05-23 10:38:17.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0140e0) proc(0x7f82ac00e590) pid(13925) version 11:1:1:4 [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac00e590), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac00ede0 with con 0x7f82ac024740, requested num -1 [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:17.452 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:17.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:17.458 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 10:38:17.458 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019090) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:38:17.458 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac019090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:17.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:17.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:17.567 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015e60) allocated [ CSSD]2013-05-23 10:38:17.568 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:38:17.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015e60 - 1,2,3 [ CSSD]2013-05-23 10:38:17.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac015e60) pid(13930) version 11:1:1:4 [ CSSD]2013-05-23 10:38:17.584 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:38:17.587 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:38:17.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:38:17.590 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015e60 [ CSSD]2013-05-23 10:38:17.590 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015e60) con(0x7f82ac01de30) skgpid ospid 13930 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:17.661 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e590 [ CSSD]2013-05-23 10:38:17.661 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e590) con(0x7f82ac0140e0) skgpid ospid 13925 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:18.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:18.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:18.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:19.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:19.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:20.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:21.174 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e590) allocated [ CSSD]2013-05-23 10:38:21.175 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:38:21.176 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e590 - 1,2,3 [ CSSD]2013-05-23 10:38:21.176 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0140e0) proc(0x7f82ac00e590) pid(13980) version 11:1:1:4 [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac00e590), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac024740, requested num -1 [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:21.182 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:21.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:21.189 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:38:21.189 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:21.189 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:21.391 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e590 [ CSSD]2013-05-23 10:38:21.391 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e590) con(0x7f82ac0140e0) skgpid ospid 13980 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:21.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:21.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:22.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:22.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:23.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:23.057 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:23.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:23.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:24.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:25.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:25.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:26.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:27.060 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:27.060 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:38:27.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:27.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:28.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:29.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:29.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:30.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:31.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:31.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:32.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:32.063 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:32.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:32.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:33.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:33.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:34.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:35.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:35.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:36.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:36.425 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e590) allocated [ CSSD]2013-05-23 10:38:36.426 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:38:36.427 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e590 - 1,2,3 [ CSSD]2013-05-23 10:38:36.427 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0140e0) proc(0x7f82ac00e590) pid(14131) version 11:1:1:4 [ CSSD]2013-05-23 10:38:36.433 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac00e590), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:36.433 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:36.433 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac024740, requested num -1 [ CSSD]2013-05-23 10:38:36.433 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:36.433 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:38:36.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:36.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:36.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:36.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:38:36.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:36.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:36.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e590 [ CSSD]2013-05-23 10:38:36.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e590) con(0x7f82ac0140e0) skgpid ospid 14131 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:37.066 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:37.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:37.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:37.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:38.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:39.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:39.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:40.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:40.986 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e590) allocated [ CSSD]2013-05-23 10:38:40.987 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:38:40.988 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e590 - 1,2,3 [ CSSD]2013-05-23 10:38:40.988 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0140e0) proc(0x7f82ac00e590) pid(14221) version 11:1:1:4 [ CSSD]2013-05-23 10:38:41.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e590 [ CSSD]2013-05-23 10:38:41.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e590) con(0x7f82ac0140e0) skgpid ospid 14221 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:41.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:41.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:42.068 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:42.068 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:42.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:42.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:43.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:43.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:44.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:45.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:45.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:46.134 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015d10) allocated [ CSSD]2013-05-23 10:38:46.135 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:38:46.135 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015d10 - 1,2,3 [ CSSD]2013-05-23 10:38:46.135 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac015d10) pid(14407) version 11:1:1:4 [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac015d10), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac024740, requested num -1 [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018fc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:46.142 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:46.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:46.150 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:38:46.150 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0245c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:46.151 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0245c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:46.353 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015d10 [ CSSD]2013-05-23 10:38:46.353 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015d10) con(0x7f82ac01de30) skgpid ospid 14407 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:46.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:47.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:47.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:47.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:47.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:48.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:48.479 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac026ad0) [ CSSD]2013-05-23 10:38:48.479 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac026ad0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:38:48.479 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac026ad0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:38:48.479 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac028880) [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac028880), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac028880), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac017710 [ CSSD]2013-05-23 10:38:48.484 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac017710) con(0x7f82ac027880) skgpid 8493 ospid 8493 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:49.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:49.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:50.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:51.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:51.074 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:38:51.679 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0140c0) allocated [ CSSD]2013-05-23 10:38:51.680 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:38:51.681 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0140c0 - 1,2,3 [ CSSD]2013-05-23 10:38:51.681 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0140c0) pid(14464) version 11:1:1:4 [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0140c0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac0141f0, requested num -1 [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01d520/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:38:51.698 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:38:51.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:51.705 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:38:51.705 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac015910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:38:51.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac015910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:38:51.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:51.811 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:51.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0140c0 [ CSSD]2013-05-23 10:38:51.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0140c0) con(0x7f82ac01de30) skgpid ospid 14464 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:38:52.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:52.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:38:53.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:53.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:54.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:55.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:55.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:56.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:38:56.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:38:56.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:57.514 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0140c0) allocated [ CSSD]2013-05-23 10:38:57.514 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:38:57.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0140c0 - 1,2,3 [ CSSD]2013-05-23 10:38:57.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0140c0) pid(14436/14436) version 11:1:1:4 [ CSSD]2013-05-23 10:38:57.521 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0140c0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:57.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:38:57.521 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:38:57.521 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:38:57.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:57.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:38:58.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:38:59.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:38:59.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:00.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:01.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:01.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:01.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:01.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:02.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:02.711 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:03.356 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:39:03.357 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:39:03.358 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:39:03.358 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0246a0) proc(0x7f82ac026330) pid(14582) version 11:1:1:4 [ CSSD]2013-05-23 10:39:03.482 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005600) allocated [ CSSD]2013-05-23 10:39:03.483 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:39:03.483 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005600 - 1,2,3 [ CSSD]2013-05-23 10:39:03.483 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01d6b0) proc(0x7f82ac005600) pid(14592) version 11:1:1:4 [ CSSD]2013-05-23 10:39:03.500 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:39:03.502 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:39:03.504 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005600 [ CSSD]2013-05-23 10:39:03.504 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005600) con(0x7f82ac01d6b0) skgpid ospid 14592 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:03.589 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5276/0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:03.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5276 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:03.589 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac0159d0 with con 0x7f82ac01d6a0, requested num -1 [ CSSD]2013-05-23 10:39:03.589 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:39:03.589 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac015e60/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 10:39:03.590 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:03.590 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 10:39:03.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5276 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:03.597 [1199044928] >TRACE: clssgmExitGrock: client 5276 (0x7f82ac0159d0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 10:39:03.597 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001210) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:39:03.597 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac001210) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:03.598 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:39:03.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac0246a0) skgpid ospid 14582 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:04.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:04.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:04.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:06.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:06.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:06.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:06.082 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:06.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:06.940 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:39:06.941 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:39:06.942 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:39:06.942 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0246a0) proc(0x7f82ac026330) pid(14631) version 11:1:1:4 [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac026330), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0159d0 with con 0x7f82ac01d6a0, requested num -1 [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:06.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:39:06.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:06.955 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0159d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:39:06.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01d520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:06.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01d520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:07.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:39:07.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac0246a0) skgpid ospid 14631 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:08.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:08.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:08.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:10.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:10.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:10.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:11.085 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:11.085 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:12.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:12.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:12.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:12.741 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:14.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:14.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:14.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:15.087 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:15.087 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:39:16.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:16.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:16.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:18.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:18.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:18.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:20.090 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:20.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:20.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:20.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:20.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:22.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:22.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:22.192 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026190) allocated [ CSSD]2013-05-23 10:39:22.193 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:39:22.193 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026190 - 1,2,3 [ CSSD]2013-05-23 10:39:22.193 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027880) proc(0x7f82ac026190) pid(14787) version 11:1:1:4 [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac026190), client(1/0x7f82ac024770) [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024770) [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024770 with con 0x7f82ac00e710, requested num -1 [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac015e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:22.199 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:39:22.205 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024770) [ CSSD]2013-05-23 10:39:22.205 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024770), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:39:22.205 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0264c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:22.205 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0264c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:22.408 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026190 [ CSSD]2013-05-23 10:39:22.408 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026190) con(0x7f82ac027880) skgpid ospid 14787 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:22.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:22.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:24.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:24.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:24.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:25.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:25.093 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:26.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:26.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:26.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:27.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:39:27.964 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:39:27.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:39:27.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0246a0) proc(0x7f82ac026330) pid(11655/11655) version 11:1:1:4 [ CSSD]2013-05-23 10:39:27.981 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac026330), client(1/0x7f82ac026600) [ CSSD]2013-05-23 10:39:27.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac026600) [ CSSD]2013-05-23 10:39:27.981 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:39:27.981 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:39:28.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:28.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:28.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:30.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:30.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:30.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:30.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:30.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:32.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:32.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:32.796 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:32.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:34.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:34.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:34.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:35.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:35.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:36.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:36.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:36.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:37.441 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005a40) allocated [ CSSD]2013-05-23 10:39:37.442 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:39:37.442 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005a40 - 1,2,3 [ CSSD]2013-05-23 10:39:37.443 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019170) proc(0x7f82ac005a40) pid(14935) version 11:1:1:4 [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac005a40), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0159d0 with con 0x7f82ac005960, requested num -1 [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:37.459 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:39:37.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:37.465 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0159d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:39:37.465 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:37.465 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:37.668 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005a40 [ CSSD]2013-05-23 10:39:37.668 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005a40) con(0x7f82ac019170) skgpid ospid 14935 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:38.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:38.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:38.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:40.101 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:40.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:40.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:40.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:40.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:42.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:42.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:42.820 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:42.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:44.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:44.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:44.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:45.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:45.104 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:46.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:46.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:46.390 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005a40) allocated [ CSSD]2013-05-23 10:39:46.392 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:39:46.392 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005a40 - 1,2,3 [ CSSD]2013-05-23 10:39:46.392 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027880) proc(0x7f82ac005a40) pid(15035) version 11:1:1:4 [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac005a40), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0159d0 with con 0x7f82ac019170, requested num -1 [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006150/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:46.399 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:39:46.406 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:46.406 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0159d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:39:46.406 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006450) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:46.406 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006450) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:46.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005a40 [ CSSD]2013-05-23 10:39:46.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005a40) con(0x7f82ac027880) skgpid ospid 15035 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:46.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:48.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:48.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:48.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:50.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:50.107 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:50.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:50.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:50.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:52.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:52.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:52.702 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005a40) allocated [ CSSD]2013-05-23 10:39:52.703 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:39:52.704 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005a40 - 1,2,3 [ CSSD]2013-05-23 10:39:52.704 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027880) proc(0x7f82ac005a40) pid(15082) version 11:1:1:4 [ CSSD]2013-05-23 10:39:52.710 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac005a40), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:52.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:52.710 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0159d0 with con 0x7f82ac019170, requested num -1 [ CSSD]2013-05-23 10:39:52.710 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:52.710 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006150/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:39:52.711 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:39:52.711 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:39:52.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:39:52.716 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0159d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:39:52.716 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006450) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:39:52.717 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006450) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:39:52.841 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:39:52.919 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005a40 [ CSSD]2013-05-23 10:39:52.919 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005a40) con(0x7f82ac027880) skgpid ospid 15082 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:39:52.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:54.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:54.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:54.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:55.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:55.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:39:56.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:56.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:57.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:58.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:39:58.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:39:59.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:39:59.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:39:59.113 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:40:00.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:00.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:01.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:02.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:02.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:02.864 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:03.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:04.037 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005a40) allocated [ CSSD]2013-05-23 10:40:04.038 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:40:04.039 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005a40 - 1,2,3 [ CSSD]2013-05-23 10:40:04.039 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019170) proc(0x7f82ac005a40) pid(11653/11653) version 11:1:1:4 [ CSSD]2013-05-23 10:40:04.055 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac005a40), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:40:04.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:40:04.055 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:40:04.055 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:40:04.095 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac023870) allocated [ CSSD]2013-05-23 10:40:04.096 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:40:04.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac023870 - 1,2,3 [ CSSD]2013-05-23 10:40:04.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0065a0) proc(0x7f82ac023870) pid(11645/11645) version 11:1:1:4 [ CSSD]2013-05-23 10:40:04.103 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac023870), client(1/0x7f82ac023db0) [ CSSD]2013-05-23 10:40:04.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac023db0) [ CSSD]2013-05-23 10:40:04.103 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:40:04.103 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:40:04.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:04.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:04.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:04.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:05.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:06.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:06.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:07.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:07.264 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0140c0), client(2/0x7f82ac024250) [ CSSD]2013-05-23 10:40:07.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac024250) [ CSSD]2013-05-23 10:40:07.264 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:40:07.264 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 10:40:07.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac012e60) allocated [ CSSD]2013-05-23 10:40:07.964 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:40:07.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac012e60 - 1,2,3 [ CSSD]2013-05-23 10:40:07.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024190) proc(0x7f82ac012e60) pid(15431) version 11:1:1:4 [ CSSD]2013-05-23 10:40:07.971 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac012e60), client(1/0x7f82ac028c80) [ CSSD]2013-05-23 10:40:07.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac028c80) [ CSSD]2013-05-23 10:40:07.971 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac028c80 with con 0x7f82ac012d70, requested num -1 [ CSSD]2013-05-23 10:40:07.971 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:07.971 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac028df0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:40:07.972 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:40:07.972 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:40:07.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac028c80) [ CSSD]2013-05-23 10:40:07.979 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac028c80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:40:07.979 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0290f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:07.979 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0290f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:40:08.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac012e60 [ CSSD]2013-05-23 10:40:08.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac012e60) con(0x7f82ac024190) skgpid ospid 15431 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:08.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:08.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:09.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:09.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:09.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:10.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:10.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:11.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:12.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:12.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:12.885 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x265f2a0) [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x265f2a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x265f2a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x26778f0 [ CSSD]2013-05-23 10:40:12.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26778f0) con(0x26ab100) skgpid 9845 ospid 9845 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:13.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:14.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:14.121 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:14.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:14.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:15.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:16.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:16.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:17.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:18.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:18.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:19.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:19.124 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:19.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:20.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:20.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:21.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:22.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:22.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:22.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:23.226 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac012df0) allocated [ CSSD]2013-05-23 10:40:23.227 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:40:23.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac012df0 - 1,2,3 [ CSSD]2013-05-23 10:40:23.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027880) proc(0x7f82ac012df0) pid(15578) version 11:1:1:4 [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac012df0), client(1/0x7f82ac012d50) [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012d50) [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012d50 with con 0x7f82ac012ca0, requested num -1 [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac028d40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:40:23.234 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:40:23.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012d50) [ CSSD]2013-05-23 10:40:23.241 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012d50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:40:23.241 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac029040) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:23.241 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac029040) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:40:23.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:23.443 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac012df0 [ CSSD]2013-05-23 10:40:23.443 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac012df0) con(0x7f82ac027880) skgpid ospid 15578 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:24.127 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:24.127 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:24.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:24.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:25.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:26.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:26.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:27.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:28.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:28.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:29.129 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:29.129 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:29.161 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac012df0) allocated [ CSSD]2013-05-23 10:40:29.167 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:40:29.167 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac012df0 - 1,2,3 [ CSSD]2013-05-23 10:40:29.167 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027880) proc(0x7f82ac012df0) pid(15513/15513) version 11:1:1:4 [ CSSD]2013-05-23 10:40:29.183 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac012df0), client(1/0x7f82ac028af0) [ CSSD]2013-05-23 10:40:29.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac028af0) [ CSSD]2013-05-23 10:40:29.183 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:40:29.183 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:40:29.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:30.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:30.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:31.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:32.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:32.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:32.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:33.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:34.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:34.132 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:34.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:34.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:35.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:36.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:36.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:37.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:38.482 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02b560) allocated [ CSSD]2013-05-23 10:40:38.483 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:40:38.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02b560 - 1,2,3 [ CSSD]2013-05-23 10:40:38.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac029280) proc(0x7f82ac02b560) pid(15731) version 11:1:1:4 [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02b560), client(1/0x7f82ac02bc20) [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02bc20) [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02bc20 with con 0x7f82ac02b470, requested num -1 [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02bd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:40:38.488 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:40:38.493 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02bc20) [ CSSD]2013-05-23 10:40:38.493 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02bc20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:40:38.493 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:38.494 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:40:38.696 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02b560 [ CSSD]2013-05-23 10:40:38.696 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02b560) con(0x7f82ac029280) skgpid ospid 15731 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:38.851 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02b5c0) allocated [ CSSD]2013-05-23 10:40:38.851 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:40:38.852 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02b5c0 - 1,2,3 [ CSSD]2013-05-23 10:40:38.852 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac029280) proc(0x7f82ac02b5c0) pid(15511/15511) version 11:1:1:4 [ CSSD]2013-05-23 10:40:38.868 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02b5c0), client(1/0x7f82ac02bba0) [ CSSD]2013-05-23 10:40:38.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac02bba0) [ CSSD]2013-05-23 10:40:38.868 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:40:38.868 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:40:38.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:38.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:39.135 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:39.135 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:39.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:40.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:40.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:41.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:42.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:42.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:42.964 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:43.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:44.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:44.138 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:44.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:44.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:45.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:46.400 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02b5c0), client(2/0x7f82ac02c040) [ CSSD]2013-05-23 10:40:46.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac02c040) [ CSSD]2013-05-23 10:40:46.400 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:40:46.400 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 10:40:46.659 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02ea10) allocated [ CSSD]2013-05-23 10:40:46.660 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:40:46.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02ea10 - 1,2,3 [ CSSD]2013-05-23 10:40:46.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c720) proc(0x7f82ac02ea10) pid(15826) version 11:1:1:4 [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02ea10), client(1/0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02f0e0 with con 0x7f82ac02e910, requested num -1 [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:40:46.667 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:40:46.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:46.673 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02f0e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:40:46.673 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02f550) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:46.673 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02f550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:40:46.876 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02ea10 [ CSSD]2013-05-23 10:40:46.876 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02ea10) con(0x7f82ac02c720) skgpid ospid 15826 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:46.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:46.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:47.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:48.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:48.141 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:40:48.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:48.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:49.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:50.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:50.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:51.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:52.992 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:40:53.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:53.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:53.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:53.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:53.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:53.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02ea10) allocated [ CSSD]2013-05-23 10:40:53.741 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:40:53.741 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02ea10 - 1,2,3 [ CSSD]2013-05-23 10:40:53.741 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c720) proc(0x7f82ac02ea10) pid(15899) version 11:1:1:4 [ CSSD]2013-05-23 10:40:53.747 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02ea10), client(1/0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:53.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:53.747 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02f0e0 with con 0x7f82ac02e910, requested num -1 [ CSSD]2013-05-23 10:40:53.747 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:53.747 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:40:53.748 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:40:53.748 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:40:53.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:40:53.754 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02f0e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:40:53.754 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02f550) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:40:53.755 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02f550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:40:53.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02ea10 [ CSSD]2013-05-23 10:40:53.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02ea10) con(0x7f82ac02c720) skgpid ospid 15899 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:40:55.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:55.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:55.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:57.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:57.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:57.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:40:58.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:40:58.147 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:40:59.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:40:59.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:40:59.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:01.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:01.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:01.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:03.018 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:03.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:03.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:03.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:03.150 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:03.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:05.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:05.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:05.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:07.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:07.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:07.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:08.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:08.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:08.991 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02ea10) allocated [ CSSD]2013-05-23 10:41:08.992 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:41:08.993 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02ea10 - 1,2,3 [ CSSD]2013-05-23 10:41:08.993 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c720) proc(0x7f82ac02ea10) pid(16047) version 11:1:1:4 [ CSSD]2013-05-23 10:41:08.999 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02ea10), client(1/0x7f82ac02f0e0) [ CSSD]2013-05-23 10:41:08.999 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:41:08.999 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02f0e0 with con 0x7f82ac02e910, requested num -1 [ CSSD]2013-05-23 10:41:08.999 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:08.999 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:41:09.000 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:41:09.000 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:41:09.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02f0e0) [ CSSD]2013-05-23 10:41:09.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02f0e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:41:09.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02f550) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:09.007 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02f550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:41:09.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:09.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:09.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02ea10 [ CSSD]2013-05-23 10:41:09.209 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02ea10) con(0x7f82ac02c720) skgpid ospid 16047 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:09.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:11.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:11.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:11.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:12.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:12.155 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:41:13.039 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:13.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:13.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:13.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:15.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:15.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:15.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:17.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:17.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:17.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:17.158 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:17.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01fe00 [ CSSD]2013-05-23 10:41:18.499 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01fe00) con(0x7f82ac01e470) skgpid 10778 ospid 10778 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:18.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac010620) [ CSSD]2013-05-23 10:41:18.510 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac010620), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:41:18.510 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac010620), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:41:18.510 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:41:18.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a3b0 [ CSSD]2013-05-23 10:41:18.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a3b0) con(0x7f82ac00f010) skgpid 10788 ospid 10788 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:19.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:19.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:19.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:21.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:21.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:21.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:22.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:22.161 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:23.110 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:23.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:23.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:23.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:24.252 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a520) allocated [ CSSD]2013-05-23 10:41:24.253 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:41:24.253 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a520 - 1,2,3 [ CSSD]2013-05-23 10:41:24.253 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a520) pid(16225) version 11:1:1:4 [ CSSD]2013-05-23 10:41:24.259 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac00a520), client(1/0x7f82ac021100) [ CSSD]2013-05-23 10:41:24.259 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:41:24.259 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021100 with con 0x7f82ac0087e0, requested num -1 [ CSSD]2013-05-23 10:41:24.260 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:24.260 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00fcd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:41:24.260 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:41:24.260 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:41:24.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:41:24.266 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021100), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:41:24.266 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac021270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:24.266 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac021270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:41:24.469 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a520 [ CSSD]2013-05-23 10:41:24.469 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a520) con(0x7f82ac028c60) skgpid ospid 16225 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:25.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:25.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:25.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:26.274 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac012df0), client(2/0x7f82ac018dd0) [ CSSD]2013-05-23 10:41:26.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac018dd0) [ CSSD]2013-05-23 10:41:26.274 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:41:26.274 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 10:41:27.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:27.164 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:27.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:27.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:27.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:29.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:29.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:29.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:31.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:31.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:31.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:32.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:32.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:32.645 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:41:32.646 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:41:32.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:41:32.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02be90) proc(0x7f82ac00a320) pid(13442/13442) version 11:1:1:4 [ CSSD]2013-05-23 10:41:32.664 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac00a320), client(1/0x7f82ac021410) [ CSSD]2013-05-23 10:41:32.664 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:41:32.664 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:41:32.664 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:41:33.136 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:33.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:33.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:33.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:35.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:35.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:36.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:37.170 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:37.170 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:37.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:37.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:38.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:39.507 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c1b0) allocated [ CSSD]2013-05-23 10:41:39.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:39.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:39.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:41:39.508 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c1b0 - 1,2,3 [ CSSD]2013-05-23 10:41:39.508 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac010260) proc(0x7f82ac02c1b0) pid(16374) version 11:1:1:4 [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02c1b0), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac028c60, requested num -1 [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02c870/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:41:39.515 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:41:39.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:41:39.522 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:41:39.522 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02cb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:39.522 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02cb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:41:39.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c1b0 [ CSSD]2013-05-23 10:41:39.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c1b0) con(0x7f82ac010260) skgpid ospid 16374 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:40.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:41.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:41.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:42.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:42.173 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:42.173 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:43.160 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:43.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:43.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:44.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:44.261 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac026860), client(2/0x7f82ac0214b0) [ CSSD]2013-05-23 10:41:44.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:41:44.262 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:41:44.262 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 10:41:45.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:45.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:46.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:46.918 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f7c0) allocated [ CSSD]2013-05-23 10:41:46.919 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:41:46.920 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f7c0 - 1,2,3 [ CSSD]2013-05-23 10:41:46.920 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fff0) proc(0x7f82ac01f7c0) pid(16471) version 11:1:1:4 [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac01f7c0), client(1/0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fcc0 with con 0x7f82ac01f6d0, requested num -1 [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02ce40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:41:46.926 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:41:46.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:46.933 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fcc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:41:46.933 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:46.934 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:41:47.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f7c0 [ CSSD]2013-05-23 10:41:47.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f7c0) con(0x7f82ac00fff0) skgpid ospid 16471 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:47.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:47.175 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:47.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:47.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:48.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:49.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:49.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:50.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:51.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:51.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:52.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:52.178 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:52.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:41:53.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:41:53.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:53.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:54.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:54.759 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f7c0) allocated [ CSSD]2013-05-23 10:41:54.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:41:54.761 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f7c0 - 1,2,3 [ CSSD]2013-05-23 10:41:54.761 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fff0) proc(0x7f82ac01f7c0) pid(16534) version 11:1:1:4 [ CSSD]2013-05-23 10:41:54.766 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac01f7c0), client(1/0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:54.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:54.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fcc0 with con 0x7f82ac01f6d0, requested num -1 [ CSSD]2013-05-23 10:41:54.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:54.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02ce40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:41:54.767 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:41:54.767 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:41:54.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fcc0) [ CSSD]2013-05-23 10:41:54.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fcc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:41:54.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:41:54.774 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:41:54.976 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f7c0 [ CSSD]2013-05-23 10:41:54.976 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f7c0) con(0x7f82ac00fff0) skgpid ospid 16534 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:41:55.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:55.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:56.181 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:41:56.181 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:41:56.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:57.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:57.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:41:58.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:41:59.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:41:59.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:00.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:01.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:01.184 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:01.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:01.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:02.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:03.209 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:03.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:03.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:04.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:05.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:05.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:06.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:06.187 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:06.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:07.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:07.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:08.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:09.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:09.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:10.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c4f0) allocated [ CSSD]2013-05-23 10:42:10.009 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:42:10.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c4f0 - 1,2,3 [ CSSD]2013-05-23 10:42:10.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac02c4f0) pid(16699) version 11:1:1:4 [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02c4f0), client(1/0x7f82ac02cae0) [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02cae0) [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02cae0 with con 0x7f82ac01fd00, requested num -1 [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02cc50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:42:10.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:42:10.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02cae0) [ CSSD]2013-05-23 10:42:10.021 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02cae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:42:10.021 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02cf50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:10.021 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02cf50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:42:10.223 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c4f0 [ CSSD]2013-05-23 10:42:10.223 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c4f0) con(0x7f82ac028c60) skgpid ospid 16699 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:10.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:11.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:11.189 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:11.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:11.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:11.746 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c4f0) allocated [ CSSD]2013-05-23 10:42:11.746 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:42:11.747 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c4f0 - 1,2,3 [ CSSD]2013-05-23 10:42:11.747 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac02c4f0) pid(16773) version 11:1:1:4 [ CSSD]2013-05-23 10:42:12.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:13.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:13.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:13.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:14.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:15.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:15.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:16.192 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:16.192 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:16.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:17.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:17.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:18.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:19.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:19.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:20.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:21.195 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:21.195 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:21.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:21.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:22.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:22.740 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02f000) allocated [ CSSD]2013-05-23 10:42:22.741 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:42:22.742 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02f000 - 1,2,3 [ CSSD]2013-05-23 10:42:22.742 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02cd10) proc(0x7f82ac02f000) pid(17161/17161) version 11:1:1:4 [ CSSD]2013-05-23 10:42:22.749 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02f000), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:22.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:22.749 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:42:22.749 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02f000 [ CSSD]2013-05-23 10:42:22.778 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02f000) con(0x7f82ac02cd10) skgpid 17161 ospid 17161 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:23.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:23.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:23.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:24.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:25.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02f000) allocated [ CSSD]2013-05-23 10:42:25.258 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:42:25.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02f000 - 1,2,3 [ CSSD]2013-05-23 10:42:25.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02cd10) proc(0x7f82ac02f000) pid(17186) version 11:1:1:4 [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02f000), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fd10 with con 0x7f82ac02ef00, requested num -1 [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02f7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:42:25.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:42:25.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:42:25.272 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fd10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:42:25.272 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02faa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:25.273 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02faa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:42:25.475 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02f000 [ CSSD]2013-05-23 10:42:25.475 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02f000) con(0x7f82ac02cd10) skgpid ospid 17186 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:25.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:25.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:26.198 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:26.198 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:26.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:27.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:27.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:28.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:29.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:29.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:30.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:31.201 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:31.201 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:31.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:31.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:32.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:32.726 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:32.726 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021410), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:42:32.726 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021410), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:42:32.726 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:42:32.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:42:32.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac02be90) skgpid 13442 ospid 13442 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:33.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:33.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:33.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:34.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:35.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:35.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:36.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:36.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:36.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:37.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:37.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:38.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:39.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:39.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:40.512 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:42:40.602 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:42:40.603 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:42:40.603 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02be90) proc(0x7f82ac00a320) pid(17341) version 11:1:1:4 [ CSSD]2013-05-23 10:42:40.609 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac021410) [ CSSD]2013-05-23 10:42:40.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:40.609 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021410 with con 0x7f82ac0087e0, requested num -1 [ CSSD]2013-05-23 10:42:40.609 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:40.609 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02c960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:42:40.610 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:42:40.610 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:42:40.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:40.617 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:42:40.617 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:40.618 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:42:40.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:40.820 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:42:40.820 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac02be90) skgpid ospid 17341 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:41.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:41.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:41.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:41.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:42.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:43.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:43.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:43.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:44.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:45.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:45.209 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:42:45.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:45.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:46.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:47.174 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:42:47.175 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:42:47.176 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:42:47.176 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c410) proc(0x7f82ac00a320) pid(17429) version 11:1:1:4 [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac021410) [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021410 with con 0x7f82ac00a6a0, requested num -1 [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02c960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:42:47.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:42:47.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:47.190 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:42:47.190 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02cc60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:47.191 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02cc60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:42:47.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:42:47.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac02c410) skgpid ospid 17429 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:47.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:47.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:48.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:49.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:49.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:50.212 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:50.212 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:50.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:51.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:51.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:52.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:53.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:42:53.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:42:53.868 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:42:53.869 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:42:53.869 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02bf60) proc(0x7f82ac00a320) pid(17485/17485) version 11:1:1:4 [ CSSD]2013-05-23 10:42:53.886 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac021410) [ CSSD]2013-05-23 10:42:53.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:53.886 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:42:53.886 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:42:53.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:53.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021410), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021410), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:42:54.612 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac02bf60) skgpid 17485 ospid 17485 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:54.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:55.215 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:42:55.215 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:42:55.856 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:42:55.857 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:42:55.858 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:42:55.858 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c410) proc(0x7f82ac00a320) pid(17502) version 11:1:1:4 [ CSSD]2013-05-23 10:42:55.864 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac021410) [ CSSD]2013-05-23 10:42:55.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:55.864 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021410 with con 0x7f82ac00a6a0, requested num -1 [ CSSD]2013-05-23 10:42:55.864 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:55.864 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02c960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:42:55.865 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:42:55.865 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:42:55.872 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021410) [ CSSD]2013-05-23 10:42:55.872 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:42:55.872 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02cc60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:42:55.872 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02cc60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:42:56.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:56.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:56.074 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:42:56.074 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac02c410) skgpid ospid 17502 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:42:57.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:42:58.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:42:58.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:42:59.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:00.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:00.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:00.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:00.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:01.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:02.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:02.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:02.414 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c4f0 [ CSSD]2013-05-23 10:43:02.414 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c4f0) con(0x7f82ac028c60) skgpid ospid 16773 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:03.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:03.358 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:04.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:04.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:05.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:05.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:05.221 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:06.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:06.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:07.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:08.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:08.066 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:09.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:10.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:10.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:10.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:10.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:11.108 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a520) allocated [ CSSD]2013-05-23 10:43:11.109 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:43:11.110 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a520 - 1,2,3 [ CSSD]2013-05-23 10:43:11.110 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a520) pid(17648) version 11:1:1:4 [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac00a520), client(1/0x7f82ac021100) [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021100 with con 0x7f82ac0087e0, requested num -1 [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010270/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:11.116 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:11.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:43:11.123 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021100), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:43:11.123 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac010570) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:11.123 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac010570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:11.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:11.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a520 [ CSSD]2013-05-23 10:43:11.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a520) con(0x7f82ac028c60) skgpid ospid 17648 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:12.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:12.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:13.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:13.384 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:14.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:14.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:15.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:15.226 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:15.226 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:15.320 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:15.321 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:15.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:15.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:16.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:16.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:17.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:17.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:43:17.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:17.741 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:43:17.741 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fe60) proc(0x7f82ac02be90) pid(17734) version 11:1:1:4 [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac02be90), client(1/0x7f82ac020f60) [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac020f60) [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac020f60 with con 0x7f82ac0087e0, requested num -1 [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010410/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:17.748 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:17.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac020f60) [ CSSD]2013-05-23 10:43:17.755 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac020f60), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 10:43:17.755 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008660) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:43:17.755 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac008660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:17.865 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c420) allocated [ CSSD]2013-05-23 10:43:17.866 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:17.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c420 - 1,2,3 [ CSSD]2013-05-23 10:43:17.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac02c420) pid(17739) version 11:1:1:4 [ CSSD]2013-05-23 10:43:17.881 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:17.883 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:17.885 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:43:17.886 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c420 [ CSSD]2013-05-23 10:43:17.886 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c420) con(0x7f82ac0210f0) skgpid ospid 17739 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:17.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:43:17.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac00fe60) skgpid ospid 17734 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:18.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:18.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:19.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:20.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:20.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:20.229 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:20.229 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:21.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:22.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:22.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:23.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:23.408 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:24.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:24.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:25.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:25.232 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:25.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:26.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:26.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:26.361 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008660) allocated [ CSSD]2013-05-23 10:43:26.362 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:43:26.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008660 - 1,2,3 [ CSSD]2013-05-23 10:43:26.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac008660) pid(17798) version 11:1:1:4 [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac008660), client(1/0x7f82ac021100) [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021100 with con 0x7f82ac00a6a0, requested num -1 [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010270/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:26.369 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:26.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021100) [ CSSD]2013-05-23 10:43:26.375 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021100), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:43:26.375 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac010570) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:26.375 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac010570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:26.578 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008660 [ CSSD]2013-05-23 10:43:26.578 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008660) con(0x7f82ac028c60) skgpid ospid 17798 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:27.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:28.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:28.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:29.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:29.235 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:43:29.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:30.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:30.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:31.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:32.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:32.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:32.726 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a520) allocated [ CSSD]2013-05-23 10:43:32.727 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:32.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a520 - 1,2,3 [ CSSD]2013-05-23 10:43:32.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a520) pid(17883/17883) version 11:1:1:4 [ CSSD]2013-05-23 10:43:32.734 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac00a520), client(1/0x7f82ac020f80) [ CSSD]2013-05-23 10:43:32.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac020f80) [ CSSD]2013-05-23 10:43:32.734 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:43:32.734 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:43:33.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:33.437 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:34.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:34.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:34.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:34.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:35.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:36.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:36.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:37.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:38.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:38.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:39.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:39.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:39.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:40.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:40.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:41.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c4f0) allocated [ CSSD]2013-05-23 10:43:41.271 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:41.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c4f0 - 1,2,3 [ CSSD]2013-05-23 10:43:41.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac02c4f0) pid(17960) version 11:1:1:4 [ CSSD]2013-05-23 10:43:41.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:41.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02ef50) allocated [ CSSD]2013-05-23 10:43:41.611 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:43:41.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02ef50 - 1,2,3 [ CSSD]2013-05-23 10:43:41.612 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02cc60) proc(0x7f82ac02ef50) pid(18023) version 11:1:1:4 [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02ef50), client(1/0x7f82ac02f620) [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02f620) [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02f620 with con 0x7f82ac02ee50, requested num -1 [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02f790/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:41.617 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:41.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02f620) [ CSSD]2013-05-23 10:43:41.622 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02f620), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:43:41.622 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02fa90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:41.622 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02fa90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:41.824 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02ef50 [ CSSD]2013-05-23 10:43:41.824 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02ef50) con(0x7f82ac02cc60) skgpid ospid 18023 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:41.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c4f0 [ CSSD]2013-05-23 10:43:41.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c4f0) con(0x7f82ac0210f0) skgpid ospid 17960 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:42.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:42.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:43.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:43.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:44.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:44.243 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:44.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:44.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:45.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:46.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:46.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:47.438 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c4f0) allocated [ CSSD]2013-05-23 10:43:47.438 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:47.439 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c4f0 - 1,2,3 [ CSSD]2013-05-23 10:43:47.439 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac02c4f0) pid(18192) version 11:1:1:4 [ CSSD]2013-05-23 10:43:47.455 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02c4f0), client(1/0x7f82ac02cae0) [ CSSD]2013-05-23 10:43:47.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02cae0) [ CSSD]2013-05-23 10:43:47.455 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02cae0 with con 0x7f82ac01fd00, requested num -1 [ CSSD]2013-05-23 10:43:47.455 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:47.455 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02cc50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:43:47.456 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:47.456 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:47.463 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02cae0) [ CSSD]2013-05-23 10:43:47.463 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02cae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:43:47.463 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02cf50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:47.463 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02cf50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:47.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:47.666 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c4f0 [ CSSD]2013-05-23 10:43:47.666 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c4f0) con(0x7f82ac0210f0) skgpid ospid 18192 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:48.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:48.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:49.246 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:49.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:49.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:50.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:50.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:50.652 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02c4f0) allocated [ CSSD]2013-05-23 10:43:50.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:43:50.654 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02c4f0 - 1,2,3 [ CSSD]2013-05-23 10:43:50.654 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac02c4f0) pid(18215/18215) version 11:1:1:4 [ CSSD]2013-05-23 10:43:50.671 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac02c4f0), client(1/0x7f82ac02c960) [ CSSD]2013-05-23 10:43:50.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac02c960) [ CSSD]2013-05-23 10:43:50.671 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:43:50.671 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:43:51.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:52.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:52.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:53.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:53.249 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:43:53.489 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:43:53.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:54.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:54.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:55.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:56.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:56.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:56.860 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02f330) allocated [ CSSD]2013-05-23 10:43:56.861 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:43:56.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02f330 - 1,2,3 [ CSSD]2013-05-23 10:43:56.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02d040) proc(0x7f82ac02f330) pid(18293) version 11:1:1:4 [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02f330), client(1/0x7f82ac02fa00) [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02fa00) [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02fa00 with con 0x7f82ac02f230, requested num -1 [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02fb70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:43:56.869 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:43:56.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02fa00) [ CSSD]2013-05-23 10:43:56.876 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02fa00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:43:56.876 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02fe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:43:56.876 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02fe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:43:57.079 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02f330 [ CSSD]2013-05-23 10:43:57.079 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02f330) con(0x7f82ac02d040) skgpid ospid 18293 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:43:57.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:43:58.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:43:58.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:43:58.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:43:58.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:43:59.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:00.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:00.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:01.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:02.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:02.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:03.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:03.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:03.512 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:03.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:03.672 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02f3e0) allocated [ CSSD]2013-05-23 10:44:03.674 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:44:03.674 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02f3e0 - 1,2,3 [ CSSD]2013-05-23 10:44:03.674 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02d0f0) proc(0x7f82ac02f3e0) pid(18380) version 11:1:1:4 [ CSSD]2013-05-23 10:44:03.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac031d70) allocated [ CSSD]2013-05-23 10:44:03.796 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:44:03.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac031d70 - 1,2,3 [ CSSD]2013-05-23 10:44:03.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02fa80) proc(0x7f82ac031d70) pid(18390) version 11:1:1:4 [ CSSD]2013-05-23 10:44:03.825 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:44:03.826 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:44:03.830 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac031d70 [ CSSD]2013-05-23 10:44:03.830 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac031d70) con(0x7f82ac02fa80) skgpid ospid 18390 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:03.997 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5277/0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5277 (0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac02fab0 with con 0x7f82ac02f2e0, requested num -1 [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac02fc20/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:03.998 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 10:44:04.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5277 (0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:04.004 [1199044928] >TRACE: clssgmExitGrock: client 5277 (0x7f82ac02fab0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 10:44:04.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02ff20) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:44:04.004 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac02ff20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:04.005 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02f3e0 [ CSSD]2013-05-23 10:44:04.005 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02f3e0) con(0x7f82ac02d0f0) skgpid ospid 18380 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:04.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:04.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:05.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:06.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:06.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:07.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:08.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:08.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:08.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:08.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:09.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:10.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:10.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:11.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:12.118 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02f3e0) allocated [ CSSD]2013-05-23 10:44:12.119 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:44:12.120 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02f3e0 - 1,2,3 [ CSSD]2013-05-23 10:44:12.120 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02d0f0) proc(0x7f82ac02f3e0) pid(18461) version 11:1:1:4 [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82ac02f3e0), client(1/0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02fab0 with con 0x7f82ac02f2e0, requested num -1 [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02fc20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:12.126 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:44:12.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02fab0) [ CSSD]2013-05-23 10:44:12.133 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02fab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:44:12.133 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02ff20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:12.133 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02ff20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:12.336 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02f3e0 [ CSSD]2013-05-23 10:44:12.336 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02f3e0) con(0x7f82ac02d0f0) skgpid ospid 18461 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:12.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:12.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:13.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:13.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:13.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:13.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:14.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:14.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:15.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:16.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:16.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac020f80) [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac020f80), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac020f80), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a520 [ CSSD]2013-05-23 10:44:17.729 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a520) con(0x7f82ac028c60) skgpid 17883 ospid 17883 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:17.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:18.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:18.264 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:18.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:18.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:19.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:20.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:20.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:21.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:22.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:22.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:23.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:23.267 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:23.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:23.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:24.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:24.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:25.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:26.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:26.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:27.369 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:44:27.371 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:44:27.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:44:27.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a320) pid(18639) version 11:1:1:4 [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac02c870) [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac02c870) [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac02c870 with con 0x7f82ac021040, requested num -1 [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02cd40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:27.378 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:44:27.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac02c870) [ CSSD]2013-05-23 10:44:27.386 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac02c870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:44:27.386 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d040) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:27.386 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d040) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:27.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:44:27.589 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac028c60) skgpid ospid 18639 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:27.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:28.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:28.270 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:28.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:28.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:29.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:30.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:30.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:31.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:32.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:32.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:33.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:33.273 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:33.577 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:33.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:34.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:34.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:36.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:36.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:36.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:37.276 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:37.276 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:44:38.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:38.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:38.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:40.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:40.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:40.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:42.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:42.279 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:42.279 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:42.622 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a520) allocated [ CSSD]2013-05-23 10:44:42.623 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:44:42.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a520 - 1,2,3 [ CSSD]2013-05-23 10:44:42.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0087f0) proc(0x7f82ac00a520) pid(18786) version 11:1:1:4 [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a520), client(1/0x7f82ac00ffe0) [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ffe0) [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ffe0 with con 0x7f82ac02bf50, requested num -1 [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02ce10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:42.630 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:44:42.637 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ffe0) [ CSSD]2013-05-23 10:44:42.637 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ffe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:44:42.637 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d110) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:42.637 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:42.840 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a520 [ CSSD]2013-05-23 10:44:42.840 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a520) con(0x7f82ac0087f0) skgpid ospid 18786 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:43.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:43.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:43.599 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:44.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:45.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:45.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:46.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:47.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:47.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:47.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:47.282 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:47.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:44:47.714 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:44:47.715 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:44:47.715 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a320) pid(18863) version 11:1:1:4 [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac00a5e0) [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00a5e0) [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00a5e0 with con 0x7f82ac021040, requested num -1 [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02cd40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:47.721 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:44:47.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00a5e0) [ CSSD]2013-05-23 10:44:47.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00a5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:44:47.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d040) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:47.729 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d040) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:47.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:44:47.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac028c60) skgpid ospid 18863 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:48.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:49.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:49.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:50.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:51.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:51.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:52.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:52.284 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:52.285 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:53.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:53.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:53.623 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:44:54.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:55.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:55.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:56.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:57.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:57.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:44:57.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:44:57.288 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:44:57.875 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a320) allocated [ CSSD]2013-05-23 10:44:57.876 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:44:57.877 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a320 - 1,2,3 [ CSSD]2013-05-23 10:44:57.877 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00a320) pid(18943) version 11:1:1:4 [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82ac00a320), client(1/0x7f82ac00ff20) [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ff20) [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ff20 with con 0x7f82ac021040, requested num -1 [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac02cd40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:44:57.894 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:44:57.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ff20) [ CSSD]2013-05-23 10:44:57.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ff20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:44:57.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02d040) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:44:57.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02d040) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:44:58.104 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a320 [ CSSD]2013-05-23 10:44:58.104 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a320) con(0x7f82ac028c60) skgpid ospid 18943 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:44:58.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:44:59.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:44:59.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:00.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:01.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:01.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:02.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:02.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:02.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:03.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:03.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:03.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:04.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:05.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:05.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:06.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:07.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:07.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:07.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:07.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:08.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:09.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:09.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:10.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:11.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:11.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:12.297 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:12.297 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:12.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac023db0) [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac023db0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac023db0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac023870 [ CSSD]2013-05-23 10:45:12.995 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac023870) con(0x7f82ac0065a0) skgpid 11645 ospid 11645 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:12.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:45:12.999 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0159d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:45:12.999 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0159d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:45:12.999 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:45:12.999 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005a40 [ CSSD]2013-05-23 10:45:12.999 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005a40) con(0x7f82ac019170) skgpid 11653 ospid 11653 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:13.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac026600) [ CSSD]2013-05-23 10:45:13.010 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac026600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:45:13.010 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac026600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:45:13.010 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:45:13.010 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:45:13.011 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac0246a0) skgpid 11655 ospid 11655 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:13.138 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:45:13.139 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:45:13.140 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:45:13.140 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac021040) proc(0x7f82ac018b90) pid(19093) version 11:1:1:4 [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac023e80) [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023e80 with con 0x7f82ac00ff70, requested num -1 [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:45:13.146 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:45:13.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:13.153 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023e80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:45:13.153 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c6f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:13.153 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c6f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:45:13.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:13.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:13.355 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:45:13.355 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac021040) skgpid ospid 19093 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:13.680 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:14.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:15.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:15.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:16.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:17.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:17.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:17.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:17.300 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:18.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:19.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:19.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:20.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:21.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:21.302 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:45:21.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:21.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:22.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:23.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:23.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:23.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:24.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:25.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:25.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:26.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:26.305 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:26.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:27.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:27.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:28.389 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:45:28.390 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:45:28.391 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:45:28.391 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac018b90) pid(19261) version 11:1:1:4 [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac021050) [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021050 with con 0x7f82ac023e70, requested num -1 [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:45:28.398 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:45:28.406 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:45:28.406 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021050), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:45:28.406 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01db10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:28.406 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01db10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:45:28.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:28.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:45:28.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac028c60) skgpid ospid 19261 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:29.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:29.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:30.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:31.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:31.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:31.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:31.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:32.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:33.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:33.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:33.735 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:34.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:35.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:35.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:36.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:36.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:36.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:37.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:37.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:38.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:39.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:39.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:40.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:41.314 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:41.314 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:41.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:41.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:42.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:43.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:43.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:43.641 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:45:43.643 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:45:43.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:45:43.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac018b90) pid(19415) version 11:1:1:4 [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac021050) [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021050 with con 0x7f82ac023e70, requested num -1 [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:45:43.650 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:45:43.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:45:43.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021050), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:45:43.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01db10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:43.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01db10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:45:43.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:43.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:45:43.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac028c60) skgpid ospid 19415 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:44.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:45.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:45.317 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:45:45.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:45.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:46.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:47.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:47.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:47.973 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:45:47.974 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:45:47.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:45:47.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac018b90) pid(19483) version 11:1:1:4 [ CSSD]2013-05-23 10:45:47.980 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac023e80) [ CSSD]2013-05-23 10:45:47.980 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:47.980 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023e80 with con 0x7f82ac021040, requested num -1 [ CSSD]2013-05-23 10:45:47.980 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:47.980 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:45:47.981 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:45:47.981 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:45:47.987 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:47.987 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023e80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:45:47.987 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fe60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:47.987 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fe60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:45:48.190 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:45:48.190 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac028c60) skgpid ospid 19483 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:48.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:49.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:49.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:50.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:50.320 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:50.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:51.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:51.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:52.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:53.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:53.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:53.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:45:54.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:55.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:45:55.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:45:55.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:55.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:56.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:57.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:57.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:45:58.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:45:58.893 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:45:58.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:45:58.895 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:45:58.895 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac021040) proc(0x7f82ac018b90) pid(19564) version 11:1:1:4 [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac023e80) [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023e80 with con 0x7f82ac00ff70, requested num -1 [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:45:58.901 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:45:58.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023e80) [ CSSD]2013-05-23 10:45:58.908 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023e80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:45:58.908 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00a520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:45:58.908 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00a520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:45:59.111 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:45:59.111 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac021040) skgpid ospid 19564 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:45:59.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:45:59.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:00.326 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:00.326 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:00.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:01.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:01.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:02.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:03.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:03.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:03.883 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:04.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:05.328 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:05.329 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:05.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:05.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:06.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:07.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:07.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:08.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:09.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:09.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:10.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:10.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:10.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:11.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:11.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:12.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:13.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:13.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:13.913 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:14.145 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018b90) allocated [ CSSD]2013-05-23 10:46:14.145 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:46:14.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018b90 - 1,2,3 [ CSSD]2013-05-23 10:46:14.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac018b90) pid(19708) version 11:1:1:4 [ CSSD]2013-05-23 10:46:14.152 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018b90), client(1/0x7f82ac021050) [ CSSD]2013-05-23 10:46:14.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:46:14.152 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021050 with con 0x7f82ac023e70, requested num -1 [ CSSD]2013-05-23 10:46:14.152 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:14.152 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:46:14.153 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:46:14.153 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:46:14.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021050) [ CSSD]2013-05-23 10:46:14.160 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021050), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:46:14.160 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01db10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:14.160 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01db10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:46:14.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018b90 [ CSSD]2013-05-23 10:46:14.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018b90) con(0x7f82ac028c60) skgpid ospid 19708 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:46:14.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:15.335 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:15.335 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:15.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:15.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:17.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:17.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:17.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0048d0) [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0048d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0048d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01c840 [ CSSD]2013-05-23 10:46:18.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01c840) con(0x7f82ac00f0c0) skgpid 12362 ospid 12362 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:46:19.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:19.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:19.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:20.338 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:20.338 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:21.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:21.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:21.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:23.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:23.938 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:23.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:23.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:25.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:25.341 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:25.341 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:25.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:25.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:27.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:27.517 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015c40) allocated [ CSSD]2013-05-23 10:46:27.518 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:46:27.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015c40 - 1,2,3 [ CSSD]2013-05-23 10:46:27.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0162c0) proc(0x7f82ac015c40) pid(19774/19774) version 11:1:1:4 [ CSSD]2013-05-23 10:46:27.526 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac015c40), client(1/0x7f82ac0049a0) [ CSSD]2013-05-23 10:46:27.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0049a0) [ CSSD]2013-05-23 10:46:27.526 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:46:27.526 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:46:27.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:27.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:29.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:29.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:29.343 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:46:29.402 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01dbd0) allocated [ CSSD]2013-05-23 10:46:29.403 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:46:29.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01dbd0 - 1,2,3 [ CSSD]2013-05-23 10:46:29.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac01dbd0) pid(19846) version 11:1:1:4 [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01dbd0), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0159d0 with con 0x7f82ac028c60, requested num -1 [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00e590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:46:29.421 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:46:29.430 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:46:29.430 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0159d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:46:29.430 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac023940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:29.430 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac023940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:46:29.632 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01dbd0 [ CSSD]2013-05-23 10:46:29.632 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01dbd0) con(0x7f82ac00afa0) skgpid ospid 19846 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:46:29.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:29.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:31.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:31.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:31.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:33.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:33.967 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:34.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:34.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:34.340 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac015c40), client(2/0x7f82ac0159d0) [ CSSD]2013-05-23 10:46:34.340 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:46:34.340 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:46:34.340 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 10:46:34.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:34.346 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:35.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:36.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:36.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:37.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:38.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:38.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:39.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:39.349 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:39.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:40.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:40.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:41.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:42.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:42.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:43.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:43.991 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:44.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:44.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:44.351 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:44.352 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:44.666 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:46:44.667 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:46:44.668 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:46:44.668 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02be90) pid(19992) version 11:1:1:4 [ CSSD]2013-05-23 10:46:44.674 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac02be90), client(1/0x7f82ac00e590) [ CSSD]2013-05-23 10:46:44.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:46:44.674 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e590 with con 0x7f82ac028c60, requested num -1 [ CSSD]2013-05-23 10:46:44.674 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:44.674 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:46:44.675 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:46:44.675 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:46:44.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:46:44.682 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:46:44.682 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00e700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:44.682 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00e700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:46:44.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:46:44.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac00afa0) skgpid ospid 19992 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:46:45.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:46.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:46.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:47.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:48.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:46:48.229 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:46:48.229 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:46:48.229 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac02be90) pid(20060) version 11:1:1:4 [ CSSD]2013-05-23 10:46:48.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:48.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac02be90), client(1/0x7f82ac00e590) [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e590 with con 0x7f82ac00afa0, requested num -1 [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:46:48.236 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:46:48.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:46:48.244 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:46:48.244 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00e700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:48.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00e700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:46:48.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:46:48.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac028c60) skgpid ospid 20060 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:46:49.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:49.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:49.354 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:50.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:50.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:51.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:52.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:52.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:53.357 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:53.357 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:46:53.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:54.017 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:46:54.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:54.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:55.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:56.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:56.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:57.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:58.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:46:58.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:46:58.360 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:46:58.360 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:46:59.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:46:59.920 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:46:59.921 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:46:59.921 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:46:59.921 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02be90) pid(20161) version 11:1:1:4 [ CSSD]2013-05-23 10:46:59.927 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac02be90), client(1/0x7f82ac00e7f0) [ CSSD]2013-05-23 10:46:59.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7f0) [ CSSD]2013-05-23 10:46:59.927 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7f0 with con 0x7f82ac00ffe0, requested num -1 [ CSSD]2013-05-23 10:46:59.927 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:59.927 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:46:59.928 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:46:59.928 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:46:59.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7f0) [ CSSD]2013-05-23 10:46:59.935 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:46:59.935 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fe60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:46:59.935 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fe60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:00.137 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:47:00.138 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac00afa0) skgpid ospid 20161 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:00.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:00.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:00.511 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:47:00.512 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:00.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:47:00.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02be90) pid(20208) version 11:1:1:4 [ CSSD]2013-05-23 10:47:00.518 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac02be90), client(1/0x7f82ac00e590) [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e590 with con 0x7f82ac028c60, requested num -1 [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:00.519 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:00.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e590) [ CSSD]2013-05-23 10:47:00.526 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:00.526 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00e700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:00.526 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00e700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:00.729 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:47:00.729 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac00afa0) skgpid ospid 20208 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:01.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:02.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:02.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:03.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:03.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:03.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:04.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:04.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:04.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:05.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:06.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:06.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:07.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:08.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:08.366 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:08.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:08.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:09.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:10.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:10.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:11.047 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02be90) allocated [ CSSD]2013-05-23 10:47:11.048 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:11.049 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02be90 - 1,2,3 [ CSSD]2013-05-23 10:47:11.049 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02be90) pid(20334) version 11:1:1:4 [ CSSD]2013-05-23 10:47:11.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:12.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:12.369 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:47:12.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:12.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:13.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:14.066 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:14.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:14.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:15.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:47:15.173 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:47:15.173 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:47:15.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac026330) pid(20660) version 11:1:1:4 [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac026330), client(1/0x7f82ac018f80) [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac018f80) [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac018f80 with con 0x7f82ac00e710, requested num -1 [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00f6c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:15.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:15.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac018f80) [ CSSD]2013-05-23 10:47:15.188 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac018f80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:15.188 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0190f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:15.188 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0190f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:15.390 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:47:15.390 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac028c60) skgpid ospid 20660 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:15.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:16.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:16.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:17.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:17.371 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:17.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:18.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:18.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:19.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:20.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:20.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:21.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:22.254 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e6c0) allocated [ CSSD]2013-05-23 10:47:22.255 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:22.256 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e6c0 - 1,2,3 [ CSSD]2013-05-23 10:47:22.256 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ff20) proc(0x7f82ac00e6c0) pid(20800/20800) version 11:1:1:4 [ CSSD]2013-05-23 10:47:22.273 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac00e6c0), client(1/0x7f82ac0160c0) [ CSSD]2013-05-23 10:47:22.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0160c0) [ CSSD]2013-05-23 10:47:22.273 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:47:22.273 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0160c0) [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0160c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0160c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e6c0 [ CSSD]2013-05-23 10:47:22.290 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e6c0) con(0x7f82ac00ff20) skgpid 20800 ospid 20800 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:22.375 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:22.375 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:22.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:22.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:23.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:24.092 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:24.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:24.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:25.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:26.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:26.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:27.378 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:27.378 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:27.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:28.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:28.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:29.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:30.014 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:47:30.015 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:30.015 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:47:30.015 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ff20) proc(0x7f82ac026330) pid(20866) version 11:1:1:4 [ CSSD]2013-05-23 10:47:30.023 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac026330), client(1/0x7f82ac0191e0) [ CSSD]2013-05-23 10:47:30.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0191e0) [ CSSD]2013-05-23 10:47:30.023 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0191e0 with con 0x7f82ac00e7e0, requested num -1 [ CSSD]2013-05-23 10:47:30.023 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:30.023 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00f6c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:30.024 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:30.024 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:30.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0191e0) [ CSSD]2013-05-23 10:47:30.032 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0191e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:30.032 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac015fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:30.032 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac015fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:30.234 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:47:30.234 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac00ff20) skgpid ospid 20866 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:30.427 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac023940) allocated [ CSSD]2013-05-23 10:47:30.428 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:47:30.429 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac023940 - 1,2,3 [ CSSD]2013-05-23 10:47:30.429 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026330) proc(0x7f82ac023940) pid(20879) version 11:1:1:4 [ CSSD]2013-05-23 10:47:30.434 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac023940), client(1/0x7f82ac0264b0) [ CSSD]2013-05-23 10:47:30.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0264b0) [ CSSD]2013-05-23 10:47:30.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0264b0 with con 0x7f82ac00f840, requested num -1 [ CSSD]2013-05-23 10:47:30.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:30.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018f80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:30.435 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:30.435 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:30.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0264b0) [ CSSD]2013-05-23 10:47:30.443 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0264b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:30.443 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00e710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:30.443 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00e710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:30.645 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac023940 [ CSSD]2013-05-23 10:47:30.645 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac023940) con(0x7f82ac026330) skgpid ospid 20879 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:30.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:30.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:31.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:32.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:32.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:32.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:32.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:33.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:34.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:34.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:34.764 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:35.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:36.383 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:36.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:47:36.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:36.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:37.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:38.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:38.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:39.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:40.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:40.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:41.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:41.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:41.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:42.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:42.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:43.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:44.144 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:44.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:44.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:45.679 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026330) allocated [ CSSD]2013-05-23 10:47:45.680 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:47:45.680 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026330 - 1,2,3 [ CSSD]2013-05-23 10:47:45.680 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac026330) pid(21036) version 11:1:1:4 [ CSSD]2013-05-23 10:47:45.697 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac026330), client(1/0x7f82ac018f80) [ CSSD]2013-05-23 10:47:45.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac018f80) [ CSSD]2013-05-23 10:47:45.697 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac018f80 with con 0x7f82ac00e710, requested num -1 [ CSSD]2013-05-23 10:47:45.697 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:45.697 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00f6c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:45.698 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:45.698 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:45.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac018f80) [ CSSD]2013-05-23 10:47:45.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac018f80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:45.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0190f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:45.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0190f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:45.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:45.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026330 [ CSSD]2013-05-23 10:47:45.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026330) con(0x7f82ac028c60) skgpid ospid 21036 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:46.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:46.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:46.685 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f6c0) allocated [ CSSD]2013-05-23 10:47:46.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:46.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f6c0 - 1,2,3 [ CSSD]2013-05-23 10:47:46.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac028c60) proc(0x7f82ac00f6c0) pid(21014/21014) version 11:1:1:4 [ CSSD]2013-05-23 10:47:46.702 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac00f6c0), client(1/0x7f82ac00f920) [ CSSD]2013-05-23 10:47:46.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00f920) [ CSSD]2013-05-23 10:47:46.702 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:47:46.702 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:47:46.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:46.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:47.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a70105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.630 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.630 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b4207a80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a80105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 10:47:47.631 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a90105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.631 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:47:47.632 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:47:47.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:47:47.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02aa0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.632 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.632 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ab0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.633 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:47:47.633 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:47:47.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ac0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.634 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.634 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ad0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.635 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:47:47.635 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ae0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02af0105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:47:47.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:47:47.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b00105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.637 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.637 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b10105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:47:47.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:47:47.638 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 10:47:47.638 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:47:47.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b20105) incarnation(174631049) [ CSSD]2013-05-23 10:47:47.639 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:47:47.639 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b4207a80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:47:47.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:47:47.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:47:47.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:48.492 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0232a0) allocated [ CSSD]2013-05-23 10:47:48.493 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:48.493 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0232a0 - 1,2,3 [ CSSD]2013-05-23 10:47:48.493 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e800) proc(0x7f82ac0232a0) pid(21099) version 11:1:1:4 [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0232a0), client(1/0x7f82ac023640) [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023640 with con 0x7f82ac0192a0, requested num -1 [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001f20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:47:48.500 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:47:48.507 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:47:48.507 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:47:48.507 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002220) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:47:48.507 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002220) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:47:48.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0232a0 [ CSSD]2013-05-23 10:47:48.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0232a0) con(0x7f82ac00e800) skgpid ospid 21099 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:48.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:48.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:49.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:50.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:50.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:51.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:51.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:51.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:52.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:52.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:53.353 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0015d0) allocated [ CSSD]2013-05-23 10:47:53.354 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:47:53.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0015d0 - 1,2,3 [ CSSD]2013-05-23 10:47:53.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac0015d0) pid(21140/21140) version 11:1:1:4 [ CSSD]2013-05-23 10:47:53.361 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0015d0), client(1/0x7f82ac001bf0) [ CSSD]2013-05-23 10:47:53.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001bf0) [ CSSD]2013-05-23 10:47:53.361 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:47:53.361 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001bf0) [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001bf0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001bf0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0015d0 [ CSSD]2013-05-23 10:47:53.658 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0015d0) con(0x7f82ac026590) skgpid 21140 ospid 21140 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:47:53.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:54.168 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:47:54.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:54.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:55.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:56.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:47:56.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:47:56.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:56.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:57.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:47:58.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:47:58.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:47:59.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:00.397 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:00.397 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:48:00.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0232a0) allocated [ CSSD]2013-05-23 10:48:00.946 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:48:00.947 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0232a0 - 1,2,3 [ CSSD]2013-05-23 10:48:00.947 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e800) proc(0x7f82ac0232a0) pid(21199) version 11:1:1:4 [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0232a0), client(1/0x7f82ac023640) [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023640 with con 0x7f82ac0192a0, requested num -1 [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001f20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:00.953 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:00.959 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:48:00.959 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:48:00.959 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002220) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:00.960 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002220) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:00.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:00.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:01.162 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0232a0 [ CSSD]2013-05-23 10:48:01.162 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0232a0) con(0x7f82ac00e800) skgpid ospid 21199 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:01.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:03.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:03.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:03.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:04.192 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:05.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:05.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:05.400 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:05.400 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:06.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:07.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:07.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:08.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:09.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:09.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:10.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:10.403 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:10.403 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:11.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:11.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:12.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:13.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:13.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:14.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:14.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:15.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:15.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:15.406 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:15.406 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:16.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:16.195 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0232a0) allocated [ CSSD]2013-05-23 10:48:16.196 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:48:16.197 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0232a0 - 1,2,3 [ CSSD]2013-05-23 10:48:16.197 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e800) proc(0x7f82ac0232a0) pid(21353) version 11:1:1:4 [ CSSD]2013-05-23 10:48:16.213 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82ac0232a0), client(1/0x7f82ac023640) [ CSSD]2013-05-23 10:48:16.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:48:16.213 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac023640 with con 0x7f82ac0192a0, requested num -1 [ CSSD]2013-05-23 10:48:16.213 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:16.213 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001f20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:48:16.214 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:16.214 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:16.221 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023640) [ CSSD]2013-05-23 10:48:16.221 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:48:16.221 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002220) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:16.221 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002220) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:16.423 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0232a0 [ CSSD]2013-05-23 10:48:16.423 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0232a0) con(0x7f82ac00e800) skgpid ospid 21353 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:17.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:17.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:17.351 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02be90 [ CSSD]2013-05-23 10:48:17.351 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02be90) con(0x7f82ac00afa0) skgpid ospid 20334 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:18.036 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bdd0) allocated [ CSSD]2013-05-23 10:48:18.037 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:48:18.038 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bdd0 - 1,2,3 [ CSSD]2013-05-23 10:48:18.038 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac02bdd0) pid(21407) version 11:1:1:4 [ CSSD]2013-05-23 10:48:18.045 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac02bdd0), client(1/0x7f82ac00afa0) [ CSSD]2013-05-23 10:48:18.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00afa0) [ CSSD]2013-05-23 10:48:18.045 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac00afa0 with con 0x7f82ac02c7c0, requested num -1 [ CSSD]2013-05-23 10:48:18.046 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:48:18.046 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 10:48:18.046 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:18.046 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:18.053 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00afa0) [ CSSD]2013-05-23 10:48:18.053 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00afa0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 10:48:18.053 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:48:18.053 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:18.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:18.160 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0235a0) allocated [ CSSD]2013-05-23 10:48:18.161 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:48:18.162 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0235a0 - 1,2,3 [ CSSD]2013-05-23 10:48:18.162 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac0235a0) pid(21412) version 11:1:1:4 [ CSSD]2013-05-23 10:48:18.179 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:48:18.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:48:18.184 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:48:18.186 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0235a0 [ CSSD]2013-05-23 10:48:18.186 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0235a0) con(0x7f82ac00afa0) skgpid ospid 21412 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:18.255 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bdd0 [ CSSD]2013-05-23 10:48:18.255 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bdd0) con(0x7f82ac026590) skgpid ospid 21407 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:19.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:19.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:20.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:20.409 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:20.409 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:21.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:21.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:22.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:23.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:23.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:24.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:24.246 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:25.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:25.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:25.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:25.411 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:26.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:27.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:27.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:28.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:29.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:29.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:30.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:30.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:30.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:31.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:31.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:31.459 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bdd0) allocated [ CSSD]2013-05-23 10:48:31.461 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:48:31.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bdd0 - 1,2,3 [ CSSD]2013-05-23 10:48:31.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02bdd0) pid(21508) version 11:1:1:4 [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac02bdd0), client(1/0x7f82ac026590) [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac026590) [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac026590 with con 0x7f82ac02c7c0, requested num -1 [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:31.467 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:31.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac026590) [ CSSD]2013-05-23 10:48:31.473 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac026590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:48:31.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:31.474 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:31.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bdd0 [ CSSD]2013-05-23 10:48:31.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bdd0) con(0x7f82ac00afa0) skgpid ospid 21508 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:32.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:33.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:33.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:34.268 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:34.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:35.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:35.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:35.417 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:35.417 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:36.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:37.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:37.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:38.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:39.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:39.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:40.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:40.420 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:40.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:41.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:41.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:41.424 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bdd0) allocated [ CSSD]2013-05-23 10:48:41.424 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:48:41.425 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bdd0 - 1,2,3 [ CSSD]2013-05-23 10:48:41.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02bdd0) pid(21633) version 11:1:1:4 [ CSSD]2013-05-23 10:48:42.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bdd0 [ CSSD]2013-05-23 10:48:42.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bdd0) con(0x7f82ac00afa0) skgpid ospid 21633 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:42.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:43.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:43.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:44.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:44.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:44.423 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:48:44.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:45.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:45.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:46.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:46.710 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bdd0) allocated [ CSSD]2013-05-23 10:48:46.711 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:48:46.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bdd0 - 1,2,3 [ CSSD]2013-05-23 10:48:46.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac02bdd0) pid(21817) version 11:1:1:4 [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac02bdd0), client(1/0x7f82ac00e7d0) [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00e7d0) [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00e7d0 with con 0x7f82ac02c7c0, requested num -1 [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:46.719 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:46.726 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00e7d0) [ CSSD]2013-05-23 10:48:46.726 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00e7d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:48:46.726 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01db10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:46.726 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01db10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:46.929 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bdd0 [ CSSD]2013-05-23 10:48:46.929 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bdd0) con(0x7f82ac00afa0) skgpid ospid 21817 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:47.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:47.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:48.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:48.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:48:48.553 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0214b0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:48:48.553 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0214b0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:48:48.553 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 10:48:48.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:48:48.557 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:48:48.557 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:48:48.558 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:48:48.558 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026860 [ CSSD]2013-05-23 10:48:48.558 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026860) con(0x7f82ac016210) skgpid 10790 ospid 10790 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:48.762 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:48:48.762 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:48:48.763 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:48:48.763 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac021270) pid(21880) version 11:1:1:4 [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021d90 with con 0x7f82ac002ac0, requested num -1 [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:48:48.770 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:48:48.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:48:48.777 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021d90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:48:48.777 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:48:48.777 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:48:48.979 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:48:48.979 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac026590) skgpid ospid 21880 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:48:49.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:49.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:49.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:49.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:50.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:51.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:51.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:52.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:53.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:53.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:54.313 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:48:54.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:54.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:54.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:55.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:55.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:56.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:57.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:57.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:48:58.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:48:59.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:48:59.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:48:59.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:48:59.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:00.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:01.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:01.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:01.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:01.964 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:49:01.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:01.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002ac0) proc(0x7f82ac021270) pid(21982) version 11:1:1:4 [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021d90 with con 0x7f82ac026590, requested num -1 [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:01.971 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:49:01.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:49:01.978 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021d90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:49:01.978 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:01.978 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:02.181 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:02.181 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac002ac0) skgpid ospid 21982 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:02.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:03.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:03.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:04.084 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:04.085 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:49:04.086 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:04.086 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac021270) pid(22036) version 11:1:1:4 [ CSSD]2013-05-23 10:49:04.205 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bdd0) allocated [ CSSD]2013-05-23 10:49:04.206 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:49:04.207 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bdd0 - 1,2,3 [ CSSD]2013-05-23 10:49:04.207 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002ac0) proc(0x7f82ac02bdd0) pid(22046) version 11:1:1:4 [ CSSD]2013-05-23 10:49:04.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:49:04.226 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:49:04.230 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bdd0 [ CSSD]2013-05-23 10:49:04.230 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bdd0) con(0x7f82ac002ac0) skgpid ospid 22046 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5278/0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5278 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac0214b0 with con 0x7f82ac00afa0, requested num -1 [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:04.308 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 10:49:04.314 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5278 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:04.314 [1199044928] >TRACE: clssgmExitGrock: client 5278 (0x7f82ac0214b0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 10:49:04.314 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:49:04.314 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:04.315 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:04.315 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac026590) skgpid ospid 22036 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:04.337 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:04.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:04.433 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:04.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:05.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:05.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:06.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:07.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:07.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:08.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:09.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:09.436 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:09.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:09.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:10.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:11.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:11.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:12.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:13.439 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:13.439 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:49:13.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:13.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:14.364 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:14.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:15.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:15.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:16.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:17.207 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:17.208 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:49:17.209 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:17.209 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac021270) pid(22147) version 11:1:1:4 [ CSSD]2013-05-23 10:49:17.215 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:17.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:17.215 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac026590, requested num -1 [ CSSD]2013-05-23 10:49:17.215 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:17.215 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:49:17.216 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:17.216 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:49:17.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:17.222 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:49:17.222 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:17.222 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:17.425 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:17.425 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac00afa0) skgpid ospid 22147 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:17.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:17.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:18.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:18.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:18.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:19.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:19.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:20.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:21.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:21.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:22.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:23.444 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:23.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:23.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:23.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:24.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:24.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:25.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:25.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:26.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:27.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:27.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:28.447 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:28.447 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:28.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:29.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:29.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:30.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:31.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:31.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:32.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:32.450 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:49:32.469 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:32.470 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:49:32.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:32.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac021270) pid(22284) version 11:1:1:4 [ CSSD]2013-05-23 10:49:32.477 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:32.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:32.477 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac002ac0, requested num -1 [ CSSD]2013-05-23 10:49:32.477 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:32.477 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:49:32.478 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:32.478 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:49:32.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:32.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:49:32.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:32.485 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:32.687 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:32.687 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac00afa0) skgpid ospid 22284 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:32.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:33.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:33.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:34.418 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:34.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:36.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:36.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:37.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:37.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:37.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:38.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:38.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:39.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:40.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:40.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:41.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:42.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:42.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:42.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:42.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:43.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:44.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:44.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:44.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:45.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:46.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:46.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:47.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:47.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:47.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:47.731 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:47.732 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:49:47.733 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:47.733 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac021270) pid(22430) version 11:1:1:4 [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac026590, requested num -1 [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:47.739 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:49:47.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:47.747 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:49:47.747 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:47.747 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:47.950 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:47.950 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac00afa0) skgpid ospid 22430 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:48.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:48.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:49.014 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:49:49.015 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:49:49.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:49:49.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac021270) pid(22481) version 11:1:1:4 [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac00afa0, requested num -1 [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:49:49.033 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:49:49.040 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:49:49.040 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:49:49.040 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:49:49.040 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:49:49.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:49.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:49:49.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac026590) skgpid ospid 22481 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:49:50.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:50.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:51.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:52.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:52.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:52.461 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:52.461 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:53.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:54.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:54.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:54.477 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:49:55.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:56.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:56.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:57.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:49:57.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:49:57.464 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:49:58.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:49:58.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:49:59.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:00.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:00.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:01.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:01.466 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:01.466 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:50:02.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:02.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:02.987 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021270) allocated [ CSSD]2013-05-23 10:50:02.988 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:50:02.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021270 - 1,2,3 [ CSSD]2013-05-23 10:50:02.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00afa0) proc(0x7f82ac021270) pid(22757) version 11:1:1:4 [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021270), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac026590, requested num -1 [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:50:02.995 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:50:03.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:03.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:50:03.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:03.004 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:50:03.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021270 [ CSSD]2013-05-23 10:50:03.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021270) con(0x7f82ac00afa0) skgpid ospid 22757 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:03.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:04.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:04.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:04.505 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:05.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:06.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:06.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:06.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:06.469 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:07.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:08.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:08.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:09.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:10.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:10.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:11.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:11.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:11.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:12.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:12.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:13.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac018dd0) [ CSSD]2013-05-23 10:50:13.135 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac018dd0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:50:13.135 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac018dd0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:50:13.135 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 10:50:13.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac02c040) [ CSSD]2013-05-23 10:50:13.138 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac02c040), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:50:13.138 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac02c040), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:50:13.138 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 10:50:13.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac02bba0) [ CSSD]2013-05-23 10:50:13.141 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac02bba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:50:13.141 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac02bba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:50:13.141 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:50:13.142 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02b5c0 [ CSSD]2013-05-23 10:50:13.142 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02b5c0) con(0x7f82ac029280) skgpid 15511 ospid 15511 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac028af0) [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac028af0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac028af0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac012df0 [ CSSD]2013-05-23 10:50:13.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac012df0) con(0x7f82ac027880) skgpid 15513 ospid 15513 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:13.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:14.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:14.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:14.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:15.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:16.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:16.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:16.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:16.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:17.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:18.242 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac028880) allocated [ CSSD]2013-05-23 10:50:18.243 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:50:18.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac028880 - 1,2,3 [ CSSD]2013-05-23 10:50:18.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f010) proc(0x7f82ac028880) pid(22950) version 11:1:1:4 [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac028880), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0214b0 with con 0x7f82ac00afa0, requested num -1 [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac027630/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:50:18.249 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:50:18.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:18.257 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0214b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:50:18.257 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01d760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:18.257 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01d760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:50:18.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:18.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:18.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac028880 [ CSSD]2013-05-23 10:50:18.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac028880) con(0x7f82ac00f010) skgpid ospid 22950 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:19.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:20.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:20.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:21.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:21.477 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:21.477 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:22.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:22.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:23.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:24.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:24.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:24.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:25.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:25.479 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:25.479 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:50:26.374 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac028880) allocated [ CSSD]2013-05-23 10:50:26.375 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:50:26.375 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac028880 - 1,2,3 [ CSSD]2013-05-23 10:50:26.375 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002ac0) proc(0x7f82ac028880) pid(22901/22901) version 11:1:1:4 [ CSSD]2013-05-23 10:50:26.391 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac028880), client(1/0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:26.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:50:26.392 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:50:26.392 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 10:50:26.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:26.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:27.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:28.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:28.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:29.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:30.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:30.482 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:30.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:30.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:31.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:32.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:32.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:33.493 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026860) allocated [ CSSD]2013-05-23 10:50:33.494 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:50:33.495 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026860 - 1,2,3 [ CSSD]2013-05-23 10:50:33.495 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac026860) pid(23117) version 11:1:1:4 [ CSSD]2013-05-23 10:50:33.501 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac026860), client(1/0x7f82ac01d810) [ CSSD]2013-05-23 10:50:33.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:33.501 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01d810 with con 0x7f82ac02c7c0, requested num -1 [ CSSD]2013-05-23 10:50:33.501 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:33.501 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac027630/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:50:33.502 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:50:33.502 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:50:33.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:33.510 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01d810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:50:33.510 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac017830) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:33.510 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac017830) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:50:33.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:33.713 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026860 [ CSSD]2013-05-23 10:50:33.713 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026860) con(0x7f82ac026590) skgpid ospid 23117 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:34.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:34.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:34.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:35.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:35.485 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:35.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:36.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:36.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:37.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:38.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:38.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:39.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:40.488 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:40.488 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:40.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:40.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:41.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:42.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:42.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:43.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:44.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:44.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:44.606 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:45.491 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:45.491 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:45.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:46.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:46.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:47.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:48.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:48.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:48.746 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac023fe0) allocated [ CSSD]2013-05-23 10:50:48.748 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:50:48.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac023fe0 - 1,2,3 [ CSSD]2013-05-23 10:50:48.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac023fe0) pid(23295) version 11:1:1:4 [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac023fe0), client(1/0x7f82ac01d810) [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01d810 with con 0x7f82ac00f010, requested num -1 [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac027630/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:50:48.755 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:50:48.763 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:48.763 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01d810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:50:48.763 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac017830) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:48.763 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac017830) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:50:48.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac023fe0 [ CSSD]2013-05-23 10:50:48.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac023fe0) con(0x7f82ac026590) skgpid ospid 23295 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:49.289 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01dbe0) allocated [ CSSD]2013-05-23 10:50:49.290 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:50:49.291 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01dbe0 - 1,2,3 [ CSSD]2013-05-23 10:50:49.291 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c7c0) proc(0x7f82ac01dbe0) pid(23339) version 11:1:1:4 [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac01dbe0), client(1/0x7f82ac01d810) [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01d810 with con 0x7f82ac00f010, requested num -1 [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac027630/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:50:49.297 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:50:49.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:49.304 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01d810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:50:49.304 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac023fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:50:49.305 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac023fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:50:49.507 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01dbe0 [ CSSD]2013-05-23 10:50:49.507 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01dbe0) con(0x7f82ac02c7c0) skgpid ospid 23339 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:50:49.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:50.494 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:50.494 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:50.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:50.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:51.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:52.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:52.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:53.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:54.472 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac026860) allocated [ CSSD]2013-05-23 10:50:54.473 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:50:54.473 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac026860 - 1,2,3 [ CSSD]2013-05-23 10:50:54.473 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac026590) proc(0x7f82ac026860) pid(22899/22899) version 11:1:1:4 [ CSSD]2013-05-23 10:50:54.490 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac026860), client(1/0x7f82ac01d810) [ CSSD]2013-05-23 10:50:54.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:50:54.490 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:50:54.490 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:50:54.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:54.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:54.629 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:50:55.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:50:55.497 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:50:55.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:56.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:56.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:57.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:50:58.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:50:58.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:50:59.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:00.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:00.500 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:00.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:00.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:01.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:02.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:02.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:03.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:04.001 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac018dd0) allocated [ CSSD]2013-05-23 10:51:04.002 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:51:04.003 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac018dd0 - 1,2,3 [ CSSD]2013-05-23 10:51:04.003 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015e40) proc(0x7f82ac018dd0) pid(23451) version 11:1:1:4 [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac018dd0), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021d90 with con 0x7f82ac0277b0, requested num -1 [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0232f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:51:04.010 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:51:04.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:04.017 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021d90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:51:04.017 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0235f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:04.018 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0235f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:51:04.220 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac018dd0 [ CSSD]2013-05-23 10:51:04.220 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac018dd0) con(0x7f82ac015e40) skgpid ospid 23451 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:04.652 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:04.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:04.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:05.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:05.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:05.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:06.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:06.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:07.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:08.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:08.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:09.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:09.505 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:51:09.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:10.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:10.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:11.259 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac017900) allocated [ CSSD]2013-05-23 10:51:11.260 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:51:11.261 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac017900 - 1,2,3 [ CSSD]2013-05-23 10:51:11.261 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c7c0) proc(0x7f82ac017900) pid(23543/23543) version 11:1:1:4 [ CSSD]2013-05-23 10:51:11.267 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac017900), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.267 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.268 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:51:11.268 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac017900 [ CSSD]2013-05-23 10:51:11.313 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac017900) con(0x7f82ac02c7c0) skgpid 23543 ospid 23543 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:11.489 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006fa0) allocated [ CSSD]2013-05-23 10:51:11.490 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:51:11.490 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006fa0 - 1,2,3 [ CSSD]2013-05-23 10:51:11.490 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c7c0) proc(0x7f82ac006fa0) pid(23546/23546) version 11:1:1:4 [ CSSD]2013-05-23 10:51:11.497 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac006fa0), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.497 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:51:11.497 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006fa0 [ CSSD]2013-05-23 10:51:11.549 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006fa0) con(0x7f82ac02c7c0) skgpid 23546 ospid 23546 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:11.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:12.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:12.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:13.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:14.508 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:14.508 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:14.678 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:14.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:14.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:15.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:16.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:16.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:17.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:17.401 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:17.402 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:17.402 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:17.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:18.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac02c960) [ CSSD]2013-05-23 10:51:18.587 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac02c960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:51:18.587 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac02c960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:51:18.587 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:51:18.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02c4f0 [ CSSD]2013-05-23 10:51:18.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02c4f0) con(0x7f82ac0210f0) skgpid 18215 ospid 18215 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:18.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:18.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:19.263 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac017830) allocated [ CSSD]2013-05-23 10:51:19.264 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:51:19.265 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac017830 - 1,2,3 [ CSSD]2013-05-23 10:51:19.265 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac017830) pid(23625) version 11:1:1:4 [ CSSD]2013-05-23 10:51:19.271 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac017830), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:51:19.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:19.271 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021d90 with con 0x7f82ac02c7c0, requested num -1 [ CSSD]2013-05-23 10:51:19.271 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:19.271 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:51:19.272 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:51:19.272 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:51:19.278 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:19.278 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021d90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:51:19.278 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:19.278 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:51:19.480 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac017830 [ CSSD]2013-05-23 10:51:19.481 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac017830) con(0x7f82ac0210f0) skgpid ospid 23625 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:19.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:19.511 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:19.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:20.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:20.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:20.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b30105) incarnation(174631049) [ CSSD]2013-05-23 10:51:20.732 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:51:20.732 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:51:20.734 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:20.734 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:51:20.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:20.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:21.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:22.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:22.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:23.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:24.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:24.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:24.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:25.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:25.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:25.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:27.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:27.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:27.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:29.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:29.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:29.442 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac017830) allocated [ CSSD]2013-05-23 10:51:29.443 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:51:29.444 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac017830 - 1,2,3 [ CSSD]2013-05-23 10:51:29.444 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0210f0) proc(0x7f82ac017830) pid(23617/23617) version 11:1:1:4 [ CSSD]2013-05-23 10:51:29.460 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac017830), client(1/0x7f82ac021d90) [ CSSD]2013-05-23 10:51:29.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 10:51:29.460 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:51:29.460 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:51:29.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:29.517 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:29.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:31.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:31.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:32.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:33.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:33.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:33.519 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:33.519 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:51:33.995 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac028880), client(2/0x7f82ac017a50) [ CSSD]2013-05-23 10:51:33.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac017a50) [ CSSD]2013-05-23 10:51:33.996 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:51:33.996 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 10:51:34.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:34.515 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:51:34.516 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:51:34.517 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:51:34.517 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(23770) version 11:1:1:4 [ CSSD]2013-05-23 10:51:34.523 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:51:34.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:34.523 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac016590 with con 0x7f82ac01fc30, requested num -1 [ CSSD]2013-05-23 10:51:34.523 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:34.523 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001470/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:51:34.524 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:51:34.524 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:51:34.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:34.532 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:51:34.532 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fab0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:34.532 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:51:34.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:51:34.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid ospid 23770 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:34.764 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:35.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:35.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:36.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:37.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:37.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:38.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:38.522 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:38.522 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:39.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:39.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:40.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:41.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:41.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:42.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:43.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:43.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:43.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:43.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:44.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:44.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:45.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:45.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:46.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:47.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:47.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:48.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:48.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:48.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:49.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:49.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:49.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01fb30) allocated [ CSSD]2013-05-23 10:51:49.549 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:51:49.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01fb30 - 1,2,3 [ CSSD]2013-05-23 10:51:49.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c340) proc(0x7f82ac01fb30) pid(23918) version 11:1:1:4 [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01fb30), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac016590 with con 0x7f82ac01fa50, requested num -1 [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:51:49.557 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:51:49.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.564 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:51:49.564 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:49.564 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:51:49.767 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01fb30 [ CSSD]2013-05-23 10:51:49.767 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01fb30) con(0x7f82ac02c340) skgpid ospid 23918 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:49.768 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:51:49.769 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:51:49.770 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:51:49.770 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c340) proc(0x7f82ac0101a0) pid(23927) version 11:1:1:4 [ CSSD]2013-05-23 10:51:49.775 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.775 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.775 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac016590 with con 0x7f82ac0236c0, requested num -1 [ CSSD]2013-05-23 10:51:49.775 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:49.775 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac002360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:51:49.776 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:51:49.776 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:51:49.783 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:51:49.783 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:51:49.783 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:51:49.783 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:51:49.986 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:51:49.986 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac02c340) skgpid ospid 23927 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:51:50.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:51.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:51.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:52.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:53.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:53.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:53.530 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:53.530 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:51:54.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:54.809 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:51:55.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:55.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:56.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:57.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:57.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:51:57.532 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:51:57.533 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:51:58.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:51:59.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:51:59.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:00.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:01.143 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:01.143 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:01.144 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:01.144 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24175) version 11:1:1:4 [ CSSD]2013-05-23 10:52:01.187 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.187 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac016590 with con 0x7f82ac01fc30, requested num -1 [ CSSD]2013-05-23 10:52:01.187 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:01.187 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001470/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 10:52:01.188 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:01.188 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:01.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.191 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 10:52:01.191 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fab0) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:01.191 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac01fab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:01.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:01.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:01.235 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:01.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid ospid 24175 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:01.652 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01fb30) allocated [ CSSD]2013-05-23 10:52:01.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:01.653 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01fb30 - 1,2,3 [ CSSD]2013-05-23 10:52:01.653 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c340) proc(0x7f82ac01fb30) pid(24242) version 11:1:1:4 [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01fb30), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac016590 with con 0x7f82ac01fa50, requested num -1 [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001210/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:01.683 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:01.685 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.685 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 10:52:01.685 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001510) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:01.685 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac001510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac01fb30), client(2/0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac016590 with con 0x7f82ac01fa50, requested num -1 [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010270/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:01.732 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:01.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:01.766 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 10:52:01.766 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac010570) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:01.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac010570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:01.826 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01fb30 [ CSSD]2013-05-23 10:52:01.826 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01fb30) con(0x7f82ac02c340) skgpid ospid 24242 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:02.226 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac010520) allocated [ CSSD]2013-05-23 10:52:02.227 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:02.227 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac010520 - 1,2,3 [ CSSD]2013-05-23 10:52:02.227 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c340) proc(0x7f82ac010520) pid(24307) version 11:1:1:4 [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac010520), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac016590 with con 0x7f82ac0014e0, requested num -1 [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f180/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:02.278 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:02.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.279 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 10:52:02.279 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001360) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:02.279 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac001360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:02.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac010520), client(2/0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac016590 with con 0x7f82ac0014e0, requested num -1 [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac023220/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:02.306 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:02.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.331 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 10:52:02.331 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fb80) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:02.331 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac01fb80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:02.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac010520 [ CSSD]2013-05-23 10:52:02.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac010520) con(0x7f82ac02c340) skgpid ospid 24307 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:02.535 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:02.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:02.613 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:02.614 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:02.614 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:02.614 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fd00) proc(0x7f82ac0101a0) pid(24345) version 11:1:1:4 [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac023480 with con 0x7f82ac002650, requested num -1 [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac019030/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:02.651 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:02.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.652 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac023480), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 10:52:02.652 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01f3d0) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 10:52:02.652 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac01f3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:02.683 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(2/0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.683 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac016590 with con 0x7f82ac002650, requested num -1 [ CSSD]2013-05-23 10:52:02.683 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:02.683 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018ea0/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 10:52:02.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:02.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:02.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:02.705 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac016590), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 10:52:02.705 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0191a0) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 10:52:02.705 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac0191a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(3/0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 3 (0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.HWPROD new client 0x7f82ac023480 with con 0x7f82ac002650, requested num -1 [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.HWPROD [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.HWPROD) [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.HWPROD) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:02.707 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.HWPROD member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:02.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 3 (0x7f82ac023480) [ CSSD]2013-05-23 10:52:02.803 [1199044928] >TRACE: clssgmExitGrock: client 3 (0x7f82ac023480), grock SRVM.HWPROD, member 0 [ CSSD]2013-05-23 10:52:02.803 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0190d0) in global grock SRVM.HWPROD [ CSSD]2013-05-23 10:52:02.803 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.HWPROD, member number 0 (0x7f82ac0190d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:02.828 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:02.828 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac01fd00) skgpid ospid 24345 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:03.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:03.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:04.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:04.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:05.019 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:05.020 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:52:05.021 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:05.021 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24432) version 11:1:1:4 [ CSSD]2013-05-23 10:52:05.027 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:05.027 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:05.027 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac016590 with con 0x7f82ac01fc30, requested num -1 [ CSSD]2013-05-23 10:52:05.027 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:05.027 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001470/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:52:05.028 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:05.028 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:05.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:05.034 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac016590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:52:05.034 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fab0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:05.034 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:05.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:05.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:05.237 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:05.237 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid ospid 24432 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:06.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:07.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:07.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:07.538 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:07.538 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:08.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:08.525 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:08.526 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:08.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:08.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24499/24499) version 11:1:1:4 [ CSSD]2013-05-23 10:52:08.532 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.532 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:08.532 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:52:08.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.612 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:08.612 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:08.613 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:52:08.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:08.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid 24499 ospid 24499 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:08.761 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:08.762 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:08.762 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:08.762 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24506/24506) version 11:1:1:4 [ CSSD]2013-05-23 10:52:08.778 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.778 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:08.778 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:52:08.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:08.834 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:08.834 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:08.834 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:52:08.834 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:08.834 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid 24506 ospid 24506 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:09.227 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:09.228 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:09.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:09.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24509/24509) version 11:1:1:4 [ CSSD]2013-05-23 10:52:09.244 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0101a0), client(1/0x7f82ac016590) [ CSSD]2013-05-23 10:52:09.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:09.244 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:09.244 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:52:09.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:09.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:10.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac016590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:52:10.552 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid 24509 ospid 24509 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:10.873 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0101a0) allocated [ CSSD]2013-05-23 10:52:10.874 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:10.874 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0101a0 - 1,2,3 [ CSSD]2013-05-23 10:52:10.874 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0232e0) proc(0x7f82ac0101a0) pid(24565) version 11:1:1:4 [ CSSD]2013-05-23 10:52:11.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:11.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:12.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:12.541 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:12.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:13.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:13.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:14.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:14.855 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:15.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:15.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:16.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:17.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:17.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:17.544 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:17.544 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:18.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:19.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:19.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:20.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b10) allocated [ CSSD]2013-05-23 10:52:20.272 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:52:20.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b10 - 1,2,3 [ CSSD]2013-05-23 10:52:20.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018dd0) proc(0x7f82ac005b10) pid(24980) version 11:1:1:4 [ CSSD]2013-05-23 10:52:20.278 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac005b10), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 10:52:20.278 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:52:20.278 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fd10 with con 0x7f82ac005a30, requested num -1 [ CSSD]2013-05-23 10:52:20.278 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:20.278 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:52:20.279 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:20.279 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:20.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 10:52:20.286 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fd10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:52:20.286 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:20.286 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:20.489 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b10 [ CSSD]2013-05-23 10:52:20.489 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b10) con(0x7f82ac018dd0) skgpid ospid 24980 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:20.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:21.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:21.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:21.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:21.546 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:52:22.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:22.625 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac017830), client(2/0x7f82ac016590) [ CSSD]2013-05-23 10:52:22.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 10:52:22.625 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:52:22.625 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 10:52:22.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0060a0) allocated [ CSSD]2013-05-23 10:52:22.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:22.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0060a0 - 1,2,3 [ CSSD]2013-05-23 10:52:22.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017a0) proc(0x7f82ac0060a0) pid(25043/25043) version 11:1:1:4 [ CSSD]2013-05-23 10:52:22.757 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac0060a0), client(1/0x7f82ac006550) [ CSSD]2013-05-23 10:52:22.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:22.757 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:22.757 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:52:22.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:22.775 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:22.775 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:22.775 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:52:22.775 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0060a0 [ CSSD]2013-05-23 10:52:22.775 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0060a0) con(0x7f82ac0017a0) skgpid 25043 ospid 25043 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:23.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:23.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:24.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:24.881 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:25.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:25.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:26.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:26.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:26.549 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:27.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:27.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:28.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:28.791 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0060a0) allocated [ CSSD]2013-05-23 10:52:28.792 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:28.793 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0060a0 - 1,2,3 [ CSSD]2013-05-23 10:52:28.793 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017a0) proc(0x7f82ac0060a0) pid(25087/25087) version 11:1:1:4 [ CSSD]2013-05-23 10:52:28.799 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac0060a0), client(1/0x7f82ac006550) [ CSSD]2013-05-23 10:52:28.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:28.799 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:28.799 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0060a0 [ CSSD]2013-05-23 10:52:28.903 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0060a0) con(0x7f82ac0017a0) skgpid 25087 ospid 25087 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:29.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:29.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:30.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:31.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:31.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:31.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:31.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:32.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:33.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:33.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:34.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:34.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:35.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:35.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:35.522 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002500) allocated [ CSSD]2013-05-23 10:52:35.523 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:52:35.524 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002500 - 1,2,3 [ CSSD]2013-05-23 10:52:35.524 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018dd0) proc(0x7f82ac002500) pid(25327) version 11:1:1:4 [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac002500), client(1/0x7f82ac006550) [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006550 with con 0x7f82ac002420, requested num -1 [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0066c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:35.530 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:35.536 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006550) [ CSSD]2013-05-23 10:52:35.536 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:52:35.536 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0069c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:35.536 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0069c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:35.739 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002500 [ CSSD]2013-05-23 10:52:35.739 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002500) con(0x7f82ac018dd0) skgpid ospid 25327 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:36.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:36.555 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:36.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:37.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:37.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:38.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:39.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:39.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:40.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:41.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:41.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:41.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:41.558 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:42.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:43.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac024c30) [ CSSD]2013-05-23 10:52:43.149 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac024c30), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:52:43.149 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac024c30), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:52:43.149 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac027590) [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac027590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac027590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021700 [ CSSD]2013-05-23 10:52:43.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021700) con(0x7f82ac00ed30) skgpid 13558 ospid 13558 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:43.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:43.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:44.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:44.930 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:45.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:45.561 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:52:45.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:45.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:46.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:47.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:47.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:48.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:49.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:49.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:49.805 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0217d0) allocated [ CSSD]2013-05-23 10:52:49.806 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:49.807 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0217d0 - 1,2,3 [ CSSD]2013-05-23 10:52:49.807 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018dd0) proc(0x7f82ac0217d0) pid(25508) version 11:1:1:4 [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0217d0), client(1/0x7f82ac027d30) [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac027d30 with con 0x7f82ac020310, requested num -1 [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00df90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:49.813 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:49.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:52:49.819 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac027d30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:52:49.820 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0149d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:49.820 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0149d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:50.022 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0217d0 [ CSSD]2013-05-23 10:52:50.022 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0217d0) con(0x7f82ac018dd0) skgpid ospid 25508 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:50.564 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:50.564 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:50.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac021700) allocated [ CSSD]2013-05-23 10:52:50.776 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:52:50.777 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac021700 - 1,2,3 [ CSSD]2013-05-23 10:52:50.777 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac021700) pid(25523) version 11:1:1:4 [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac021700), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024c30 with con 0x7f82ac00ed30, requested num -1 [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00df90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:52:50.793 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:52:50.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:52:50.800 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:52:50.800 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac014900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:52:50.800 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac014900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:52:51.003 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac021700 [ CSSD]2013-05-23 10:52:51.003 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac021700) con(0x7f82ac020310) skgpid ospid 25523 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:51.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:51.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:52.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:53.525 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0273f0) allocated [ CSSD]2013-05-23 10:52:53.526 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:52:53.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0273f0 - 1,2,3 [ CSSD]2013-05-23 10:52:53.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018dd0) proc(0x7f82ac0273f0) pid(25592/25592) version 11:1:1:4 [ CSSD]2013-05-23 10:52:53.544 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0273f0), client(1/0x7f82ac027d30) [ CSSD]2013-05-23 10:52:53.544 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:52:53.544 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:52:53.544 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:52:53.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:53.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac027d30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac027d30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0273f0 [ CSSD]2013-05-23 10:52:53.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0273f0) con(0x7f82ac018dd0) skgpid 25592 ospid 25592 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:52:54.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:54.960 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:52:55.566 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:52:55.566 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:52:55.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:55.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:56.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:57.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:57.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:52:58.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:52:59.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:52:59.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:00.569 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:00.569 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:00.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:01.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:01.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:02.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:03.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:03.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:04.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:04.986 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:05.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:05.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:05.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:05.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:06.037 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0217d0) allocated [ CSSD]2013-05-23 10:53:06.038 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:53:06.038 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0217d0 - 1,2,3 [ CSSD]2013-05-23 10:53:06.038 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0217d0) pid(25686) version 11:1:1:4 [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0217d0), client(1/0x7f82ac027d30) [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac027d30 with con 0x7f82ac018dd0, requested num -1 [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00df90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:06.045 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:06.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac027d30) [ CSSD]2013-05-23 10:53:06.052 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac027d30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:53:06.052 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0149d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:06.052 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0149d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:06.255 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0217d0 [ CSSD]2013-05-23 10:53:06.255 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0217d0) con(0x7f82ac020310) skgpid ospid 25686 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:06.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:07.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:07.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:09.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:09.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:09.574 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:53:09.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:09.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:11.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:11.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:11.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:13.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:13.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:13.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:14.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:14.576 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:15.010 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:15.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:15.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:15.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:17.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:17.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:17.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:18.328 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0217d0) allocated [ CSSD]2013-05-23 10:53:18.329 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:53:18.329 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0217d0 - 1,2,3 [ CSSD]2013-05-23 10:53:18.329 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018dd0) proc(0x7f82ac0217d0) pid(25828) version 11:1:1:4 [ CSSD]2013-05-23 10:53:18.336 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0217d0), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:53:18.336 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:18.336 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac024c30 with con 0x7f82ac020310, requested num -1 [ CSSD]2013-05-23 10:53:18.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:53:18.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00df90/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 10:53:18.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:18.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:18.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:18.344 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 10:53:18.344 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0149d0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:53:18.344 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac0149d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:18.451 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0060a0) allocated [ CSSD]2013-05-23 10:53:18.452 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:53:18.453 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0060a0 - 1,2,3 [ CSSD]2013-05-23 10:53:18.453 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ed30) proc(0x7f82ac0060a0) pid(25833) version 11:1:1:4 [ CSSD]2013-05-23 10:53:18.468 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:53:18.470 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:53:18.472 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:53:18.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0060a0 [ CSSD]2013-05-23 10:53:18.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0060a0) con(0x7f82ac00ed30) skgpid ospid 25833 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:18.547 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0217d0 [ CSSD]2013-05-23 10:53:18.547 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0217d0) con(0x7f82ac018dd0) skgpid ospid 25828 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:19.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:19.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:19.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:19.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:19.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:21.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:21.292 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0273f0) allocated [ CSSD]2013-05-23 10:53:21.293 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:53:21.293 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0273f0 - 1,2,3 [ CSSD]2013-05-23 10:53:21.293 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0273f0) pid(25874) version 11:1:1:4 [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0273f0), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024c30 with con 0x7f82ac00ed30, requested num -1 [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00df90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:21.300 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:21.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:21.307 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:53:21.307 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0149d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:21.308 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0149d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:21.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0273f0 [ CSSD]2013-05-23 10:53:21.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0273f0) con(0x7f82ac020310) skgpid ospid 25874 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:21.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:21.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:23.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:23.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:23.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:24.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:24.582 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:25.040 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:25.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:25.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:25.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:27.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:27.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:27.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:29.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:29.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:29.585 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:29.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:29.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:31.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:31.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:31.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:33.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:33.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:33.587 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:53:34.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:34.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:34.199 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0101a0 [ CSSD]2013-05-23 10:53:34.199 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0101a0) con(0x7f82ac0232e0) skgpid ospid 24565 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:35.071 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:35.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:36.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:36.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:36.543 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0217d0) allocated [ CSSD]2013-05-23 10:53:36.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:53:36.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0217d0 - 1,2,3 [ CSSD]2013-05-23 10:53:36.545 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0217d0) pid(26033) version 11:1:1:4 [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0217d0), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024c30 with con 0x7f82ac00ed30, requested num -1 [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0101a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:36.552 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:36.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:36.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:53:36.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0104a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:36.560 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0104a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:36.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0217d0 [ CSSD]2013-05-23 10:53:36.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0217d0) con(0x7f82ac020310) skgpid ospid 26033 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:37.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:38.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:38.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:38.341 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0217d0) allocated [ CSSD]2013-05-23 10:53:38.341 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:53:38.342 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0217d0 - 1,2,3 [ CSSD]2013-05-23 10:53:38.342 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0217d0) pid(26090/26090) version 11:1:1:4 [ CSSD]2013-05-23 10:53:38.359 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0217d0), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:53:38.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:53:38.359 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:53:38.359 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:53:38.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:38.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:39.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:40.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:40.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:40.722 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac023220) allocated [ CSSD]2013-05-23 10:53:40.723 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:53:40.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac023220 - 1,2,3 [ CSSD]2013-05-23 10:53:40.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027d20) proc(0x7f82ac023220) pid(26124) version 11:1:1:4 [ CSSD]2013-05-23 10:53:41.283 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac023220 [ CSSD]2013-05-23 10:53:41.283 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac023220) con(0x7f82ac027d20) skgpid ospid 26124 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:41.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:42.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:42.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:43.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:43.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:43.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:44.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:44.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:45.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:45.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:46.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:46.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:47.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:48.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:48.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:48.596 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:48.596 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:48.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac024250) [ CSSD]2013-05-23 10:53:48.605 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac024250), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:53:48.605 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac024250), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:53:48.605 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0140c0 [ CSSD]2013-05-23 10:53:48.616 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0140c0) con(0x7f82ac01de30) skgpid 14436 ospid 14436 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:49.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:50.065 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:53:50.066 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:53:50.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:53:50.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26358) version 11:1:1:4 [ CSSD]2013-05-23 10:53:50.073 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:50.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:50.073 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac021c00, requested num -1 [ CSSD]2013-05-23 10:53:50.073 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:50.073 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:53:50.074 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:50.074 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:50.081 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:50.081 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:53:50.081 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c1b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:50.081 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c1b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:50.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:50.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:50.284 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:53:50.284 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid ospid 26358 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:51.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:51.797 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:53:51.798 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:53:51.799 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:53:51.799 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26373) version 11:1:1:4 [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac021c00, requested num -1 [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:53:51.805 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:53:51.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:53:51.812 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:53:51.812 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c1b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:53:51.812 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c1b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:53:52.015 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:53:52.015 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid ospid 26373 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:53:52.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:52.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:53.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:53.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:53.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:53:54.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:54.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:55.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:53:55.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:56.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:56.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:57.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:53:57.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:53:57.601 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:53:58.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:53:58.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:53:59.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:00.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:00.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:01.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:02.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:02.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:02.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:02.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:03.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:04.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:04.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:04.399 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:04.400 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:04.400 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:04.400 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26502) version 11:1:1:4 [ CSSD]2013-05-23 10:54:04.530 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac015840) allocated [ CSSD]2013-05-23 10:54:04.531 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:04.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac015840 - 1,2,3 [ CSSD]2013-05-23 10:54:04.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027d20) proc(0x7f82ac015840) pid(26512) version 11:1:1:4 [ CSSD]2013-05-23 10:54:04.550 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:54:04.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:54:04.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015840 [ CSSD]2013-05-23 10:54:04.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015840) con(0x7f82ac027d20) skgpid ospid 26512 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5279/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5279 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac00ede0 with con 0x7f82ac027d20, requested num -1 [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac008d90/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:04.622 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 10:54:04.628 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5279 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:04.628 [1199044928] >TRACE: clssgmExitGrock: client 5279 (0x7f82ac00ede0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 10:54:04.628 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac009090) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:54:04.628 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac009090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:04.630 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:04.630 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid ospid 26502 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:05.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:05.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:06.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:06.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:07.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:07.043 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:54:07.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:07.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26536) version 11:1:1:4 [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac027d20, requested num -1 [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:07.060 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:54:07.067 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:07.067 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:54:07.067 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0140c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:07.067 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0140c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:07.269 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:07.269 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid ospid 26536 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:07.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:07.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:07.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:08.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:08.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:09.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:10.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:10.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:11.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:12.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:12.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:12.610 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:12.610 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:13.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:14.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:14.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:15.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:15.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:16.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:16.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:17.613 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:17.613 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:17.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:18.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:18.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:19.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:20.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:20.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:21.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:21.616 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:54:21.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:22.304 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:22.305 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:54:22.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:22.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027d20) proc(0x7f82ac0266a0) pid(26699) version 11:1:1:4 [ CSSD]2013-05-23 10:54:22.312 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:22.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:22.312 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac021c00, requested num -1 [ CSSD]2013-05-23 10:54:22.312 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:22.312 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:54:22.313 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:22.313 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:54:22.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:22.320 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:54:22.320 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac02c1b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:22.320 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac02c1b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:22.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:22.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:22.523 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:22.523 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac027d20) skgpid ospid 26699 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:23.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:24.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:24.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:25.213 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:25.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:26.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:26.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:26.619 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:26.619 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:27.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:28.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:28.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:29.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:30.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:30.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:31.622 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:31.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:31.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:32.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:32.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:33.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:33.955 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:33.956 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:33.957 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:33.957 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26820/26820) version 11:1:1:4 [ CSSD]2013-05-23 10:54:33.974 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:33.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:33.974 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:54:33.974 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:34.138 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid 26820 ospid 26820 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:34.351 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:34.351 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:34.352 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:34.352 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26830/26830) version 11:1:1:4 [ CSSD]2013-05-23 10:54:34.369 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.369 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:54:34.369 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:54:34.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.384 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:54:34.384 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:54:34.384 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:54:34.385 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:34.385 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid 26830 ospid 26830 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:34.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:34.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:34.598 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:34.599 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:34.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:34.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26834/26834) version 11:1:1:4 [ CSSD]2013-05-23 10:54:34.615 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.615 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:54:34.615 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:34.790 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid 26834 ospid 26834 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:35.243 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:35.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:36.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:36.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:36.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:36.625 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:37.569 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:37.571 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:54:37.571 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:37.571 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac0266a0) pid(26857) version 11:1:1:4 [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ede0 with con 0x7f82ac027d20, requested num -1 [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:37.578 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:54:37.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:37.585 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ede0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:54:37.585 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0140c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:37.585 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0140c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:37.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 10:54:37.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac01de30) skgpid ospid 26857 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:37.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:38.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:38.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:39.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:40.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:40.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:40.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:40.627 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:54:42.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:42.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:42.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:44.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:44.464 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0266a0) allocated [ CSSD]2013-05-23 10:54:44.465 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:44.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0266a0 - 1,2,3 [ CSSD]2013-05-23 10:54:44.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027d20) proc(0x7f82ac0266a0) pid(26340/26340) version 11:1:1:4 [ CSSD]2013-05-23 10:54:44.483 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0266a0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:44.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 10:54:44.483 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:54:44.483 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:54:44.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:44.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:45.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:45.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:45.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:46.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:46.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:46.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:48.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:48.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:48.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:50.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:50.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008ff0) allocated [ CSSD]2013-05-23 10:54:50.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:50.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008ff0 - 1,2,3 [ CSSD]2013-05-23 10:54:50.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015900) proc(0x7f82ac008ff0) pid(26996) version 11:1:1:4 [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac008ff0), client(1/0x7f82ac01f630) [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01f630) [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01f630 with con 0x7f82ac008f10, requested num -1 [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:54:50.329 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:50.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:54:50.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01f630) [ CSSD]2013-05-23 10:54:50.337 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01f630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:54:50.337 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001360) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:50.337 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:50.540 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008ff0 [ CSSD]2013-05-23 10:54:50.540 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008ff0) con(0x7f82ac015900) skgpid ospid 26996 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:50.632 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:50.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:50.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:50.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:52.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:52.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:52.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:52.824 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008ff0) allocated [ CSSD]2013-05-23 10:54:52.826 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:54:52.826 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008ff0 - 1,2,3 [ CSSD]2013-05-23 10:54:52.826 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01de30) proc(0x7f82ac008ff0) pid(27024) version 11:1:1:4 [ CSSD]2013-05-23 10:54:52.832 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac008ff0), client(1/0x7f82ac01f560) [ CSSD]2013-05-23 10:54:52.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01f560) [ CSSD]2013-05-23 10:54:52.832 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01f560 with con 0x7f82ac015920, requested num -1 [ CSSD]2013-05-23 10:54:52.832 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:52.832 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:54:52.833 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:54:52.833 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:54:52.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01f560) [ CSSD]2013-05-23 10:54:52.839 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01f560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:54:52.839 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:54:52.839 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:54:53.042 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008ff0 [ CSSD]2013-05-23 10:54:53.042 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008ff0) con(0x7f82ac01de30) skgpid ospid 27024 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:54:54.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:54.422 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008f20) allocated [ CSSD]2013-05-23 10:54:54.423 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:54:54.423 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008f20 - 1,2,3 [ CSSD]2013-05-23 10:54:54.423 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac014180) proc(0x7f82ac008f20) pid(25456/25456) version 11:1:1:4 [ CSSD]2013-05-23 10:54:54.439 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac008f20), client(1/0x7f82ac01f3e0) [ CSSD]2013-05-23 10:54:54.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01f3e0) [ CSSD]2013-05-23 10:54:54.439 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:54:54.439 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:54:54.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:54.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:55.284 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:54:55.635 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:54:55.635 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:54:56.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:56.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:56.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:54:58.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:54:58.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:54:58.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:00.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:00.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:00.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:00.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:00.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:02.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:02.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:02.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:03.297 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac008f20), client(2/0x7f82ac01f7b0) [ CSSD]2013-05-23 10:55:03.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac01f7b0) [ CSSD]2013-05-23 10:55:03.297 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:55:03.297 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 10:55:04.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:04.641 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:04.641 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:55:04.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:04.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:05.304 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:06.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:06.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:06.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:07.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:55:07.827 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac024c30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:55:07.827 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac024c30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:55:07.827 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 10:55:07.827 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0217d0 [ CSSD]2013-05-23 10:55:07.827 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0217d0) con(0x7f82ac020310) skgpid 26090 ospid 26090 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:08.076 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac016630) allocated [ CSSD]2013-05-23 10:55:08.077 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:55:08.078 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac016630 - 1,2,3 [ CSSD]2013-05-23 10:55:08.078 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac016630) pid(27188) version 11:1:1:4 [ CSSD]2013-05-23 10:55:08.084 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac016630), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:55:08.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:55:08.084 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024c30 with con 0x7f82ac00ed30, requested num -1 [ CSSD]2013-05-23 10:55:08.084 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:08.084 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001520/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:55:08.085 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:55:08.085 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:55:08.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:55:08.091 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:55:08.091 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:08.091 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:55:08.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:08.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac016630 [ CSSD]2013-05-23 10:55:08.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac016630) con(0x7f82ac020310) skgpid ospid 27188 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:08.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:08.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:09.644 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:09.644 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:10.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:10.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:10.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:12.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:12.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:12.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00f920) [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00f920), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00f920), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f6c0 [ CSSD]2013-05-23 10:55:13.193 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f6c0) con(0x7f82ac028c60) skgpid 21014 ospid 21014 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:14.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:14.647 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:14.647 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:14.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:14.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:15.324 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:16.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:16.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:16.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:18.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:19.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:19.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:19.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:19.650 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:20.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:20.308 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f920) allocated [ CSSD]2013-05-23 10:55:20.309 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:55:20.310 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f920 - 1,2,3 [ CSSD]2013-05-23 10:55:20.310 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00ed30) proc(0x7f82ac01f920) pid(27276/27276) version 11:1:1:4 [ CSSD]2013-05-23 10:55:20.326 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac01f920), client(1/0x7f82ac024c30) [ CSSD]2013-05-23 10:55:20.326 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 10:55:20.326 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:55:20.326 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 10:55:21.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:21.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:22.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:23.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:23.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:23.248 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0274a0) allocated [ CSSD]2013-05-23 10:55:23.249 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:55:23.250 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0274a0 - 1,2,3 [ CSSD]2013-05-23 10:55:23.250 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac0274a0) pid(27274/27274) version 11:1:1:4 [ CSSD]2013-05-23 10:55:23.266 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0274a0), client(1/0x7f82ac023a00) [ CSSD]2013-05-23 10:55:23.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac023a00) [ CSSD]2013-05-23 10:55:23.266 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:55:23.266 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 10:55:23.330 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006300) allocated [ CSSD]2013-05-23 10:55:23.331 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:55:23.332 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006300 - 1,2,3 [ CSSD]2013-05-23 10:55:23.332 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001aa0) proc(0x7f82ac006300) pid(27341) version 11:1:1:4 [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac006300), client(1/0x7f82ac006a30) [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006a30) [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006a30 with con 0x7f82ac006220, requested num -1 [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:55:23.338 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:55:23.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006a30) [ CSSD]2013-05-23 10:55:23.345 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:55:23.345 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac010850) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:23.346 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac010850) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:55:23.548 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006300 [ CSSD]2013-05-23 10:55:23.548 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006300) con(0x7f82ac001aa0) skgpid ospid 27341 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:24.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:24.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:24.653 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:25.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:25.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:25.345 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:26.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:27.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:27.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:28.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:28.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:28.655 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:55:29.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:29.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:30.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:31.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:31.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:32.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:33.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:33.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:33.658 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:33.658 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:34.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:35.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:35.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:35.375 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:36.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:37.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:37.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:38.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:38.582 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0063d0) allocated [ CSSD]2013-05-23 10:55:38.583 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:55:38.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0063d0 - 1,2,3 [ CSSD]2013-05-23 10:55:38.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001b70) proc(0x7f82ac0063d0) pid(27487) version 11:1:1:4 [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac0063d0), client(1/0x7f82ac006b00) [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006b00) [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006b00 with con 0x7f82ac0062f0, requested num -1 [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac010850/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:55:38.590 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:55:38.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006b00) [ CSSD]2013-05-23 10:55:38.597 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006b00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:55:38.597 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006c70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:38.597 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006c70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:55:38.660 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:38.660 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:38.800 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0063d0 [ CSSD]2013-05-23 10:55:38.800 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0063d0) con(0x7f82ac001b70) skgpid ospid 27487 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:39.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:39.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:40.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:41.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:41.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:42.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:43.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:43.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:43.663 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:43.663 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:44.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:45.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:45.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:45.395 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:46.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:47.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:47.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:48.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:48.666 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:48.666 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:48.789 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0063d0) allocated [ CSSD]2013-05-23 10:55:48.790 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:55:48.790 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0063d0 - 1,2,3 [ CSSD]2013-05-23 10:55:48.790 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001b70) proc(0x7f82ac0063d0) pid(27601/27601) version 11:1:1:4 [ CSSD]2013-05-23 10:55:48.808 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82ac0063d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 10:55:48.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 10:55:48.808 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:55:48.808 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:55:49.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:49.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:49.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 10:55:49.293 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:55:49.293 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:55:49.293 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:55:49.293 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0063d0 [ CSSD]2013-05-23 10:55:49.293 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0063d0) con(0x7f82ac001b70) skgpid 27601 ospid 27601 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:50.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:50.583 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a44e0) allocated [ CSSD]2013-05-23 10:55:50.584 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:55:50.585 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a44e0 - 1,2,3 [ CSSD]2013-05-23 10:55:50.585 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258490) proc(0x7f82b42a44e0) pid(27617) version 11:1:1:4 [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42a44e0), client(1/0x26def20) [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26def20) [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26def20 with con 0x267fa40, requested num -1 [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:55:50.592 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:55:50.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26def20) [ CSSD]2013-05-23 10:55:50.599 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26def20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:55:50.599 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x264fe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:50.599 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x264fe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:55:50.801 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a44e0 [ CSSD]2013-05-23 10:55:50.801 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a44e0) con(0x7f82b4258490) skgpid ospid 27617 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:51.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:51.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:52.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:52.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:52.668 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:55:53.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:53.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:53.839 [1199044928] >TRACE: clssgmAllocProc: (0x26778f0) allocated [ CSSD]2013-05-23 10:55:53.840 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:55:53.840 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26778f0 - 1,2,3 [ CSSD]2013-05-23 10:55:53.840 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266e570) proc(0x26778f0) pid(27668) version 11:1:1:4 [ CSSD]2013-05-23 10:55:53.855 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26778f0), client(1/0x265f2a0) [ CSSD]2013-05-23 10:55:53.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x265f2a0) [ CSSD]2013-05-23 10:55:53.855 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x265f2a0 with con 0x2657940, requested num -1 [ CSSD]2013-05-23 10:55:53.855 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:53.855 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:55:53.856 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:55:53.856 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:55:53.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x265f2a0) [ CSSD]2013-05-23 10:55:53.862 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x265f2a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:55:53.862 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e2870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:55:53.862 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e2870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:55:54.065 [1199044928] >TRACE: clssgmDeadProc: proc 0x26778f0 [ CSSD]2013-05-23 10:55:54.065 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26778f0) con(0x266e570) skgpid ospid 27668 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:55:54.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:55.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:55.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:55.416 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:55:56.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:57.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:57.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:55:57.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:55:57.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:55:58.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:55:59.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:55:59.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:00.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:01.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:01.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:02.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:02.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:02.674 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:03.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:03.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:04.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:05.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:05.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:05.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:06.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:07.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:07.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:07.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:07.677 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:08.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:09.109 [1199044928] >TRACE: clssgmAllocProc: (0x26778f0) allocated [ CSSD]2013-05-23 10:56:09.110 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:56:09.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26778f0 - 1,2,3 [ CSSD]2013-05-23 10:56:09.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ab100) proc(0x26778f0) pid(27815) version 11:1:1:4 [ CSSD]2013-05-23 10:56:09.116 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26778f0), client(1/0x264ff30) [ CSSD]2013-05-23 10:56:09.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x264ff30) [ CSSD]2013-05-23 10:56:09.116 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x264ff30 with con 0x269a3e0, requested num -1 [ CSSD]2013-05-23 10:56:09.116 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:09.116 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:56:09.117 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:56:09.117 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:56:09.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x264ff30) [ CSSD]2013-05-23 10:56:09.123 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x264ff30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:56:09.123 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de680) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:09.123 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:56:09.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x26778f0 [ CSSD]2013-05-23 10:56:09.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26778f0) con(0x26ab100) skgpid ospid 27815 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:56:09.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:09.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:10.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:11.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:11.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:12.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:12.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:12.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:12.996 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac01f920), client(2/0x26def20) [ CSSD]2013-05-23 10:56:12.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26def20) [ CSSD]2013-05-23 10:56:12.996 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:56:12.996 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 10:56:13.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:13.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:14.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:15.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:15.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:15.475 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:16.682 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:16.682 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:56:16.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:17.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:17.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:18.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:19.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:19.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:20.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:21.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:21.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:21.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:21.686 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:22.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:23.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:23.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:24.359 [1199044928] >TRACE: clssgmAllocProc: (0x2660d60) allocated [ CSSD]2013-05-23 10:56:24.360 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:56:24.361 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2660d60 - 1,2,3 [ CSSD]2013-05-23 10:56:24.361 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a3e0) proc(0x2660d60) pid(28008) version 11:1:1:4 [ CSSD]2013-05-23 10:56:24.367 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2660d60), client(1/0x26a6bf0) [ CSSD]2013-05-23 10:56:24.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6bf0) [ CSSD]2013-05-23 10:56:24.367 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a6bf0 with con 0x2657940, requested num -1 [ CSSD]2013-05-23 10:56:24.367 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:24.367 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:56:24.368 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:56:24.368 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:56:24.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6bf0) [ CSSD]2013-05-23 10:56:24.374 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6bf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:56:24.375 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e2870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:24.375 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e2870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:56:24.577 [1199044928] >TRACE: clssgmDeadProc: proc 0x2660d60 [ CSSD]2013-05-23 10:56:24.577 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2660d60) con(0x269a3e0) skgpid ospid 28008 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:56:24.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:25.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:25.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:25.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:26.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:26.689 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:26.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:27.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:27.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:28.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:29.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:29.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:29.754 [1199044928] >TRACE: clssgmAllocProc: (0x2660d60) allocated [ CSSD]2013-05-23 10:56:29.755 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:56:29.756 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2660d60 - 1,2,3 [ CSSD]2013-05-23 10:56:29.756 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a3e0) proc(0x2660d60) pid(27924/27924) version 11:1:1:4 [ CSSD]2013-05-23 10:56:29.762 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2660d60), client(1/0x26e2940) [ CSSD]2013-05-23 10:56:29.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e2940) [ CSSD]2013-05-23 10:56:29.762 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:56:29.762 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:56:30.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:31.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:31.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:31.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:31.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:32.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:33.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:33.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:34.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:35.536 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:35.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:35.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:36.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:36.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:36.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:37.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:37.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:38.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:39.604 [1199044928] >TRACE: clssgmAllocProc: (0x2658ad0) allocated [ CSSD]2013-05-23 10:56:39.605 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:56:39.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2658ad0 - 1,2,3 [ CSSD]2013-05-23 10:56:39.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2661b20) proc(0x2658ad0) pid(28150) version 11:1:1:4 [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2658ad0), client(1/0x26a6630) [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6630) [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a6630 with con 0x2659b90, requested num -1 [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:56:39.611 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:56:39.618 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6630) [ CSSD]2013-05-23 10:56:39.618 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:56:39.618 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2659cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:39.618 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2659cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:56:39.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:39.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:39.821 [1199044928] >TRACE: clssgmDeadProc: proc 0x2658ad0 [ CSSD]2013-05-23 10:56:39.821 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2658ad0) con(0x2661b20) skgpid ospid 28150 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:56:41.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:41.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:41.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:41.698 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:41.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:43.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:43.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:43.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:45.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:45.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:45.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:45.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:46.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:46.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:47.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:47.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:47.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:49.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:49.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:49.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:50.844 [1199044928] >TRACE: clssgmAllocProc: (0x26a6b20) allocated [ CSSD]2013-05-23 10:56:50.845 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:56:50.846 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a6b20 - 1,2,3 [ CSSD]2013-05-23 10:56:50.846 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2656940) proc(0x26a6b20) pid(28276) version 11:1:1:4 [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26a6b20), client(1/0x26e1ed0) [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1ed0 with con 0x2659b90, requested num -1 [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:56:50.852 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:56:50.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:56:50.858 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1ed0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:56:50.858 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26591b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:50.859 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26591b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:56:51.061 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a6b20 [ CSSD]2013-05-23 10:56:51.061 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a6b20) con(0x2656940) skgpid ospid 28276 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:56:51.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:51.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:51.703 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:51.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:51.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:53.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:53.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:53.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:54.855 [1199044928] >TRACE: clssgmAllocProc: (0x26583f0) allocated [ CSSD]2013-05-23 10:56:54.856 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:56:54.857 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26583f0 - 1,2,3 [ CSSD]2013-05-23 10:56:54.857 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2663760) proc(0x26583f0) pid(28309) version 11:1:1:4 [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26583f0), client(1/0x26e1ed0) [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1ed0 with con 0x2659b90, requested num -1 [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:56:54.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:56:54.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:56:54.868 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1ed0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:56:54.868 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2661b20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:56:54.868 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2661b20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:56:55.071 [1199044928] >TRACE: clssgmDeadProc: proc 0x26583f0 [ CSSD]2013-05-23 10:56:55.071 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26583f0) con(0x2663760) skgpid ospid 28309 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:56:55.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:55.587 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:56:55.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:55.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:56.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:56:56.706 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:56:57.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:57.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:57.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:56:59.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:56:59.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:56:59.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:00.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:00.708 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:57:00.863 [1199044928] >TRACE: clssgmAllocProc: (0x26a6b20) allocated [ CSSD]2013-05-23 10:57:00.864 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:00.865 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a6b20 - 1,2,3 [ CSSD]2013-05-23 10:57:00.865 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2657df0) proc(0x26a6b20) pid(28395) version 11:1:1:4 [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26a6b20), client(1/0x26e1ed0) [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1ed0 with con 0x2659b90, requested num -1 [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:00.871 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:00.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1ed0) [ CSSD]2013-05-23 10:57:00.877 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1ed0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:00.877 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2658ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:00.877 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2658ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:01.079 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a6b20 [ CSSD]2013-05-23 10:57:01.079 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a6b20) con(0x2657df0) skgpid ospid 28395 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:01.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:01.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:01.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:03.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:03.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:03.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:05.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:05.638 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:05.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:05.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:05.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:05.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:06.435 [1199044928] >TRACE: clssgmAllocProc: (0x26a6b20) allocated [ CSSD]2013-05-23 10:57:06.436 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:06.437 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a6b20 - 1,2,3 [ CSSD]2013-05-23 10:57:06.437 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2663760) proc(0x26a6b20) pid(27272/27272) version 11:1:1:4 [ CSSD]2013-05-23 10:57:06.453 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26a6b20), client(1/0x2658ad0) [ CSSD]2013-05-23 10:57:06.453 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2658ad0) [ CSSD]2013-05-23 10:57:06.453 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:57:06.453 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:57:07.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:07.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:07.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:09.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:09.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:09.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:10.102 [1199044928] >TRACE: clssgmAllocProc: (0x2657610) allocated [ CSSD]2013-05-23 10:57:10.103 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:57:10.104 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2657610 - 1,2,3 [ CSSD]2013-05-23 10:57:10.104 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x2657610) pid(28486) version 11:1:1:4 [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x2657610), client(1/0x26de250) [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de250) [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de250 with con 0x2659e40, requested num -1 [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:10.110 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:10.117 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de250) [ CSSD]2013-05-23 10:57:10.117 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de250), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:10.117 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269f1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:10.117 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269f1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:10.319 [1199044928] >TRACE: clssgmDeadProc: proc 0x2657610 [ CSSD]2013-05-23 10:57:10.319 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2657610) con(0x26e1ed0) skgpid ospid 28486 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:10.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:10.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:11.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:11.497 [1199044928] >TRACE: clssgmAllocProc: (0x2657660) allocated [ CSSD]2013-05-23 10:57:11.498 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:11.499 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2657660 - 1,2,3 [ CSSD]2013-05-23 10:57:11.499 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6720) proc(0x2657660) pid(28558) version 11:1:1:4 [ CSSD]2013-05-23 10:57:11.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:11.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:13.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:13.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:15.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:15.657 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:15.717 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:15.717 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:15.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:15.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:17.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:17.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:17.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:19.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:19.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:19.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:20.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:20.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:21.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:21.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:21.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:22.778 [1199044928] >TRACE: clssgmAllocProc: (0x26915c0) allocated [ CSSD]2013-05-23 10:57:22.779 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:22.780 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26915c0 - 1,2,3 [ CSSD]2013-05-23 10:57:22.780 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x26915c0) pid(28951/28951) version 11:1:1:4 [ CSSD]2013-05-23 10:57:22.797 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26915c0), client(1/0x26a9ad0) [ CSSD]2013-05-23 10:57:22.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a9ad0) [ CSSD]2013-05-23 10:57:22.797 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:57:22.797 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:57:22.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a9ad0) [ CSSD]2013-05-23 10:57:22.813 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a9ad0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:57:22.813 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a9ad0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:57:22.813 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 10:57:22.814 [1199044928] >TRACE: clssgmDeadProc: proc 0x26915c0 [ CSSD]2013-05-23 10:57:22.814 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26915c0) con(0x26e1ed0) skgpid 28951 ospid 28951 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:23.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:23.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:23.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:24.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:24.722 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:57:25.353 [1199044928] >TRACE: clssgmAllocProc: (0x26915c0) allocated [ CSSD]2013-05-23 10:57:25.354 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:57:25.355 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26915c0 - 1,2,3 [ CSSD]2013-05-23 10:57:25.355 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x26915c0) pid(28985) version 11:1:1:4 [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26915c0), client(1/0x26501e0) [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26501e0) [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26501e0 with con 0x2659e40, requested num -1 [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:25.361 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:25.368 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26501e0) [ CSSD]2013-05-23 10:57:25.368 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26501e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:25.368 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:25.368 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:25.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:25.570 [1199044928] >TRACE: clssgmDeadProc: proc 0x26915c0 [ CSSD]2013-05-23 10:57:25.571 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26915c0) con(0x26e1ed0) skgpid ospid 28985 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:25.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:25.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:25.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:27.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:27.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:27.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:29.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:29.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:29.725 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:29.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:29.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:30.353 [1199044928] >TRACE: clssgmAllocProc: (0x26915c0) allocated [ CSSD]2013-05-23 10:57:30.355 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:30.355 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26915c0 - 1,2,3 [ CSSD]2013-05-23 10:57:30.355 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x26915c0) pid(29061) version 11:1:1:4 [ CSSD]2013-05-23 10:57:30.361 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26915c0), client(1/0x261c1c0) [ CSSD]2013-05-23 10:57:30.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 10:57:30.361 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c1c0 with con 0x2659e40, requested num -1 [ CSSD]2013-05-23 10:57:30.361 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:30.361 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:30.362 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:30.362 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:30.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 10:57:30.369 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c1c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:30.369 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c630) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:30.369 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c630) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:30.571 [1199044928] >TRACE: clssgmDeadProc: proc 0x26915c0 [ CSSD]2013-05-23 10:57:30.571 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26915c0) con(0x26e1ed0) skgpid ospid 29061 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:31.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:31.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:31.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:33.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:33.582 [1199044928] >TRACE: clssgmAllocProc: (0x26a9850) allocated [ CSSD]2013-05-23 10:57:33.583 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:33.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9850 - 1,2,3 [ CSSD]2013-05-23 10:57:33.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269f240) proc(0x26a9850) pid(27922/27922) version 11:1:1:4 [ CSSD]2013-05-23 10:57:33.590 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26a9850), client(1/0x2659f40) [ CSSD]2013-05-23 10:57:33.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2659f40) [ CSSD]2013-05-23 10:57:33.590 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:57:33.590 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:57:34.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:34.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:34.728 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:34.728 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:35.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:35.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:36.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:36.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:37.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:38.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:38.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:39.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:39.731 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:39.731 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:40.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:40.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:40.604 [1199044928] >TRACE: clssgmAllocProc: (0x267c0c0) allocated [ CSSD]2013-05-23 10:57:40.605 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:57:40.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c0c0 - 1,2,3 [ CSSD]2013-05-23 10:57:40.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x267c0c0) pid(29152) version 11:1:1:4 [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x267c0c0), client(1/0x266f0c0) [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f0c0) [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f0c0 with con 0x267bfc0, requested num -1 [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266f230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:40.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:40.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f0c0) [ CSSD]2013-05-23 10:57:40.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f0c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:40.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f530) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:40.630 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f530) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:40.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c0c0 [ CSSD]2013-05-23 10:57:40.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c0c0) con(0x26e1ed0) skgpid ospid 29152 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:41.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:42.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:42.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:43.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01d810) [ CSSD]2013-05-23 10:57:43.227 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01d810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:57:43.227 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01d810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:57:43.227 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 10:57:43.228 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac026860 [ CSSD]2013-05-23 10:57:43.228 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac026860) con(0x7f82ac026590) skgpid 22899 ospid 22899 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:43.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac017a50) [ CSSD]2013-05-23 10:57:43.243 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac017a50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:57:43.243 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac017a50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:57:43.243 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0214b0) [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0214b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0214b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac028880 [ CSSD]2013-05-23 10:57:43.254 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac028880) con(0x7f82ac002ac0) skgpid 22901 ospid 22901 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:43.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:44.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:44.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:44.734 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:44.734 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:45.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:45.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:46.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:46.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:47.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:48.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:48.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:48.736 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:48.736 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:57:49.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:49.603 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac0274a0), client(2/0x26505e0) [ CSSD]2013-05-23 10:57:49.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26505e0) [ CSSD]2013-05-23 10:57:49.604 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:57:49.604 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 10:57:50.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:50.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:51.096 [1199044928] >TRACE: clssgmAllocProc: (0x267bd70) allocated [ CSSD]2013-05-23 10:57:51.097 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:51.098 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bd70 - 1,2,3 [ CSSD]2013-05-23 10:57:51.098 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ed0) proc(0x267bd70) pid(29269) version 11:1:1:4 [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x267bd70), client(1/0x267c430) [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c430) [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c430 with con 0x266f5b0, requested num -1 [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268bc90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:51.106 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:51.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c430) [ CSSD]2013-05-23 10:57:51.113 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:51.113 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:51.113 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:51.316 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bd70 [ CSSD]2013-05-23 10:57:51.316 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bd70) con(0x26e1ed0) skgpid ospid 29269 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:51.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:52.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:52.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:52.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x2657660 [ CSSD]2013-05-23 10:57:52.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2657660) con(0x26a6720) skgpid ospid 28558 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:53.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:53.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:53.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:53.866 [1199044928] >TRACE: clssgmAllocProc: (0x2650750) allocated [ CSSD]2013-05-23 10:57:53.867 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:57:53.867 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650750 - 1,2,3 [ CSSD]2013-05-23 10:57:53.867 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ff0) proc(0x2650750) pid(29298/29298) version 11:1:1:4 [ CSSD]2013-05-23 10:57:53.874 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2650750), client(1/0x26a6750) [ CSSD]2013-05-23 10:57:53.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:57:53.874 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:57:53.874 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a6750), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a6750), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650750 [ CSSD]2013-05-23 10:57:54.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650750) con(0x26e1ff0) skgpid 29298 ospid 29298 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:54.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:54.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:55.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:55.759 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:57:55.870 [1199044928] >TRACE: clssgmAllocProc: (0x2650750) allocated [ CSSD]2013-05-23 10:57:55.871 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:57:55.872 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650750 - 1,2,3 [ CSSD]2013-05-23 10:57:55.872 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ff0) proc(0x2650750) pid(29317) version 11:1:1:4 [ CSSD]2013-05-23 10:57:55.877 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2650750), client(1/0x26a6750) [ CSSD]2013-05-23 10:57:55.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:57:55.877 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a6750 with con 0x2650b60, requested num -1 [ CSSD]2013-05-23 10:57:55.877 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:55.877 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:57:55.878 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:57:55.878 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:57:55.883 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:57:55.883 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6750), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:57:55.883 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266edb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:57:55.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266edb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:57:56.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650750 [ CSSD]2013-05-23 10:57:56.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650750) con(0x26e1ff0) skgpid ospid 29317 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:57:56.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:56.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:57.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:57:58.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:57:58.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:57:58.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:57:58.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:57:59.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:00.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:00.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:01.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:02.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:02.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:03.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:03.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:03.745 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:04.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:04.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:05.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:05.780 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:06.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:06.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:07.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:08.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:08.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:08.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:08.748 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:09.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:10.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:10.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:11.129 [1199044928] >TRACE: clssgmAllocProc: (0x2650430) allocated [ CSSD]2013-05-23 10:58:11.130 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:58:11.131 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650430 - 1,2,3 [ CSSD]2013-05-23 10:58:11.131 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26911e0) proc(0x2650430) pid(29476) version 11:1:1:4 [ CSSD]2013-05-23 10:58:11.147 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2650430), client(1/0x26a6750) [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a6750 with con 0x2657600, requested num -1 [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:11.148 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:11.154 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:11.154 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6750), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:58:11.154 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2657480) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:11.155 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2657480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:11.357 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650430 [ CSSD]2013-05-23 10:58:11.357 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650430) con(0x26911e0) skgpid ospid 29476 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:11.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:12.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:12.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:12.750 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:12.750 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:58:13.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:14.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:14.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:15.820 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:15.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:16.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:16.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:17.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:17.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:17.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:18.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:18.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:18.623 [1199044928] >TRACE: clssgmAllocProc: (0x2650430) allocated [ CSSD]2013-05-23 10:58:18.624 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:58:18.624 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650430 - 1,2,3 [ CSSD]2013-05-23 10:58:18.624 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26911e0) proc(0x2650430) pid(29563) version 11:1:1:4 [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2650430), client(1/0x26a6750) [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26a6750 with con 0x2657600, requested num -1 [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eab0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:18.632 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:18.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:18.639 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6750), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 10:58:18.639 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2657480) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 10:58:18.639 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x2657480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:18.751 [1199044928] >TRACE: clssgmAllocProc: (0x267c3c0) allocated [ CSSD]2013-05-23 10:58:18.751 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:58:18.752 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c3c0 - 1,2,3 [ CSSD]2013-05-23 10:58:18.752 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650890) proc(0x267c3c0) pid(29568) version 11:1:1:4 [ CSSD]2013-05-23 10:58:18.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:58:18.770 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:58:18.772 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:58:18.773 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c3c0 [ CSSD]2013-05-23 10:58:18.773 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c3c0) con(0x2650890) skgpid ospid 29568 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:18.842 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650430 [ CSSD]2013-05-23 10:58:18.842 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650430) con(0x26911e0) skgpid ospid 29563 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:19.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:20.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:20.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:21.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:22.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:22.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:22.755 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:22.755 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:23.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:24.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:24.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:25.850 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:25.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:26.395 [1199044928] >TRACE: clssgmAllocProc: (0x2650750) allocated [ CSSD]2013-05-23 10:58:26.396 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:58:26.397 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650750 - 1,2,3 [ CSSD]2013-05-23 10:58:26.397 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ff0) proc(0x2650750) pid(29627) version 11:1:1:4 [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2650750), client(1/0x26a6750) [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a6750 with con 0x2650b60, requested num -1 [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:26.403 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:26.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a6750) [ CSSD]2013-05-23 10:58:26.411 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a6750), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:58:26.411 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266edb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:26.411 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266edb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:26.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:26.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:26.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650750 [ CSSD]2013-05-23 10:58:26.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650750) con(0x26e1ff0) skgpid ospid 29627 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:27.758 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:27.758 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:27.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:28.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:28.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:29.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:30.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:30.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:31.965 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2660d60), client(2/0x26912a0) [ CSSD]2013-05-23 10:58:31.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26912a0) [ CSSD]2013-05-23 10:58:31.965 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:58:31.965 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 10:58:32.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:32.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:32.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:32.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:32.761 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:34.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:34.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:34.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:35.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:36.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:36.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:36.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:36.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:36.763 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:58:38.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:38.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:38.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:40.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:40.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:40.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:41.274 [1199044928] >TRACE: clssgmAllocProc: (0x26509c0) allocated [ CSSD]2013-05-23 10:58:41.275 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:58:41.275 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509c0 - 1,2,3 [ CSSD]2013-05-23 10:58:41.275 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509c0) pid(29771) version 11:1:1:4 [ CSSD]2013-05-23 10:58:41.644 [1199044928] >TRACE: clssgmAllocProc: (0x267c360) allocated [ CSSD]2013-05-23 10:58:41.645 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:58:41.645 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c360 - 1,2,3 [ CSSD]2013-05-23 10:58:41.645 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266edd0) proc(0x267c360) pid(29850) version 11:1:1:4 [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x267c360), client(1/0x266f6d0) [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f6d0) [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f6d0 with con 0x267c580, requested num -1 [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268c150/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:41.651 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:41.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f6d0) [ CSSD]2013-05-23 10:58:41.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f6d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:58:41.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c450) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:41.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c450) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:41.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:41.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:41.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c360 [ CSSD]2013-05-23 10:58:41.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c360) con(0x266edd0) skgpid ospid 29850 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:41.895 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509c0 [ CSSD]2013-05-23 10:58:41.895 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509c0) con(0x26a6570) skgpid ospid 29771 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:42.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:42.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:42.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:44.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:44.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:44.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:45.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:46.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:46.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:46.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:46.769 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:46.769 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:48.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:48.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0159d0) [ CSSD]2013-05-23 10:58:48.648 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0159d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 10:58:48.648 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0159d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 10:58:48.648 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0049a0) [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0049a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0049a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac015c40 [ CSSD]2013-05-23 10:58:48.660 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac015c40) con(0x7f82ac0162c0) skgpid 19774 ospid 19774 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:48.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:48.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:50.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:50.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:50.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:51.373 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:58:51.374 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:58:51.374 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:58:51.374 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30048) version 11:1:1:4 [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x2650bb0) [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650bb0 with con 0x26508d0, requested num -1 [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266edc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:51.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:51.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:58:51.398 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650bb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:58:51.398 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:51.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:51.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 10:58:51.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid ospid 30048 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:51.772 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:51.772 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:52.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:52.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:52.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:54.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:54.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:54.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:55.921 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:58:56.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:56.775 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:58:56.775 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:58:56.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:56.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:58:56.893 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:58:56.895 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:58:56.896 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:58:56.896 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30107) version 11:1:1:4 [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x2650bb0) [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650bb0 with con 0x26508d0, requested num -1 [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266edc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:58:56.902 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:58:56.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:58:56.910 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650bb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:58:56.910 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:58:56.910 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:58:57.113 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 10:58:57.113 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid ospid 30107 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:58:58.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:58:58.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:58:58.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:00.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:00.778 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:00.778 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:59:00.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:00.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:02.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:02.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:02.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:04.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:04.706 [1199044928] >TRACE: clssgmAllocProc: (0x2657600) allocated [ CSSD]2013-05-23 10:59:04.708 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:04.708 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2657600 - 1,2,3 [ CSSD]2013-05-23 10:59:04.708 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6740) proc(0x2657600) pid(30204) version 11:1:1:4 [ CSSD]2013-05-23 10:59:04.838 [1199044928] >TRACE: clssgmAllocProc: (0x267c290) allocated [ CSSD]2013-05-23 10:59:04.839 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:04.840 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c290 - 1,2,3 [ CSSD]2013-05-23 10:59:04.840 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266ed60) proc(0x267c290) pid(30214) version 11:1:1:4 [ CSSD]2013-05-23 10:59:04.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:04.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:04.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c290 [ CSSD]2013-05-23 10:59:04.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c290) con(0x266ed60) skgpid ospid 30214 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5280/0x266eca0) [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5280 (0x266eca0) [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x266eca0 with con 0x267c580, requested num -1 [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x266ee10/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:04.942 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 10:59:04.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5280 (0x266eca0) [ CSSD]2013-05-23 10:59:04.948 [1199044928] >TRACE: clssgmExitGrock: client 5280 (0x266eca0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 10:59:04.948 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f110) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 10:59:04.948 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x266f110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:04.949 [1199044928] >TRACE: clssgmDeadProc: proc 0x2657600 [ CSSD]2013-05-23 10:59:04.949 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2657600) con(0x26a6740) skgpid ospid 30204 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:04.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:04.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:05.781 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:05.781 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:05.952 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:06.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:06.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:06.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:08.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:08.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:08.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:10.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:10.784 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:10.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:10.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:10.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:12.153 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:59:12.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:59:12.154 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:59:12.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30275) version 11:1:1:4 [ CSSD]2013-05-23 10:59:12.170 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x266ecf0) [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266ecf0) [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266ecf0 with con 0x26508d0, requested num -1 [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266ee60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:12.171 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:59:12.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266ecf0) [ CSSD]2013-05-23 10:59:12.177 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266ecf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:59:12.177 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f160) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:12.178 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f160) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:12.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 10:59:12.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid ospid 30275 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:12.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:12.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:12.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:14.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:15.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:15.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:15.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:15.787 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:15.972 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:16.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:17.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:17.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:18.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:19.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:19.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:19.508 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:19.509 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:19.510 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:19.511 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 10:59:19.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:19.790 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:59:20.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:21.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:21.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:22.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:23.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:23.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:24.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:24.793 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:24.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:25.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:25.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:25.991 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:26.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:27.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:27.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:27.413 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:59:27.414 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:59:27.415 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:59:27.415 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30462) version 11:1:1:4 [ CSSD]2013-05-23 10:59:27.421 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x2650bb0) [ CSSD]2013-05-23 10:59:27.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:59:27.421 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650bb0 with con 0x26508d0, requested num -1 [ CSSD]2013-05-23 10:59:27.421 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:27.421 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266edc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:59:27.422 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:27.422 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:59:27.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:59:27.428 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650bb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:59:27.428 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:27.429 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:27.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 10:59:27.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid ospid 30462 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:28.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:29.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:29.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:29.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:29.796 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:30.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:31.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:31.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:32.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:32.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b40105) incarnation(174631049) [ CSSD]2013-05-23 10:59:32.811 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:32.811 [1123510592] >TRACE: clssgmRemoveMember: grock EVMDMAIN, member number 2 (0x7f82b42a1760) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 10:59:32.811 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 10:59:33.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:33.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:34.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:34.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:34.799 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:35.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:35.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:36.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:36.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:37.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b50105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.013 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.013 [1123510592] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP, member number 2 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 10:59:37.013 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 10:59:37.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b60105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.219 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.219 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.219 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42d3b20/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 10:59:37.219 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b70105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.220 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.220 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b80105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.221 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.221 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.221 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42d3b20/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b90105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.222 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.222 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ba0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.223 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.223 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.223 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42d3b20/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 10:59:37.223 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bb0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.224 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.224 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02bc0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.225 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.225 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.225 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42d3b20/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 10:59:37.225 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bd0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.226 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.226 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02be0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.227 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.227 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.227 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42d3b20/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 10:59:37.227 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bf0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.228 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.228 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c00105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c10105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.231 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.232 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c20105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.232 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.232 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c30105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.233 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.233 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.233 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.233 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c40105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.234 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.234 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c50105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.235 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.235 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c60105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c70105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.236 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.237 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c80105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.237 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.237 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c90105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 10:59:37.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 10:59:37.238 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 10:59:37.238 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 10:59:37.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ca0105) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.239 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 10:59:37.239 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 10:59:37.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:37.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:38.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:39.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:39.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:39.801 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:39.801 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:40.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:41.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:41.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:42.668 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:59:42.669 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:59:42.669 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:59:42.669 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30608) version 11:1:1:4 [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x2650bb0) [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650bb0 with con 0x26508d0, requested num -1 [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266edc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:42.676 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:59:42.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 10:59:42.683 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650bb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:59:42.683 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:42.683 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:42.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:42.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 10:59:42.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid ospid 30608 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:43.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:43.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:43.325 [1199044928] >TRACE: clssgmAllocProc: (0x26509b0) allocated [ CSSD]2013-05-23 10:59:43.326 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:43.327 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26509b0 - 1,2,3 [ CSSD]2013-05-23 10:59:43.327 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6570) proc(0x26509b0) pid(30025/30025) version 11:1:1:4 [ CSSD]2013-05-23 10:59:43.333 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(1/0x266eb60) [ CSSD]2013-05-23 10:59:43.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266eb60) [ CSSD]2013-05-23 10:59:43.333 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:59:43.333 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 10:59:43.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:43.804 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 10:59:44.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:45.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:45.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:46.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:46.159 [1199044928] >TRACE: clssgmAllocProc: (0x266f630) allocated [ CSSD]2013-05-23 10:59:46.160 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:46.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f630 - 1,2,3 [ CSSD]2013-05-23 10:59:46.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f260) proc(0x266f630) pid(30023/30023) version 11:1:1:4 [ CSSD]2013-05-23 10:59:46.165 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x266f630), client(1/0x268c340) [ CSSD]2013-05-23 10:59:46.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268c340) [ CSSD]2013-05-23 10:59:46.165 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:59:46.165 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 10:59:46.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:47.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:47.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:48.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:48.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:48.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:49.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:49.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:50.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:51.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:51.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:51.638 [1199044928] >TRACE: clssgmAllocProc: (0x2679110) allocated [ CSSD]2013-05-23 10:59:51.640 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:51.640 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679110 - 1,2,3 [ CSSD]2013-05-23 10:59:51.640 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c4b0) proc(0x2679110) pid(30714) version 11:1:1:4 [ CSSD]2013-05-23 10:59:51.648 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x2679110), client(1/0x2690f90) [ CSSD]2013-05-23 10:59:51.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690f90) [ CSSD]2013-05-23 10:59:51.648 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690f90 with con 0x2690b20, requested num -1 [ CSSD]2013-05-23 10:59:51.648 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:51.648 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2698a10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:59:51.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:51.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:59:51.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690f90) [ CSSD]2013-05-23 10:59:51.655 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690f90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:59:51.655 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2698d10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:51.655 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2698d10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:51.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679110 [ CSSD]2013-05-23 10:59:51.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679110) con(0x268c4b0) skgpid ospid 30714 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:52.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:53.083 [1199044928] >TRACE: clssgmAllocProc: (0x2699d70) allocated [ CSSD]2013-05-23 10:59:53.084 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 10:59:53.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699d70 - 1,2,3 [ CSSD]2013-05-23 10:59:53.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c280) proc(0x2699d70) pid(30021/30021) version 11:1:1:4 [ CSSD]2013-05-23 10:59:53.099 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x2699d70), client(1/0x2677ec0) [ CSSD]2013-05-23 10:59:53.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2677ec0) [ CSSD]2013-05-23 10:59:53.099 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 10:59:53.099 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 10:59:53.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:53.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:53.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:53.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:54.239 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x266f630), client(2/0x2699110) [ CSSD]2013-05-23 10:59:54.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2699110) [ CSSD]2013-05-23 10:59:54.239 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 10:59:54.239 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 10:59:54.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:55.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:55.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:56.097 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 10:59:56.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:57.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:57.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 10:59:57.922 [1199044928] >TRACE: clssgmAllocProc: (0x2679150) allocated [ CSSD]2013-05-23 10:59:57.923 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 10:59:57.924 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679150 - 1,2,3 [ CSSD]2013-05-23 10:59:57.924 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26784d0) proc(0x2679150) pid(30767) version 11:1:1:4 [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x2679150), client(1/0x2680850) [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680850) [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680850 with con 0x26cfa10, requested num -1 [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26809c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 10:59:57.930 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 10:59:57.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680850) [ CSSD]2013-05-23 10:59:57.937 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680850), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 10:59:57.937 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 10:59:57.937 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 10:59:58.140 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679150 [ CSSD]2013-05-23 10:59:58.140 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679150) con(0x26784d0) skgpid ospid 30767 with 0 clients, refcount 0 [ CSSD]2013-05-23 10:59:58.813 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 10:59:58.813 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 10:59:58.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 10:59:59.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 10:59:59.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:01.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:01.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:01.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:03.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:03.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:03.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:03.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:03.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:05.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:05.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:05.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:06.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:07.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:07.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:07.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:08.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:08.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:09.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:09.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:09.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:10.003 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26509b0), client(2/0x2678360) [ CSSD]2013-05-23 11:00:10.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2678360) [ CSSD]2013-05-23 11:00:10.003 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:00:10.003 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 11:00:11.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:11.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:11.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:13.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:13.174 [1199044928] >TRACE: clssgmAllocProc: (0x26790a0) allocated [ CSSD]2013-05-23 11:00:13.175 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:00:13.176 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790a0 - 1,2,3 [ CSSD]2013-05-23 11:00:13.176 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678a20) proc(0x26790a0) pid(31105) version 11:1:1:4 [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26790a0), client(1/0x26cfc40) [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cfc40) [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cfc40 with con 0x26cf6c0, requested num -1 [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680da0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:00:13.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:00:13.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cfc40) [ CSSD]2013-05-23 11:00:13.190 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cfc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:00:13.190 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26810a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:13.191 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26810a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:00:13.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac01f7b0) [ CSSD]2013-05-23 11:00:13.263 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac01f7b0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:00:13.263 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac01f7b0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:00:13.264 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01f3e0) [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01f3e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01f3e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008f20 [ CSSD]2013-05-23 11:00:13.269 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008f20) con(0x7f82ac014180) skgpid 25456 ospid 25456 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:13.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790a0 [ CSSD]2013-05-23 11:00:13.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790a0) con(0x2678a20) skgpid ospid 31105 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:13.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:13.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:13.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:13.822 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:15.079 [1199044928] >TRACE: clssgmAllocProc: (0x26cfc10) allocated [ CSSD]2013-05-23 11:00:15.080 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:00:15.081 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfc10 - 1,2,3 [ CSSD]2013-05-23 11:00:15.081 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678970) proc(0x26cfc10) pid(31150/31150) version 11:1:1:4 [ CSSD]2013-05-23 11:00:15.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:15.097 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26cfc10), client(1/0x2680b90) [ CSSD]2013-05-23 11:00:15.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2680b90) [ CSSD]2013-05-23 11:00:15.097 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:00:15.097 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 11:00:15.337 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26cfc10), client(2/0x2681030) [ CSSD]2013-05-23 11:00:15.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2681030) [ CSSD]2013-05-23 11:00:15.337 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:00:15.337 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 11:00:15.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:15.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:16.148 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:17.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:17.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:17.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:17.675 [1199044928] >TRACE: clssgmAllocProc: (0x2695070) allocated [ CSSD]2013-05-23 11:00:17.676 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:00:17.676 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2695070 - 1,2,3 [ CSSD]2013-05-23 11:00:17.676 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681580) proc(0x2695070) pid(31187/31187) version 11:1:1:4 [ CSSD]2013-05-23 11:00:17.682 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x2695070), client(1/0x26955e0) [ CSSD]2013-05-23 11:00:17.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26955e0) [ CSSD]2013-05-23 11:00:17.682 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:00:17.682 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 32 [ CSSD]2013-05-23 11:00:17.684 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x2695070), client(2/0x2695a90) [ CSSD]2013-05-23 11:00:17.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2695a90) [ CSSD]2013-05-23 11:00:17.684 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:00:17.684 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 45 [ CSSD]2013-05-23 11:00:18.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:18.825 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:19.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:19.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:19.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:21.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:21.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:21.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ce330) [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ce330), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ce330), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 44 [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a69d0 [ CSSD]2013-05-23 11:00:22.812 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a69d0) con(0x26de5d0) skgpid 11256 ospid 11256 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:23.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:23.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:23.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:23.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:23.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:24.060 [1199044928] >TRACE: clssgmAllocProc: (0x26dec00) allocated [ CSSD]2013-05-23 11:00:24.061 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:00:24.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dec00 - 1,2,3 [ CSSD]2013-05-23 11:00:24.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce3f0) proc(0x26dec00) pid(31148/31148) version 11:1:1:4 [ CSSD]2013-05-23 11:00:24.068 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26dec00), client(1/0x26802a0) [ CSSD]2013-05-23 11:00:24.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26802a0) [ CSSD]2013-05-23 11:00:24.068 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:00:24.068 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 45 [ CSSD]2013-05-23 11:00:25.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:25.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:25.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:26.173 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:27.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:27.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:27.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:27.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:27.831 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:00:28.426 [1199044928] >TRACE: clssgmAllocProc: (0x26a1280) allocated [ CSSD]2013-05-23 11:00:28.428 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:00:28.428 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a1280 - 1,2,3 [ CSSD]2013-05-23 11:00:28.428 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a5f90) proc(0x26a1280) pid(31288) version 11:1:1:4 [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26a1280), client(1/0x26959f0) [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26959f0 with con 0x26a1120, requested num -1 [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a1a80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:00:28.435 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:00:28.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:00:28.442 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26959f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:00:28.442 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a1d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:28.442 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a1d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:00:28.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a1280 [ CSSD]2013-05-23 11:00:28.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a1280) con(0x26a5f90) skgpid ospid 31288 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:29.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:29.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:29.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:31.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:31.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:31.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:32.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:32.834 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:33.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:33.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:33.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:35.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:35.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:35.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:36.199 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:37.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:37.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:37.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:37.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:37.837 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:39.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:39.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:39.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:41.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:41.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:41.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:42.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:42.839 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:43.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:43.678 [1199044928] >TRACE: clssgmAllocProc: (0x26a1310) allocated [ CSSD]2013-05-23 11:00:43.679 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:00:43.680 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a1310 - 1,2,3 [ CSSD]2013-05-23 11:00:43.680 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6060) proc(0x26a1310) pid(31428) version 11:1:1:4 [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26a1310), client(1/0x26959f0) [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26959f0 with con 0x26a1210, requested num -1 [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a1b30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:00:43.696 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:00:43.704 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:00:43.704 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26959f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:00:43.704 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a1e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:43.704 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a1e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:00:43.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:43.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:43.906 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a1310 [ CSSD]2013-05-23 11:00:43.906 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a1310) con(0x26a6060) skgpid ospid 31428 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:45.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:45.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:45.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:46.221 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:46.592 [1199044928] >TRACE: clssgmAllocProc: (0x26a1200) allocated [ CSSD]2013-05-23 11:00:46.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:00:46.593 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a1200 - 1,2,3 [ CSSD]2013-05-23 11:00:46.593 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a5f90) proc(0x26a1200) pid(31146/31146) version 11:1:1:4 [ CSSD]2013-05-23 11:00:46.610 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26a1200), client(1/0x26959f0) [ CSSD]2013-05-23 11:00:46.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:00:46.610 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:00:46.610 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 46 [ CSSD]2013-05-23 11:00:47.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:47.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:47.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:47.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:47.842 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:49.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:49.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:49.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:51.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:51.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:51.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:51.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:51.845 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:00:51.901 [1199044928] >TRACE: clssgmAllocProc: (0x26e8f10) allocated [ CSSD]2013-05-23 11:00:51.902 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:00:51.902 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8f10 - 1,2,3 [ CSSD]2013-05-23 11:00:51.902 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a1890) proc(0x26e8f10) pid(31523) version 11:1:1:4 [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x26e8f10), client(1/0x26e9570) [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9570) [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e9570 with con 0x26e8da0, requested num -1 [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e96e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:00:51.909 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:00:51.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9570) [ CSSD]2013-05-23 11:00:51.916 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9570), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:00:51.916 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e99e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:51.916 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e99e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:00:52.119 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8f10 [ CSSD]2013-05-23 11:00:52.119 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8f10) con(0x26a1890) skgpid ospid 31523 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:53.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:53.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:53.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:55.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:55.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:55.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:56.244 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:00:56.848 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:00:56.848 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:00:57.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:57.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:57.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:00:58.942 [1199044928] >TRACE: clssgmAllocProc: (0x26e8f10) allocated [ CSSD]2013-05-23 11:00:58.943 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:00:58.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8f10 - 1,2,3 [ CSSD]2013-05-23 11:00:58.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a1890) proc(0x26e8f10) pid(31579) version 11:1:1:4 [ CSSD]2013-05-23 11:00:58.950 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x26e8f10), client(1/0x26e9570) [ CSSD]2013-05-23 11:00:58.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9570) [ CSSD]2013-05-23 11:00:58.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e9570 with con 0x26e8da0, requested num -1 [ CSSD]2013-05-23 11:00:58.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:58.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e96e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:00:58.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:00:58.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:00:58.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9570) [ CSSD]2013-05-23 11:00:58.958 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9570), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:00:58.958 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e99e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:00:58.958 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e99e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:00:59.161 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8f10 [ CSSD]2013-05-23 11:00:59.161 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8f10) con(0x26a1890) skgpid ospid 31579 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:00:59.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:00:59.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:00:59.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:01.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:01.851 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:01.851 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:01.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:01.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:03.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:03.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:03.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:05.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:05.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:05.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:06.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:06.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:06.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:07.298 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x2699d70), client(2/0x26a1bd0) [ CSSD]2013-05-23 11:01:07.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26a1bd0) [ CSSD]2013-05-23 11:01:07.298 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:01:07.298 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 33 [ CSSD]2013-05-23 11:01:07.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:08.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:08.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:09.426 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26a1200), client(2/0x26a2070) [ CSSD]2013-05-23 11:01:09.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26a2070) [ CSSD]2013-05-23 11:01:09.426 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:01:09.426 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 34 [ CSSD]2013-05-23 11:01:09.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:10.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:10.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:10.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:10.856 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:01:11.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:12.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:12.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:13.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:14.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:14.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:14.195 [1199044928] >TRACE: clssgmAllocProc: (0x26e98d0) allocated [ CSSD]2013-05-23 11:01:14.195 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:01:14.196 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e98d0 - 1,2,3 [ CSSD]2013-05-23 11:01:14.196 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a21e0) proc(0x26e98d0) pid(31742) version 11:1:1:4 [ CSSD]2013-05-23 11:01:14.201 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x26e98d0), client(1/0x26e9f50) [ CSSD]2013-05-23 11:01:14.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9f50) [ CSSD]2013-05-23 11:01:14.201 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e9f50 with con 0x26e9760, requested num -1 [ CSSD]2013-05-23 11:01:14.201 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:14.201 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ec200/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:01:14.202 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:01:14.202 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:01:14.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9f50) [ CSSD]2013-05-23 11:01:14.208 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9f50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:01:14.208 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ec500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:14.208 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ec500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:01:14.411 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e98d0 [ CSSD]2013-05-23 11:01:14.411 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e98d0) con(0x26a21e0) skgpid ospid 31742 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:15.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:15.858 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:15.858 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:16.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:16.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:16.300 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:17.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:18.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:18.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:18.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac016590) [ CSSD]2013-05-23 11:01:18.673 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac016590), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:01:18.673 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac016590), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:01:18.673 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 33 [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 45 [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0266a0 [ CSSD]2013-05-23 11:01:18.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0266a0) con(0x7f82ac027d20) skgpid 26340 ospid 26340 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:18.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac021d90) [ CSSD]2013-05-23 11:01:18.681 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:01:18.682 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac021d90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:01:18.682 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 44 [ CSSD]2013-05-23 11:01:18.682 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac017830 [ CSSD]2013-05-23 11:01:18.682 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac017830) con(0x7f82ac0210f0) skgpid 23617 ospid 23617 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:19.158 [1199044928] >TRACE: clssgmAllocProc: (0x26e9780) allocated [ CSSD]2013-05-23 11:01:19.159 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:19.159 [1199044928] >TRACE: clssgmAllocProc: (0x26ee370) allocated [ CSSD]2013-05-23 11:01:19.159 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e9780 - 1,2,3 [ CSSD]2013-05-23 11:01:19.159 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a1fa0) proc(0x26e9780) pid(31826/31826) version 11:1:1:4 [ CSSD]2013-05-23 11:01:19.160 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:19.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee370 - 1,2,3 [ CSSD]2013-05-23 11:01:19.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9f10) proc(0x26ee370) pid(31816/31816) version 11:1:1:4 [ CSSD]2013-05-23 11:01:19.177 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26e9780), client(1/0x26ea090) [ CSSD]2013-05-23 11:01:19.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ea090) [ CSSD]2013-05-23 11:01:19.177 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:01:19.177 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 45 [ CSSD]2013-05-23 11:01:19.178 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26ee370), client(1/0x26eedb0) [ CSSD]2013-05-23 11:01:19.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eedb0) [ CSSD]2013-05-23 11:01:19.178 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:01:19.178 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 46 [ CSSD]2013-05-23 11:01:19.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:20.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:20.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ea090) [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ea090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ea090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 45 [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e9780 [ CSSD]2013-05-23 11:01:20.699 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e9780) con(0x26a1fa0) skgpid 31826 ospid 31826 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:20.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:20.861 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:21.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:22.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:22.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:23.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:24.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:24.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:24.598 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:01:24.598 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:24.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:01:24.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee0f0) proc(0x26eef20) pid(31814/31814) version 11:1:1:4 [ CSSD]2013-05-23 11:01:24.605 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26eef20), client(1/0x26eed10) [ CSSD]2013-05-23 11:01:24.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:01:24.605 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:01:24.605 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 46 [ CSSD]2013-05-23 11:01:24.642 [1199044928] >TRACE: clssgmAllocProc: (0x26b6150) allocated [ CSSD]2013-05-23 11:01:24.643 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:24.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6150 - 1,2,3 [ CSSD]2013-05-23 11:01:24.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9340) proc(0x26b6150) pid(31812/31812) version 11:1:1:4 [ CSSD]2013-05-23 11:01:24.659 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x26b6150), client(1/0x26ea090) [ CSSD]2013-05-23 11:01:24.659 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ea090) [ CSSD]2013-05-23 11:01:24.659 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:01:24.659 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 47 [ CSSD]2013-05-23 11:01:25.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:25.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:25.863 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:26.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:26.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:27.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:28.239 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:28.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:28.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:29.448 [1199044928] >TRACE: clssgmAllocProc: (0x26bb090) allocated [ CSSD]2013-05-23 11:01:29.449 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:01:29.450 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb090 - 1,2,3 [ CSSD]2013-05-23 11:01:29.450 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b60a0) proc(0x26bb090) pid(31902) version 11:1:1:4 [ CSSD]2013-05-23 11:01:29.466 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x26bb090), client(1/0x26bb780) [ CSSD]2013-05-23 11:01:29.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb780) [ CSSD]2013-05-23 11:01:29.466 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb780 with con 0x26baf20, requested num -1 [ CSSD]2013-05-23 11:01:29.466 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:29.466 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb8f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:01:29.467 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:01:29.467 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:01:29.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb780) [ CSSD]2013-05-23 11:01:29.474 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb780), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:01:29.474 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:29.474 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:01:29.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb090 [ CSSD]2013-05-23 11:01:29.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb090) con(0x26b60a0) skgpid ospid 31902 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:29.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:30.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:30.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:30.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:30.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:31.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:32.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:32.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:33.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:34.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:34.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:35.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:35.868 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:35.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:36.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:36.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:37.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:38.268 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:38.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:38.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:40.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:40.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:40.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:40.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:40.871 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:40.993 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26eef20), client(2/0x26b6a90) [ CSSD]2013-05-23 11:01:40.993 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b6a90) [ CSSD]2013-05-23 11:01:40.993 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:01:40.993 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 34 [ CSSD]2013-05-23 11:01:42.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:42.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:42.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:44.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:44.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:44.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:44.719 [1199044928] >TRACE: clssgmAllocProc: (0x26bb610) allocated [ CSSD]2013-05-23 11:01:44.719 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:01:44.719 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb610 - 1,2,3 [ CSSD]2013-05-23 11:01:44.720 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b8d00) proc(0x26bb610) pid(32077) version 11:1:1:4 [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x26bb610), client(1/0x26b69f0) [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b69f0) [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b69f0 with con 0x26bb4a0, requested num -1 [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bdeb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:01:44.726 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:01:44.732 [1199044928] >TRACE: clssgmAllocProc: (0x26c0da0) allocated [ CSSD]2013-05-23 11:01:44.732 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b69f0) [ CSSD]2013-05-23 11:01:44.732 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b69f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:01:44.732 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26be1b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:44.733 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26be1b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:01:44.733 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:44.733 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26c0da0 - 1,2,3 [ CSSD]2013-05-23 11:01:44.733 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb3f0) proc(0x26c0da0) pid(32080/32080) version 11:1:1:4 [ CSSD]2013-05-23 11:01:44.749 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x26c0da0), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 11:01:44.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:01:44.749 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:01:44.749 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x26c0da0 [ CSSD]2013-05-23 11:01:44.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26c0da0) con(0x26bb3f0) skgpid 32080 ospid 32080 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:44.935 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb610 [ CSSD]2013-05-23 11:01:44.936 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb610) con(0x26b8d00) skgpid ospid 32077 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:45.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:45.874 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:46.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:46.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:46.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:48.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:48.305 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:48.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:48.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:50.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:50.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:50.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:50.530 [1199044928] >TRACE: clssgmRegisterClient: proc(76/0x26ee370), client(2/0x7f82ac021d90) [ CSSD]2013-05-23 11:01:50.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac021d90) [ CSSD]2013-05-23 11:01:50.530 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:01:50.530 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 35 [ CSSD]2013-05-23 11:01:50.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:50.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:52.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:52.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008660) allocated [ CSSD]2013-05-23 11:01:52.156 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:01:52.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008660 - 1,2,3 [ CSSD]2013-05-23 11:01:52.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f010) proc(0x7f82ac008660) pid(32171) version 11:1:1:4 [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac008660), client(1/0x7f82ac01f880) [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01f880) [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01f880 with con 0x7f82ac00d2a0, requested num -1 [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:01:52.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:01:52.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:01:52.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01f880) [ CSSD]2013-05-23 11:01:52.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01f880), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:01:52.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00d120) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:52.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00d120) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:01:52.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008660 [ CSSD]2013-05-23 11:01:52.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008660) con(0x7f82ac00f010) skgpid ospid 32171 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:01:52.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:52.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:54.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:54.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:54.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:55.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:01:55.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:01:56.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:56.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:56.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:58.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:01:58.328 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:01:58.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:01:58.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:01:59.964 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008660) allocated [ CSSD]2013-05-23 11:01:59.965 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:01:59.966 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008660 - 1,2,3 [ CSSD]2013-05-23 11:01:59.966 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027d20) proc(0x7f82ac008660) pid(32237) version 11:1:1:4 [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac008660), client(1/0x7f82ac0049a0) [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0049a0) [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0049a0 with con 0x7f82ac00f010, requested num -1 [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:01:59.972 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:01:59.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0049a0) [ CSSD]2013-05-23 11:01:59.979 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0049a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:01:59.979 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac027ac0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:01:59.979 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac027ac0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:02:00.181 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008660 [ CSSD]2013-05-23 11:02:00.181 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008660) con(0x7f82ac027d20) skgpid ospid 32237 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:00.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:00.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:00.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:00.881 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:00.882 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:02.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:02.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:02.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:04.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:04.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:04.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:05.884 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:05.884 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:06.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:06.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:06.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:07.547 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008660) allocated [ CSSD]2013-05-23 11:02:07.547 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:07.548 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008660 - 1,2,3 [ CSSD]2013-05-23 11:02:07.548 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f010) proc(0x7f82ac008660) pid(31810/31810) version 11:1:1:4 [ CSSD]2013-05-23 11:02:07.552 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac008660), client(1/0x7f82ac01f880) [ CSSD]2013-05-23 11:02:07.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01f880) [ CSSD]2013-05-23 11:02:07.552 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:07.552 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:02:08.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:08.351 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:08.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:08.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:09.886 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:09.886 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:02:10.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:10.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:10.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:11.037 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e720) allocated [ CSSD]2013-05-23 11:02:11.037 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:11.038 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e720 - 1,2,3 [ CSSD]2013-05-23 11:02:11.038 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027b80) proc(0x7f82ac00e720) pid(32395) version 11:1:1:4 [ CSSD]2013-05-23 11:02:12.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:12.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:12.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:14.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:14.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:14.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:14.787 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x26dec00), client(2/0x7f82ac00ede0) [ CSSD]2013-05-23 11:02:14.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:02:14.787 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:02:14.788 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:02:14.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:14.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:15.230 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0140c0) allocated [ CSSD]2013-05-23 11:02:15.232 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:02:15.232 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0140c0 - 1,2,3 [ CSSD]2013-05-23 11:02:15.232 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fab0) proc(0x7f82ac0140c0) pid(32733) version 11:1:1:4 [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac0140c0), client(1/0x7f82ac027870) [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac027870) [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac027870 with con 0x7f82ac01e780, requested num -1 [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:02:15.239 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:02:15.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac027870) [ CSSD]2013-05-23 11:02:15.247 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac027870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:02:15.247 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:15.248 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:02:15.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0140c0 [ CSSD]2013-05-23 11:02:15.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0140c0) con(0x7f82ac01fab0) skgpid ospid 32733 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:16.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:16.515 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0246f0) allocated [ CSSD]2013-05-23 11:02:16.515 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:16.516 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0246f0 - 1,2,3 [ CSSD]2013-05-23 11:02:16.516 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015850) proc(0x7f82ac0246f0) pid(316/316) version 11:1:1:4 [ CSSD]2013-05-23 11:02:16.522 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac0246f0), client(1/0x7f82ac0159d0) [ CSSD]2013-05-23 11:02:16.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 11:02:16.522 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:16.522 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:02:16.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:16.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0159d0) [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0159d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0159d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0246f0 [ CSSD]2013-05-23 11:02:16.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0246f0) con(0x7f82ac015850) skgpid 316 ospid 316 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:16.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:16.946 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:16.947 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:16.947 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fe00) proc(0x7f82ac004180) pid(326/326) version 11:1:1:4 [ CSSD]2013-05-23 11:02:16.953 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac004180), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:16.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:16.953 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:16.953 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:16.973 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac01fe00) skgpid 326 ospid 326 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:17.194 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:17.195 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:17.195 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:17.195 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fe00) proc(0x7f82ac004180) pid(331/331) version 11:1:1:4 [ CSSD]2013-05-23 11:02:17.201 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac004180), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:17.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:17.201 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:17.201 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:02:17.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:17.387 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:17.387 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01fd10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:17.387 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:02:17.388 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:17.388 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac01fe00) skgpid 331 ospid 331 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:18.371 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:18.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:18.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:18.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:19.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:19.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:20.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:20.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:20.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:22.168 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:22.169 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:22.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:22.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015770) proc(0x7f82ac004180) pid(386/386) version 11:1:1:4 [ CSSD]2013-05-23 11:02:22.175 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac004180), client(1/0x7f82ac004430) [ CSSD]2013-05-23 11:02:22.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:22.175 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:22.175 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac004430), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac004430), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:22.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac015770) skgpid 386 ospid 386 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:22.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:22.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:22.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:24.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:24.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:24.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:24.893 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:24.893 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:26.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:26.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:26.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:28.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:28.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:28.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:28.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:29.895 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:29.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:30.483 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:30.484 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:02:30.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:30.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015770) proc(0x7f82ac004180) pid(460) version 11:1:1:4 [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac004180), client(1/0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fd10 with con 0x7f82ac0141d0, requested num -1 [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:02:30.490 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:02:30.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:30.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:02:30.496 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fd10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:02:30.496 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fe00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:30.496 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fe00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:02:30.698 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:30.698 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac015770) skgpid ospid 460 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:30.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:30.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:32.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:32.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:32.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:34.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:34.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:34.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:34.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:34.898 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:36.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:36.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:36.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:38.431 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:38.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:38.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:38.900 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:02:38.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:38.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:40.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:40.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:40.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:42.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:42.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:42.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2658ad0) [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2658ad0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2658ad0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a6b20 [ CSSD]2013-05-23 11:02:43.298 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a6b20) con(0x2663760) skgpid 27272 ospid 27272 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:43.902 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:43.902 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:44.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:44.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:44.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:45.738 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:45.739 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:02:45.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:45.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015770) proc(0x7f82ac004180) pid(637) version 11:1:1:4 [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac004180), client(1/0x7f82ac004430) [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004430 with con 0x7f82ac0141d0, requested num -1 [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:02:45.746 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:02:45.752 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:45.752 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:02:45.752 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fe00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:45.752 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fe00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:02:45.955 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:45.955 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac015770) skgpid ospid 637 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:46.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:47.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:47.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:48.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:48.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:48.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:48.905 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:49.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:49.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:50.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:51.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:51.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:52.418 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004180) allocated [ CSSD]2013-05-23 11:02:52.419 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:52.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004180 - 1,2,3 [ CSSD]2013-05-23 11:02:52.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015770) proc(0x7f82ac004180) pid(722) version 11:1:1:4 [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac004180), client(1/0x7f82ac004430) [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004430 with con 0x7f82ac0141d0, requested num -1 [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01f250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:02:52.426 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:02:52.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:02:52.434 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:02:52.434 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fe00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:02:52.434 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fe00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:02:52.636 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004180 [ CSSD]2013-05-23 11:02:52.636 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004180) con(0x7f82ac015770) skgpid ospid 722 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:52.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:53.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:53.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:53.302 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0140c0) allocated [ CSSD]2013-05-23 11:02:53.303 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:53.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0140c0 - 1,2,3 [ CSSD]2013-05-23 11:02:53.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac015770) proc(0x7f82ac0140c0) pid(739/739) version 11:1:1:4 [ CSSD]2013-05-23 11:02:53.310 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac0140c0), client(1/0x7f82ac027870) [ CSSD]2013-05-23 11:02:53.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac027870) [ CSSD]2013-05-23 11:02:53.310 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:02:53.310 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:02:53.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:53.908 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:54.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:55.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:55.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac027870) [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac027870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac027870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0140c0 [ CSSD]2013-05-23 11:02:55.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0140c0) con(0x7f82ac015770) skgpid 739 ospid 739 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:56.500 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e720 [ CSSD]2013-05-23 11:02:56.500 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e720) con(0x7f82ac027b80) skgpid ospid 32395 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:56.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:56.919 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e720) allocated [ CSSD]2013-05-23 11:02:56.920 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:02:56.921 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e720 - 1,2,3 [ CSSD]2013-05-23 11:02:56.921 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027b80) proc(0x7f82ac00e720) pid(776) version 11:1:1:4 [ CSSD]2013-05-23 11:02:57.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:57.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:02:57.579 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e720 [ CSSD]2013-05-23 11:02:57.579 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e720) con(0x7f82ac027b80) skgpid ospid 776 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:02:58.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:02:58.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:02:58.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:02:58.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:02:59.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:02:59.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:00.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:00.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2c0) allocated [ CSSD]2013-05-23 11:03:00.991 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:03:00.992 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2c0 - 1,2,3 [ CSSD]2013-05-23 11:03:00.992 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027b80) proc(0x7f82ac00b2c0) pid(909) version 11:1:1:4 [ CSSD]2013-05-23 11:03:00.998 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac00b2c0), client(1/0x7f82ac024850) [ CSSD]2013-05-23 11:03:00.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac024850) [ CSSD]2013-05-23 11:03:00.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac024850 with con 0x7f82ac015dd0, requested num -1 [ CSSD]2013-05-23 11:03:00.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:00.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0275d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:03:00.999 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:00.999 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:01.006 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac024850) [ CSSD]2013-05-23 11:03:01.006 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac024850), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:03:01.006 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01fbc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:01.006 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01fbc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:01.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2c0 [ CSSD]2013-05-23 11:03:01.209 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2c0) con(0x7f82ac027b80) skgpid ospid 909 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:01.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:01.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:02.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:02.913 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:02.913 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:03:03.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:03.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:04.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:05.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:05.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:06.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:07.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:07.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:07.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:07.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:08.521 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:08.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:09.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:09.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:10.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:11.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:11.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:12.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:12.918 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:12.918 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:13.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:13.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:14.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:15.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:15.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:16.242 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b1f0) allocated [ CSSD]2013-05-23 11:03:16.243 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:03:16.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b1f0 - 1,2,3 [ CSSD]2013-05-23 11:03:16.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027ab0) proc(0x7f82ac00b1f0) pid(1056) version 11:1:1:4 [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac00b1f0), client(1/0x7f82ac01fc40) [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01fc40) [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01fc40 with con 0x7f82ac015f50, requested num -1 [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0245c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:16.250 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:16.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01fc40) [ CSSD]2013-05-23 11:03:16.257 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01fc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:03:16.257 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0275d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:16.257 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0275d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:16.460 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b1f0 [ CSSD]2013-05-23 11:03:16.460 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b1f0) con(0x7f82ac027ab0) skgpid ospid 1056 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:16.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:17.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:17.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:17.921 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:17.921 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:18.545 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:18.925 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00e650) allocated [ CSSD]2013-05-23 11:03:18.926 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:18.926 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00e650 - 1,2,3 [ CSSD]2013-05-23 11:03:18.926 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027ab0) proc(0x7f82ac00e650) pid(1111) version 11:1:1:4 [ CSSD]2013-05-23 11:03:18.933 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac00e650), client(1/0x7f82ac015900) [ CSSD]2013-05-23 11:03:18.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac015900) [ CSSD]2013-05-23 11:03:18.933 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac015900 with con 0x7f82ac015f50, requested num -1 [ CSSD]2013-05-23 11:03:18.934 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:03:18.934 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0245c0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:03:18.934 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:18.934 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:18.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac015900) [ CSSD]2013-05-23 11:03:18.941 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac015900), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:03:18.941 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0275d0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:03:18.941 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac0275d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:18.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:19.039 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0158a0) allocated [ CSSD]2013-05-23 11:03:19.041 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:19.041 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0158a0 - 1,2,3 [ CSSD]2013-05-23 11:03:19.041 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fba0) proc(0x7f82ac0158a0) pid(1122) version 11:1:1:4 [ CSSD]2013-05-23 11:03:19.058 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:03:19.061 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:03:19.063 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:03:19.065 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0158a0 [ CSSD]2013-05-23 11:03:19.065 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0158a0) con(0x7f82ac01fba0) skgpid ospid 1122 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:19.143 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00e650 [ CSSD]2013-05-23 11:03:19.144 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00e650) con(0x7f82ac027ab0) skgpid ospid 1111 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:19.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:19.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:20.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:21.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:21.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:22.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:22.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:23.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:23.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:23.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:25.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:25.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:25.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:27.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:27.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:27.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:27.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:27.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:28.332 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b1f0) allocated [ CSSD]2013-05-23 11:03:28.333 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:28.333 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b1f0 - 1,2,3 [ CSSD]2013-05-23 11:03:28.333 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac027ab0) proc(0x7f82ac00b1f0) pid(617/617) version 11:1:1:4 [ CSSD]2013-05-23 11:03:28.340 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac00b1f0), client(1/0x7f82ac016010) [ CSSD]2013-05-23 11:03:28.340 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac016010) [ CSSD]2013-05-23 11:03:28.340 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:03:28.340 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:03:28.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:29.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:29.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:29.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:31.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:31.486 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0140c0) allocated [ CSSD]2013-05-23 11:03:31.487 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:03:31.488 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0140c0 - 1,2,3 [ CSSD]2013-05-23 11:03:31.488 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0245c0) proc(0x7f82ac0140c0) pid(1213) version 11:1:1:4 [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac0140c0), client(1/0x7f82ac004430) [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004430 with con 0x7f82ac01e780, requested num -1 [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:31.504 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:31.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:31.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:31.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004430) [ CSSD]2013-05-23 11:03:31.511 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:03:31.511 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac01f300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:31.512 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac01f300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:31.714 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0140c0 [ CSSD]2013-05-23 11:03:31.714 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0140c0) con(0x7f82ac0245c0) skgpid ospid 1213 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:31.928 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:31.928 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:03:33.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:33.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:33.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:34.793 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac00b1f0), client(2/0x7f82ac01fd10) [ CSSD]2013-05-23 11:03:34.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:03:34.793 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:03:34.793 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:03:35.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:35.435 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f420) allocated [ CSSD]2013-05-23 11:03:35.436 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:35.436 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f420 - 1,2,3 [ CSSD]2013-05-23 11:03:35.436 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac024840) proc(0x7f82ac01f420) pid(1296) version 11:1:1:4 [ CSSD]2013-05-23 11:03:35.484 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac01f420), client(1/0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.484 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac0141d0 with con 0x7f82ac01e780, requested num -1 [ CSSD]2013-05-23 11:03:35.484 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:03:35.484 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fe00/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:03:35.485 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:35.485 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:35.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0141d0), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:03:35.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac020100) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:03:35.486 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac020100) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:35.521 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac01f420), client(2/0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.521 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac0141d0 with con 0x7f82ac01e780, requested num -1 [ CSSD]2013-05-23 11:03:35.521 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:03:35.521 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fe00/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:03:35.522 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:35.522 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:35.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:35.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:35.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:35.552 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac0141d0), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:03:35.552 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac020100) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:03:35.552 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac020100) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:35.683 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f420 [ CSSD]2013-05-23 11:03:35.683 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f420) con(0x7f82ac024840) skgpid ospid 1296 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:36.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:36.931 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:37.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:37.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:37.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:38.612 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:39.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:39.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:39.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:40.666 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f180) allocated [ CSSD]2013-05-23 11:03:40.667 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:40.667 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f180 - 1,2,3 [ CSSD]2013-05-23 11:03:40.667 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0159c0) proc(0x7f82ac01f180) pid(1382) version 11:1:1:4 [ CSSD]2013-05-23 11:03:41.099 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f180 [ CSSD]2013-05-23 11:03:41.099 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f180) con(0x7f82ac0159c0) skgpid ospid 1382 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:41.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:41.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:41.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:41.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:41.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:43.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:43.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:43.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:45.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:45.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:45.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:46.758 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f180) allocated [ CSSD]2013-05-23 11:03:46.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:03:46.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f180 - 1,2,3 [ CSSD]2013-05-23 11:03:46.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0159c0) proc(0x7f82ac01f180) pid(1577) version 11:1:1:4 [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac01f180), client(1/0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0141d0 with con 0x7f82ac01e780, requested num -1 [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac01fe00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:46.777 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:46.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:46.785 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0141d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:03:46.785 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:46.785 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:46.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:46.936 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:46.988 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f180 [ CSSD]2013-05-23 11:03:46.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f180) con(0x7f82ac0159c0) skgpid ospid 1577 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:47.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:47.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:47.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:48.637 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2659f40) [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2659f40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2659f40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9850 [ CSSD]2013-05-23 11:03:48.688 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9850) con(0x269f240) skgpid 27922 ospid 27922 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:48.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26912a0) [ CSSD]2013-05-23 11:03:48.697 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26912a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:03:48.697 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26912a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:03:48.697 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 36 [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e2940) [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e2940), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e2940), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 46 [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmDeadProc: proc 0x2660d60 [ CSSD]2013-05-23 11:03:48.709 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2660d60) con(0x269a3e0) skgpid 27924 ospid 27924 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:48.939 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01f410) allocated [ CSSD]2013-05-23 11:03:48.939 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:48.940 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01f410 - 1,2,3 [ CSSD]2013-05-23 11:03:48.940 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0159c0) proc(0x7f82ac01f410) pid(1640/1640) version 11:1:1:4 [ CSSD]2013-05-23 11:03:48.947 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x7f82ac01f410), client(1/0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:48.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:03:48.947 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:03:48.947 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 47 [ CSSD]2013-05-23 11:03:49.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:49.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:49.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:51.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:51.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:51.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:51.938 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:51.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:52.672 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019210) allocated [ CSSD]2013-05-23 11:03:52.673 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:03:52.673 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019210 - 1,2,3 [ CSSD]2013-05-23 11:03:52.673 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020070) proc(0x7f82ac019210) pid(1668) version 11:1:1:4 [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac019210), client(1/0x7f82ac020fa0) [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac020fa0) [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac020fa0 with con 0x7f82ac023790, requested num -1 [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac021110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:03:52.680 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:03:52.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac020fa0) [ CSSD]2013-05-23 11:03:52.686 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac020fa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:03:52.686 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac023610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:03:52.686 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac023610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:03:52.889 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019210 [ CSSD]2013-05-23 11:03:52.889 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019210) con(0x7f82ac020070) skgpid ospid 1668 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:03:53.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:53.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:53.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:54.020 [1199044928] >TRACE: clssgmRegisterClient: proc(77/0x7f82ac01f410), client(2/0x7f82ac007350) [ CSSD]2013-05-23 11:03:54.020 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac007350) [ CSSD]2013-05-23 11:03:54.020 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:03:54.020 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:03:55.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:55.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:55.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:56.941 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:03:56.941 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:03:57.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:57.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:57.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:03:58.659 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:03:59.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:03:59.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:03:59.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:00.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:00.943 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:04:01.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:01.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:01.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:02.030 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:04:02.031 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:04:02.032 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:04:02.032 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(1738) version 11:1:1:4 [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac020d10), client(1/0x7f82ac021480) [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021480 with con 0x7f82ac023720, requested num -1 [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:02.037 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:04:02.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:02.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:04:02.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:02.044 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:02.246 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:04:02.246 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 1738 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:03.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:03.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:03.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:05.025 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:04:05.026 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:04:05.026 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:04:05.026 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(1797) version 11:1:1:4 [ CSSD]2013-05-23 11:04:05.122 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0189f0) allocated [ CSSD]2013-05-23 11:04:05.122 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:04:05.123 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0189f0 - 1,2,3 [ CSSD]2013-05-23 11:04:05.123 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac023750) proc(0x7f82ac0189f0) pid(1807) version 11:1:1:4 [ CSSD]2013-05-23 11:04:05.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:04:05.151 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:04:05.153 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0189f0 [ CSSD]2013-05-23 11:04:05.153 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0189f0) con(0x7f82ac023750) skgpid ospid 1807 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5281/0x7f82ac021480) [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5281 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac021480 with con 0x7f82ac023750, requested num -1 [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac026c60/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:05.244 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:04:05.251 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5281 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:05.251 [1199044928] >TRACE: clssgmExitGrock: client 5281 (0x7f82ac021480), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:04:05.251 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:04:05.252 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:05.253 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:04:05.253 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 1797 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:05.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:05.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:05.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:05.945 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:05.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:07.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:07.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:07.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:08.681 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:09.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:09.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:09.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:10.948 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:10.948 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:11.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:11.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:11.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:13.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:13.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:13.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:15.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:15.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:15.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:15.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:15.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:17.275 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:04:17.276 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:04:17.277 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:04:17.277 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(1914) version 11:1:1:4 [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac020d10), client(1/0x7f82ac021480) [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021480 with con 0x7f82ac023720, requested num -1 [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:17.283 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:04:17.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:17.290 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:04:17.290 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:17.290 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:17.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:04:17.493 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 1914 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:17.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:17.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:17.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:18.703 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:19.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:20.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:20.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:20.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:20.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:21.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:22.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:22.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:23.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:24.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:24.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:25.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:25.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:25.955 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:26.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:26.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:27.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:28.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:28.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:28.723 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:29.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:29.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:29.958 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:04:30.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:30.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:31.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:32.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:32.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:32.535 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:04:32.536 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:04:32.537 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:04:32.537 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(2064) version 11:1:1:4 [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac020d10), client(1/0x7f82ac021480) [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021480 with con 0x7f82ac023720, requested num -1 [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:32.543 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:04:32.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:32.549 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:04:32.549 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:32.550 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:32.752 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:04:32.752 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 2064 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:33.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:34.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:34.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:34.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:34.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:35.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:36.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:36.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:37.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:38.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:38.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:38.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:39.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:39.963 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:39.963 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:40.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:40.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:41.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:42.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:42.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:43.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:44.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:44.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:44.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:44.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:45.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:46.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:46.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:47.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:47.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac023600) allocated [ CSSD]2013-05-23 11:04:47.795 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:04:47.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac023600 - 1,2,3 [ CSSD]2013-05-23 11:04:47.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01fe00) proc(0x7f82ac023600) pid(2236) version 11:1:1:4 [ CSSD]2013-05-23 11:04:47.800 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac023600), client(1/0x7f82ac020d10) [ CSSD]2013-05-23 11:04:47.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac020d10) [ CSSD]2013-05-23 11:04:47.800 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac020d10 with con 0x7f82ac026dd0, requested num -1 [ CSSD]2013-05-23 11:04:47.801 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:47.801 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac020e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:04:47.801 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:47.801 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:04:47.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac020d10) [ CSSD]2013-05-23 11:04:47.806 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac020d10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:04:47.806 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac021180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:47.806 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac021180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:48.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac023600 [ CSSD]2013-05-23 11:04:48.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac023600) con(0x7f82ac01fe00) skgpid ospid 2236 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:48.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:48.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:48.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:49.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:49.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:49.968 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:50.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:50.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:51.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:52.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:52.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:52.941 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:04:52.942 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:04:52.942 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:04:52.942 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(2313) version 11:1:1:4 [ CSSD]2013-05-23 11:04:52.947 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac020d10), client(1/0x7f82ac021480) [ CSSD]2013-05-23 11:04:52.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:52.947 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021480 with con 0x7f82ac023720, requested num -1 [ CSSD]2013-05-23 11:04:52.947 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:52.947 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:04:52.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:04:52.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:04:52.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:04:52.954 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:04:52.954 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:04:52.954 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:04:53.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:04:53.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 2313 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:04:53.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:53.970 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:53.970 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:04:54.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:54.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:55.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:56.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:56.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:57.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:04:58.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:04:58.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:04:58.790 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:04:58.972 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:04:58.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:04:59.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:00.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:00.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:01.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:02.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:02.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:03.049 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac020d10) allocated [ CSSD]2013-05-23 11:05:03.050 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:03.051 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac020d10 - 1,2,3 [ CSSD]2013-05-23 11:05:03.051 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac020d10) pid(2396) version 11:1:1:4 [ CSSD]2013-05-23 11:05:03.067 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac020d10), client(1/0x7f82ac021480) [ CSSD]2013-05-23 11:05:03.067 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:05:03.067 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac021480 with con 0x7f82ac023720, requested num -1 [ CSSD]2013-05-23 11:05:03.067 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:03.067 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac026c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:05:03.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:03.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:03.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac021480) [ CSSD]2013-05-23 11:05:03.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac021480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:05:03.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac026f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:03.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac026f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:03.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac020d10 [ CSSD]2013-05-23 11:05:03.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac020d10) con(0x7f82ac019040) skgpid ospid 2396 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:03.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:03.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:03.975 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:04.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:04.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:05.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:06.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:06.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:07.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:08.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:08.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:08.813 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:05:08.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:08.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:09.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:10.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cb0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.147 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82b42d3b20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:10.147 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cc0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82b42ccf90/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cd0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmAddMember: granted member(1) flags(0x1) node(2) grock (0x7f82b42d3b20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:10.149 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(1/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:10.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(02ce0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.165 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DBHWPROD, change 1 [ CSSD]2013-05-23 11:05:10.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cf0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.167 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.167 [1123510592] >TRACE: clssgmRemoveMember: grock DAALL_DB, member number 3 (0x7f82b42583a0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d00105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.169 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.169 [1123510592] >TRACE: clssgmRemoveMember: grock DGHWPROD0, member number 1 (0x7f82b427c510) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.169 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(1) master(0) event(1), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d10105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.173 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.173 [1123510592] >TRACE: clssgmRemoveMember: grock DGHWPROD, member number 1 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.173 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(1) master(0) event(1), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d20105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.175 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.175 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d30105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.176 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.176 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82b4207a80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d40105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmRemoveMember: grock IGHWPRODSYS$BACKGROUND, member number 2 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(1) master(1) event(1), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d50105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmRemoveMember: grock IGHWPRODSYS$USERS, member number 2 (0x7f82b42ae3d0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(1) master(1) event(1), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d60105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.178 [1123510592] >TRACE: clssgmRemoveMember: grock IGHWPRODALL, member number 2 (0x7f82b42a9110) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(1) master(1) event(1), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d70105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmRemoveMember: grock IGHWPRODHWPRODXDB, member number 2 (0x7f82b42ae8f0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(1) master(1) event(1), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d80105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmRemoveMember: grock IGHWPRODHWPROD, member number 2 (0x7f82b42a3ba0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(1) master(1) event(1), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d90105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.179 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 1 (0x7f82b42cbe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02da0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.300 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.300 [1123510592] >TRACE: clssgmRemoveMember: grock DBHWPROD, member number 1 (0x7f82b42ae590) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:10.300 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(1) master(0) event(1), incarn 11, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:10.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:10.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02db0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.812 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.812 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02dc0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.814 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.814 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.814 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 11:05:10.814 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:10.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02dd0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.815 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.815 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.815 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:10.815 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02de0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.816 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.816 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02df0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.818 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:10.818 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e00105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.818 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.818 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42cbe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e10105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.819 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.819 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.819 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:10.820 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e20105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.820 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e30105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.821 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:10.821 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e40105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.822 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.822 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42ae590) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e50105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.823 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.823 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.823 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:10.823 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e60105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.824 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.824 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e70105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.825 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 11:05:10.825 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:10.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e80105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.826 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:10.826 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e90105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.827 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.827 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ea0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.829 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:10.829 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02eb0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.830 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.830 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42ae590) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ec0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.831 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:10.831 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ed0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.832 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.832 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ee0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.833 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:10.833 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ef0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.834 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.834 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42ae590) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:10.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f00105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:10.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:10.835 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:10.835 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:10.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f10105) incarnation(174631049) [ CSSD]2013-05-23 11:05:10.836 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:10.836 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42cbe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f20105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.100 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82b42d3b20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:11.101 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:11.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f30105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.107 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.107 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42cbe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f40105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.195 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 11:05:11.195 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:11.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f50105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.196 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.196 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b4207a80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f60105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.683 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.683 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f70105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.685 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 11:05:11.685 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:11.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f80105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.686 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:11.686 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f90105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.687 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.687 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fa0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.689 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:11.689 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fb0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.690 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.690 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fc0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.691 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:11.691 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fd0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.692 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.692 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fe0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.693 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.693 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.693 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:11.693 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ff0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03000105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:11.695 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03010105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.695 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.695 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03020105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.696 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:11.696 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03030105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.697 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.697 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:11.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03040105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.698 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03050105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b427e110/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:11.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:11.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03060105) incarnation(174631049) [ CSSD]2013-05-23 11:05:11.700 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:11.700 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:12.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03070105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.151 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82b42d3b20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:12.151 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:12.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03080105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.158 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.158 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 9 [ CSSD]2013-05-23 11:05:12.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03090105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.743 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.743 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42b0d30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030a0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.744 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.744 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42a5440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030b0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.883 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.883 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030c0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.884 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42d3b20/_CRS_RDB) [ CSSD]2013-05-23 11:05:12.884 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:12.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030d0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.886 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:12.886 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030e0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.887 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.887 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030f0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.888 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:12.889 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03100105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.890 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.890 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03110105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:12.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03120105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.892 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03130105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:12.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03140105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.894 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.894 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03150105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.895 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.895 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.895 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:12.895 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03160105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.896 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.896 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03170105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:12.898 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03180105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.899 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:12.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03190105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42b3800/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:12.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031a0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:12.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:12.901 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42ccf90/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:12.901 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:12.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031b0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:12.902 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:12.902 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:13.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031c0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:05:13.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:05:13.199 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82b42d3b20/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:05:13.199 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:13.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031d0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.205 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.205 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82b41fa050) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:13.516 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac008cc0) allocated [ CSSD]2013-05-23 11:05:13.516 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a2d0) allocated [ CSSD]2013-05-23 11:05:13.516 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006930) allocated [ CSSD]2013-05-23 11:05:13.517 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac013120) allocated [ CSSD]2013-05-23 11:05:13.517 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac02bf40) allocated [ CSSD]2013-05-23 11:05:13.517 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.517 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.518 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.518 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a2d0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.518 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0211d0) proc(0x7f82ac00a2d0) pid(2517/2517) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.518 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006930 - 1,2,3 [ CSSD]2013-05-23 11:05:13.518 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac009650) proc(0x7f82ac006930) pid(2523/2523) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.518 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac008cc0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019040) proc(0x7f82ac008cc0) pid(2496/2496) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac030ab0) allocated [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac013120 - 1,2,3 [ CSSD]2013-05-23 11:05:13.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002220) proc(0x7f82ac013120) pid(2533/2533) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac02bf40 - 1,2,3 [ CSSD]2013-05-23 11:05:13.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0123f0) proc(0x7f82ac02bf40) pid(2510/2510) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.520 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac030ab0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac02c6b0) proc(0x7f82ac030ab0) pid(2519/2519) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac00a2d0), client(1/0x7f82ac006eb0) [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac006eb0) [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac008cc0), client(1/0x7f82ac0313c0) [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0313c0) [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.529 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82ac013120), client(1/0x7f82ac0318b0) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0318b0) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 50 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac006930), client(1/0x7f82ac031da0) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac031da0) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 51 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterClient: proc(82/0x7f82ac02bf40), client(1/0x7f82ac032290) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac032290) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 52 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterClient: proc(83/0x7f82ac030ab0), client(1/0x7f82ac032780) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac032780) [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.530 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 53 [ CSSD]2013-05-23 11:05:13.592 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac03b710) allocated [ CSSD]2013-05-23 11:05:13.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0401b0) allocated [ CSSD]2013-05-23 11:05:13.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac044d00) allocated [ CSSD]2013-05-23 11:05:13.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac049950) allocated [ CSSD]2013-05-23 11:05:13.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac04e6c0) allocated [ CSSD]2013-05-23 11:05:13.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0532a0) allocated [ CSSD]2013-05-23 11:05:13.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0538f0) allocated [ CSSD]2013-05-23 11:05:13.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0585a0) allocated [ CSSD]2013-05-23 11:05:13.595 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac05d2d0) allocated [ CSSD]2013-05-23 11:05:13.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac03b710 - 1,2,3 [ CSSD]2013-05-23 11:05:13.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac032d90) proc(0x7f82ac03b710) pid(2535/2535) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.595 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0401b0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0375d0) proc(0x7f82ac0401b0) pid(2525/2525) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.596 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac044d00 - 1,2,3 [ CSSD]2013-05-23 11:05:13.596 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac03c070) proc(0x7f82ac044d00) pid(2500/2500) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.596 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.596 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.596 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.596 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.596 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac049950 - 1,2,3 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac040bc0) proc(0x7f82ac049950) pid(2537/2537) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac04e6c0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac045810) proc(0x7f82ac04e6c0) pid(2513/2513) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0532a0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac04a580) proc(0x7f82ac0532a0) pid(2508/2508) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0538f0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac04f160) proc(0x7f82ac0538f0) pid(2498/2498) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0585a0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac054040) proc(0x7f82ac0585a0) pid(2515/2515) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.598 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.598 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac05d2d0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.598 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac058d10) proc(0x7f82ac05d2d0) pid(2521/2521) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.609 [1199044928] >TRACE: clssgmRegisterClient: proc(84/0x7f82ac03b710), client(1/0x7f82ac05d0a0) [ CSSD]2013-05-23 11:05:13.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05d0a0) [ CSSD]2013-05-23 11:05:13.609 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.609 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 54 [ CSSD]2013-05-23 11:05:13.610 [1199044928] >TRACE: clssgmRegisterClient: proc(85/0x7f82ac0401b0), client(1/0x7f82ac05dad0) [ CSSD]2013-05-23 11:05:13.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05dad0) [ CSSD]2013-05-23 11:05:13.610 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.610 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 55 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(86/0x7f82ac044d00), client(1/0x7f82ac05df40) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05df40) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 56 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(90/0x7f82ac0538f0), client(1/0x7f82ac05e6b0) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(89/0x7f82ac0532a0), client(1/0x7f82ac05e820) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05e820) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 57 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05e6b0) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 58 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(87/0x7f82ac049950), client(1/0x7f82ac05ec90) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05ec90) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 59 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(91/0x7f82ac0585a0), client(1/0x7f82ac05f480) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterClient: proc(88/0x7f82ac04e6c0), client(1/0x7f82ac05f5f0) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05f5f0) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 60 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05f480) [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.611 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 61 [ CSSD]2013-05-23 11:05:13.612 [1199044928] >TRACE: clssgmRegisterClient: proc(92/0x7f82ac05d2d0), client(1/0x7f82ac05fa60) [ CSSD]2013-05-23 11:05:13.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac05fa60) [ CSSD]2013-05-23 11:05:13.612 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.612 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 62 [ CSSD]2013-05-23 11:05:13.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac068ab0) allocated [ CSSD]2013-05-23 11:05:13.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0690d0) allocated [ CSSD]2013-05-23 11:05:13.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac068ab0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac060070) proc(0x7f82ac068ab0) pid(26315/26315) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0690d0 - 1,2,3 [ CSSD]2013-05-23 11:05:13.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac064970) proc(0x7f82ac0690d0) pid(20958/20958) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82ac068ab0), client(1/0x7f82ac069750) [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac069750) [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 63 [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac0690d0), client(1/0x7f82ac069bd0) [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac069bd0) [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.641 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:05:13.653 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26955e0) [ CSSD]2013-05-23 11:05:13.653 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26955e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:05:13.653 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26955e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:05:13.653 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 36 [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2695a90) [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2695a90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2695a90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmDeadProc: proc 0x2695070 [ CSSD]2013-05-23 11:05:13.660 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2695070) con(0x2681580) skgpid 31187 ospid 31187 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031e0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmRemoveMember: grock IG+ASMSYS$BACKGROUND, member number 2 (0x7f82b42b5df0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(1) master(1) event(1), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031f0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.757 [1123510592] >TRACE: clssgmRemoveMember: grock IG+ASMSYS$USERS, member number 2 (0x7f82b42b6250) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.758 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(1) master(1) event(1), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03200105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmRemoveMember: grock DG+ASM0, member number 1 (0x7f82b4207e50) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(1) master(0) event(1), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(03210105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.759 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DB+ASM, change 1 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03220105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmRemoveMember: grock DAALL_DB, member number 1 (0x7f82b42b35a0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03230105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmRemoveMember: grock VT+ASM, member number 2 (0x7f82b429d770) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(1), incarn 31, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03240105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmRemoveMember: grock HB+ASM, member number 2 (0x7f82b4207880) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03250105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmRemoveMember: grock DG+ASM, member number 1 (0x7f82b4285d70) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(1) master(0) event(1), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03260105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmRemoveMember: grock OSM_ALL, member number 1 (0x7f82b42b5fb0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(03270105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.760 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DG_DATA, change 1 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(03280105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DG_REDOA, change 1 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(03290105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DG_REDOB, change 1 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(032a0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DG_SBYREDOA, change 1 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(10) src(2) dest(1) size(352) tag(032b0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmHandleMemberChange: src(2), mbr 1, grock DG_SBYREDOB, change 1 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032c0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmRemoveMember: grock DG_DATA, member number 1 (0x7f82b429dac0) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.761 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(1) master(0) event(1), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:13.849 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06c560) allocated [ CSSD]2013-05-23 11:05:13.849 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:13.850 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06c560 - 1,2,3 [ CSSD]2013-05-23 11:05:13.850 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06a1e0) proc(0x7f82ac06c560) pid(2549/2549) version 11:1:1:4 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032d0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmRemoveMember: grock DG_REDOB, member number 1 (0x7f82b429e380) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(1) master(0) event(1), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032e0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmRemoveMember: grock DG_REDOA, member number 1 (0x7f82b429dfe0) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(1) master(0) event(1), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032f0105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmRemoveMember: grock DG_SBYREDOB, member number 1 (0x7f82b429eac0) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(1) master(0) event(1), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03300105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmRemoveMember: grock DB+ASM, member number 1 (0x7f82b42ae710) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(1) master(0) event(1), incarn 15, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03310105) incarnation(174631049) [ CSSD]2013-05-23 11:05:13.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:13.863 [1123510592] >TRACE: clssgmRemoveMember: grock DG_SBYREDOA, member number 1 (0x7f82b429e720) node number 2 state 0x1 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:13.863 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(1) master(0) event(1), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:13.864 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06c560), client(1/0x7f82ac06cbe0) [ CSSD]2013-05-23 11:05:13.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac06cbe0) [ CSSD]2013-05-23 11:05:13.864 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:13.864 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:05:13.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:13.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:14.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:14.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:05:14.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmRegisterClient: proc(10/0x7f82b41c7e50), client(7/0x7f82ac06d840) [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 7 (0x7f82ac06d840) [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmJoinGrock: global grock VT+ASM new client 0x7f82ac06d840 with con 0x7f82ac06d230, requested num 0 [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock VT+ASM [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmAddMember: Adding fencing for member 0, group VT+ASM, death 1, SAGE 0 [ CSSD]2013-05-23 11:05:14.502 [1199044928] >TRACE: clssgmAddMember: member (0/0x7f82ac06cf20) added. pbsz(0) prsz(0) flags 0x0 to grock (0x265c3f0/VT+ASM) [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(1), incarn 32, mbrc 2, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(1), incarn 32, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmCommonAddMember: global group grock VT+ASM member(0/Local) node(1) flags 0x0 0x0 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 3 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmMasterGrpDataUpdt: grock VT+ASM, type 3, incarn 19, len 100 [ CSSD]2013-05-23 11:05:14.503 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(8), incarn 20, mbrc 0, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 3 [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmMasterGrpDataUpdt: grock VT+ASM, type 3, incarn 20, len 100 [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(8), incarn 21, mbrc 0, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 7 (0x7f82ac06d840) [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmExitGrock: client 7 (0x7f82ac06d840), grock VT+ASM, member 0 [ CSSD]2013-05-23 11:05:14.504 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cf20) in global grock VT+ASM [ CSSD]2013-05-23 11:05:14.505 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(2), incarn 32, mbrc 2, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:14.505 [1199044928] >TRACE: clssgmRemoveMember: grock VT+ASM, member number 0 (0x7f82ac06cf20) node number 1 state 0x14 member refcnt 0 grock type 2 [ CSSD]2013-05-23 11:05:14.505 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(1), incarn 33, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:14.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterClient: proc(90/0x7f82ac0538f0), client(2/0x7f82ac06f2b0) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterClient: proc(89/0x7f82ac0532a0), client(2/0x7f82ac06f420) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterClient: proc(86/0x7f82ac044d00), client(2/0x7f82ac06f590) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterClient: proc(82/0x7f82ac02bf40), client(2/0x7f82ac06f700) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x7f82ac008cc0), client(2/0x7f82ac06f870) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac06f870) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac06f700) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac06f590) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac06f420) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac06f2b0) [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.713 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 41 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(92/0x7f82ac05d2d0), client(2/0x7f82ac0716f0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(91/0x7f82ac0585a0), client(2/0x7f82ac071860) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(88/0x7f82ac04e6c0), client(2/0x7f82ac0719d0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(87/0x7f82ac049950), client(2/0x7f82ac071b40) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(85/0x7f82ac0401b0), client(2/0x7f82ac071cb0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(84/0x7f82ac03b710), client(2/0x7f82ac071e20) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(83/0x7f82ac030ab0), client(2/0x7f82ac071f90) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82ac006930), client(2/0x7f82ac072100) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x7f82ac00a2d0), client(2/0x7f82ac072270) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac072270) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 42 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac072100) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 43 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac071f90) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 44 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac071e20) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 45 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac071cb0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 46 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac071b40) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 47 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0719d0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac071860) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0716f0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 50 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82ac013120), client(2/0x7f82ac0726f0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0726f0) [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:05:15.714 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 51 [ CSSD]2013-05-23 11:05:16.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:16.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03320105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.363 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.363 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42a41c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:16.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03330105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.365 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.365 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b4207270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:16.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03340105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.573 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.573 [1123510592] >TRACE: clssgmRemoveMember: grock ocr_prod-rac, member number 2 (0x7f82b42a1ed0) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:16.573 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03350105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmRemoveMember: grock _ORA_CRS_MEMBER_prod-rac02, member number 0 (0x7f82b4286740) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03360105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmRemoveMember: grock crs_version, member number 0 (0x7f82b42b5840) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03370105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.606 [1123510592] >TRACE: clssgmRemoveMember: grock CRSDMAIN, member number 2 (0x7f82b42b5b40) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:16.607 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:05:16.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03380105) incarnation(174631049) [ CSSD]2013-05-23 11:05:16.738 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:16.738 [1123510592] >TRACE: clssgmRemoveMember: grock #CSS_CLSSOMON, member number 2 (0x7f82b4285e90) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:16.739 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(1) master(1) event(1), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03390105) incarnation(174631049) [ CSSD]2013-05-23 11:05:17.124 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:05:17.124 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRD_2_HWPROD, member number 0 (0x7f82b42a2930) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 11:05:17.127 [1182259520] >TRACE: clssnmHandleManualShut: Nodes 2, prod-rac02, has been manually shut down [ CSSD]2013-05-23 11:05:17.256 [1123510592] >TRACE: clssgmPeerEventHndlr: receive failed, node 2 (prod-rac02) (0x7f82b427c7f0), rc 11 [ CSSD]2013-05-23 11:05:17.256 [1123510592] >TRACE: clssgmPeerDeactivate: node 2 (prod-rac02), death 0, state 0x80000001 connstate 0xf [ CSSD]2013-05-23 11:05:17.256 [1123510592] >TRACE: clssgmPeerListener: discarded 0 future msgsfor 2 [ CSSD]2013-05-23 11:05:17.256 [1182259520] >WARNING: clssnmeventhndlr: Receive failure with node 2 (prod-rac02), state 5, con(0x26a24d0), probe((nil)), rc=11 [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmDiscHelper: prod-rac02, node(2) connection failed, con (0x26a24d0), probe((nil)) [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmDiscHelper: node 2 clean up, con (0x26a24d0), init state 5, cur state 5 [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmDoSyncUpdate: Initiating sync 174631050 [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (27000)ms [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (11) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetupAckWait: node(1) is ALIVE [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631050) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: List of nodes that have ACKed my sync: NULL [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631050) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmWaitForAcks: Ack message type(11), ackCount(1) [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmHandleSync: diskTimeout set to (27000)ms [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmQueueClientEvent: Sending Event(2), type 2, incarn 174631049 [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmQueueClientEvent: Node[1] state = 3, birth = 174631047, unique = 1367734820 [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmQueueClientEvent: Node[2] state = 5, birth = 174631049, unique = 1367735557 [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmHandleSync: Acknowledging sync: src[1] srcName[prod-rac01] seq[9] sync[174631050] [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmSendAck: node 1, prod-rac01, syncSeqNo(174631050) type(11) [ CSSD]2013-05-23 11:05:17.256 [1182259520] >TRACE: clssnmHandleAck: src[1] dest[1] dom[0] seq[0] sync[174631050] type[11] ackCount(0) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631050) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: List of nodes that have ACKed my sync: 1 [ CSSD]2013-05-23 11:05:17.256 [3136792288] >TRACE: clssgmStartNMMon: node 1 active, birth 174631047 [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmWaitForAcks: done, msg type(11) [ CSSD]2013-05-23 11:05:17.256 [3136792288] >TRACE: clssgmStartNMMon: node 2 active, birth 174631049 [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetMinMaxVersion: node 1 product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetMinMaxVersion: properties common to all nodes: 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:05:17.256 [3136792288] >USER: NMEVENT_SUSPEND [00][00][00][06] [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetMinMaxVersion: min product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetMinMaxVersion: max product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:05:17.256 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 5, changes 28 [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmNeedConfReq: No configuration to change [ CSSD]2013-05-23 11:05:17.256 [3136792288] >TRACE: clssgmSuspendAllGrocks: Issue SUSPEND [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmDoSyncUpdate: Terminating node 2, prod-rac02, misstime(930) state(5) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (13) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmDoSyncUpdate: Wait for 0 vote ack(s) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmCheckDskInfo: Checking disk info... [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmEvict: Start [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmWaitOnEvictions: Start [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (15) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmBldSendUpdate: syncSeqNo(174631050) [ CSSD]2013-05-23 11:05:17.256 [1173866816] >TRACE: clssnmBldSendUpdate: using msg version 3 [ CSSD]2013-05-23 11:05:17.257 [1173866816] >TRACE: clssnmWaitForAcks: Ack message type(15), ackCount(1) [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmHandleUpdate: sync[174631050] src[1], msgvers 3 icin 174631045 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmHandleUpdate: common prop (max 14) got 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmUpdateNodeState: node 1, state (3/3) unique (1367734820/1367734820) prevConuni(0) birth (174631047/174631047) (old/new) [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmUpdateNodeState: node 2, state (5/0) unique (1367735557/1367735557) prevConuni(1367735557) birth (174631049/174631049) (old/new) [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmDeactivateNode: node prod-rac02, number 2, state 5 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmDeactivateNode: node 2 (prod-rac02) left cluster [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmSendAck: node 1, prod-rac01, syncSeqNo(174631050) type(15) [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmQueueClientEvent: Sending Event(1), type 1, incarn 174631050 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmQueueClientEvent: Node[1] state = 3, birth = 174631047, unique = 1367734820 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmQueueClientEvent: Node[2] state = 0, birth = 0, unique = 0 [ CSSD]2013-05-23 11:05:17.257 [1182259520] >USER: clssnmHandleUpdate: SYNC(174631050) from node(1) completed [ CSSD]2013-05-23 11:05:17.257 [1182259520] >USER: clssnmHandleUpdate: NODE 1 (prod-rac01) IS ACTIVE MEMBER OF CLUSTER [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms [ CSSD]2013-05-23 11:05:17.257 [1182259520] >TRACE: clssnmHandleAck: src[1] dest[1] dom[0] seq[0] sync[174631050] type[15] ackCount(0) [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(1) master(1) event(2), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [1173866816] >TRACE: clssnmWaitForAcks: done, msg type(15) [ CSSD]2013-05-23 11:05:17.257 [1173866816] >TRACE: clssnmDoSyncUpdate: Sync 174631050 complete! [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(ORA_CLSRD_1_HWPROD) count(1) master(0) event(2), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.257 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(1) master(1) event(2), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(2), incarn 33, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.258 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(1) master(0) event(2), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(1) master(0) event(2), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.259 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmSuspendAllGrocks: done [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 2, changes 29 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 174631049, changes 10 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmCleanupNodeContexts(): cleaning up nodes, rcfg(174631049) [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmCleanupNodeContexts(): successful cleanup of nodes rcfg(174631049) [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmStartNMMon: completed node cleanup [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmStartNMMon: node 1 active, birth 174631047 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmStartNMMon: node 2 failed, birth (174631049, 0) (old/new) [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmUpdateEventValue: Reconfig Event val 1, changes 10 [ CSSD]2013-05-23 11:05:17.260 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 3, changes 30 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmReconfigThread: started for reconfig (174631050) [ CSSD]2013-05-23 11:05:17.260 [1249401152] >USER: NMEVENT_RECONFIG [00][00][00][02] [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 4, from 3, changes 31 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupNodeContexts(): cleaning up nodes, rcfg(174631049) [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupNodeContexts(): successful cleanup of nodes rcfg(174631050) [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IGHWPRODHWPROD type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IG+ASMSYS$USERS type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock _ORA_CRS_MEMBER_prod-rac01 type 3 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock crs_version type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock ocr_prod-rac type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IGHWPRODHWPRODXDB type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IGHWPRODSYS$USERS type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_1_HWPROD type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_1_HWPROD type 3 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_2_HWPROD type 3 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(ORA_CLSRD_2_HWPROD) birth(174631049/0) [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmRemoveMember: grock ORA_CLSRD_2_HWPROD, member number 0 (0x7f82b42a8c30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DB+ASM type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock HB+ASM type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG+ASM type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IG+ASMSYS$BACKGROUND type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock MASTER#DISKMON#GROUP type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock VT+ASM type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG+ASM0 type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_DATA type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock OSM_ALL type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DAALL_DB type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock CRSDMAIN type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock EVMDMAIN type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_REDOA type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_REDOB type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DBHWPROD type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DGHWPROD type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IGHWPRODSYS$BACKGROUND type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DGHWPROD0 type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock IGHWPRODALL type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_SBYREDOA type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_SBYREDOB type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmCleanupGrocks: cleaning up grock #CSS_CLSSOMON type 2 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmResumeAllGrocks: Issue RESUME [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.260 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(1) master(1) event(3), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(ORA_CLSRD_1_HWPROD) count(1) master(0) event(3), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(1) master(1) event(3), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 11:05:17.261 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(3), incarn 33, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(1) master(0) event(3), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.262 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(1) master(0) event(3), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmResumeAllGrocks: done [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCMReconfig: setting cmInfo->incarn_clssgmctx to 174631050 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 6, from 4, changes 32 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmEstablishConnections: 1 nodes in cluster incarn 174631050 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 0, changes 11 [ CSSD]2013-05-23 11:05:17.263 [1123510592] >TRACE: clssgmPeerListener: new incarn 174631050. old 174631049 [ CSSD]2013-05-23 11:05:17.263 [1123510592] >TRACE: clssgmPeerListener: connects done (1/1) [ CSSD]2013-05-23 11:05:17.263 [1123510592] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 174631050, changes 12 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmWaitChangeEventValue: ev(ConnectedNodes) changed to 174631050 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmEstablishConnections: (1/1) connected, incarn(174631050) [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 33 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmEstablishMasterNode: MASTER for 174631050 is node(1) birth(174631047) [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 34 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODHWPROD, id 83, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IG+ASMSYS$USERS, id 14, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: _ORA_CRS_MEMBER_prod-rac01, id 1718830, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: crs_version, id 3, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ocr_prod-rac, id 2, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODHWPRODXDB, id 82, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODSYS$USERS, id 80, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ORA_CLSRD_1_HWPROD, id 94, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.263 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ORA_CLSRD_1_HWPROD, id 1718879, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DB+ASM, id 9, grp priv data 0, members 1, msgsize 632 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: HB+ASM, id 12, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG+ASM, id 7, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IG+ASMSYS$BACKGROUND, id 13, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: MASTER#DISKMON#GROUP, id 6, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: VT+ASM, id 11, grp priv data 100, members 1, msgsize 652 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG+ASM0, id 8, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_DATA, id 16, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: OSM_ALL, id 15, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DAALL_DB, id 10, grp priv data 0, members 2, msgsize 576 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: CRSDMAIN, id 4, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: EVMDMAIN, id 5, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_REDOA, id 71, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_REDOB, id 72, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DBHWPROD, id 78, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DGHWPROD, id 76, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODSYS$BACKGROUND, id 79, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DGHWPROD0, id 77, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODALL, id 81, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_SBYREDOA, id 19, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_SBYREDOB, id 73, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCopyoutMemberInfo: #CSS_CLSSOMON, id 1, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 35 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 36 [ CSSD]CLSS-3000: reconfiguration successful, incarnation 174631050 with 1 nodes [ CSSD]CLSS-3001: local node number 1, master node number 1 [ CSSD]2013-05-23 11:05:17.264 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CSS_INTERNAL_NODE_GROUP) count(1) master(1) event(1), incarn 174631050, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.265 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CSS_INTERNAL_NODE_GROUP) count(1) master(1) event(1), incarn 174631050, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:05:17.265 [1249401152] >TRACE: clssgmReconfigThread: completed for reconfig(174631050), with status(1) [ CSSD]2013-05-23 11:05:17.265 [1249401152] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 11 [ CSSD]2013-05-23 11:05:17.265 [3136792288] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 10 [ CSSD]2013-05-23 11:05:17.265 [3136792288] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 12 [ CSSD]2013-05-23 11:05:17.265 [3136792288] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174631050) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(134/0x7f82ac06dfc0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 134 (0x7f82ac06dfc0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmJoinGrock: global grock _ORA_CRS_FAILOVER new client 0x7f82ac06dfc0 with con 0x7f82ac06c8d0, requested num -1 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _ORA_CRS_FAILOVER [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac06cd50/_ORA_CRS_FAILOVER) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_ORA_CRS_FAILOVER) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _ORA_CRS_FAILOVER member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174631050, changes 4 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(135/0x7f82ac06e4b0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 135 (0x7f82ac06e4b0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmJoinGrock: global grock _ORA_CRS_MEMBER_prod-rac02 new client 0x7f82ac06e4b0 with con 0x7f82ac06d600, requested num -1 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _ORA_CRS_MEMBER_prod-rac02 [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac072860/_ORA_CRS_MEMBER_prod-rac02) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_ORA_CRS_MEMBER_prod-rac02) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.285 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _ORA_CRS_MEMBER_prod-rac02 member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(136/0x7f82ac0730f0) [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 136 (0x7f82ac0730f0) [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac0730f0 with con 0x7f82ac0724b0, requested num -1 [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac073260/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.286 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(137/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 137 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.vip new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.vip [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac01.vip) [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 137 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmExitGrock: client 137 (0x7f82ac073af0), grock RES ora.prod-rac01.vip, member 0 [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac01.vip [ CSSD]2013-05-23 11:05:17.287 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.vip, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(138/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 138 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 138 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmExitGrock: client 138 (0x7f82ac073af0), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.288 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(139/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 139 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.gsd new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.gsd [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac01.gsd) [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 139 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmExitGrock: client 139 (0x7f82ac073af0), grock RES ora.prod-rac01.gsd, member 0 [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac01.gsd [ CSSD]2013-05-23 11:05:17.289 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.gsd, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(140/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 140 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 140 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmExitGrock: client 140 (0x7f82ac073af0), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.290 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(141/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 141 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.ons new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.ons [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac01.ons) [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 141 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmExitGrock: client 141 (0x7f82ac073af0), grock RES ora.prod-rac01.ons, member 0 [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac01.ons [ CSSD]2013-05-23 11:05:17.291 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ons, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(142/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 142 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 142 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmExitGrock: client 142 (0x7f82ac073af0), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.292 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(143/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 143 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 143 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmExitGrock: client 143 (0x7f82ac073af0), grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member 0 [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr [ CSSD]2013-05-23 11:05:17.293 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(144/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 144 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 144 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmExitGrock: client 144 (0x7f82ac073af0), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(145/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 145 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.294 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.ASM1.asm new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.ASM1.asm [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac01.ASM1.asm) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.ASM1.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ASM1.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 145 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmExitGrock: client 145 (0x7f82ac073af0), grock RES ora.prod-rac01.ASM1.asm, member 0 [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac01.ASM1.asm [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ASM1.asm, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(146/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 146 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.295 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 146 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmExitGrock: client 146 (0x7f82ac073af0), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(147/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 147 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.db new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.db [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.HWPROD.db) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.db) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.db member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 147 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmExitGrock: client 147 (0x7f82ac073af0), grock RES ora.HWPROD.db, member 0 [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.HWPROD.db [ CSSD]2013-05-23 11:05:17.296 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.db, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(148/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 148 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD1.inst new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD1.inst [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.HWPROD.HWPROD1.inst) [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD1.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD1.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 148 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmExitGrock: client 148 (0x7f82ac073af0), grock RES ora.HWPROD.HWPROD1.inst, member 0 [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.HWPROD.HWPROD1.inst [ CSSD]2013-05-23 11:05:17.297 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD1.inst, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(149/0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 149 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac073af0 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073c60/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 149 (0x7f82ac073af0) [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmExitGrock: client 149 (0x7f82ac073af0), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073f60) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.298 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac073f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.299 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 136 (0x7f82ac0730f0) [ CSSD]2013-05-23 11:05:17.299 [1199044928] >TRACE: clssgmExitGrock: client 136 (0x7f82ac0730f0), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.299 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073560) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.299 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac073560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.306 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.306 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.320 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac077570) allocated [ CSSD]2013-05-23 11:05:17.321 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:17.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac077570 - 1,2,3 [ CSSD]2013-05-23 11:05:17.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0724b0) proc(0x7f82ac077570) pid(2579) version 11:1:1:4 [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(150/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 150 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.vip new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.vip [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac01.vip) [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 150 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmExitGrock: client 150 (0x7f82ac077c10), grock RES ora.prod-rac01.vip, member 0 [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac01.vip [ CSSD]2013-05-23 11:05:17.329 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.vip, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(151/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 151 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 151 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmExitGrock: client 151 (0x7f82ac077c10), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.330 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(152/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 152 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 152 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmExitGrock: client 152 (0x7f82ac077c10), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.331 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(153/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 153 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.gsd new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.gsd [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac01.gsd) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 153 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmExitGrock: client 153 (0x7f82ac077c10), grock RES ora.prod-rac01.gsd, member 0 [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac01.gsd [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.gsd, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(154/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 154 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 154 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmExitGrock: client 154 (0x7f82ac077c10), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(155/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 155 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.346 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 155 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmExitGrock: client 155 (0x7f82ac077c10), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.347 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(156/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 156 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.ons new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.ons [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac01.ons) [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 156 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmExitGrock: client 156 (0x7f82ac077c10), grock RES ora.prod-rac01.ons, member 0 [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac01.ons [ CSSD]2013-05-23 11:05:17.353 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ons, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(157/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 157 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 157 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmExitGrock: client 157 (0x7f82ac077c10), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.354 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(158/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 158 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 158 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmExitGrock: client 158 (0x7f82ac077c10), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.355 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(159/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 159 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 159 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmExitGrock: client 159 (0x7f82ac077c10), grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member 0 [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr [ CSSD]2013-05-23 11:05:17.365 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(160/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 160 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 160 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmExitGrock: client 160 (0x7f82ac077c10), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.366 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(161/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 161 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 161 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmExitGrock: client 161 (0x7f82ac077c10), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:17.367 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(162/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 162 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac01.ASM1.asm new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac01.ASM1.asm [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac01.ASM1.asm) [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac01.ASM1.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ASM1.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 162 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmExitGrock: client 162 (0x7f82ac077c10), grock RES ora.prod-rac01.ASM1.asm, member 0 [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac01.ASM1.asm [ CSSD]2013-05-23 11:05:17.378 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ASM1.asm, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(163/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 163 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 163 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmExitGrock: client 163 (0x7f82ac077c10), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.379 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(164/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 164 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 164 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmExitGrock: client 164 (0x7f82ac077c10), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.380 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(165/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 165 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.db new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.db [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.HWPROD.db) [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.db) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.db member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 165 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmExitGrock: client 165 (0x7f82ac077c10), grock RES ora.HWPROD.db, member 0 [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.HWPROD.db [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.db, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(166/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 166 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD1.inst new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD1.inst [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.HWPROD.HWPROD1.inst) [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD1.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.387 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD1.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 166 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmExitGrock: client 166 (0x7f82ac077c10), grock RES ora.HWPROD.HWPROD1.inst, member 0 [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.HWPROD.HWPROD1.inst [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD1.inst, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(167/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 167 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.388 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 167 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmExitGrock: client 167 (0x7f82ac077c10), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(168/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 168 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac077d80/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.389 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 168 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.390 [1199044928] >TRACE: clssgmExitGrock: client 168 (0x7f82ac077c10), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.390 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.390 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(169/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 169 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac077d80/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(170/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 170 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 170 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmExitGrock: client 170 (0x7f82ac078620), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.400 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(171/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 171 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 171 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmExitGrock: client 171 (0x7f82ac078620), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.413 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(172/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 172 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 172 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmExitGrock: client 172 (0x7f82ac078620), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(173/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 173 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 173 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmExitGrock: client 173 (0x7f82ac078620), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(174/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 174 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 174 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmExitGrock: client 174 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.416 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(175/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 175 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 175 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmExitGrock: client 175 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.417 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 169 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmExitGrock: client 169 (0x7f82ac077c10), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(176/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 176 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac077d80/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.418 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(177/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 177 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 177 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmExitGrock: client 177 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.419 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(178/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 178 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 178 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmExitGrock: client 178 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.431 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(179/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 179 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ASM2.asm new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ASM2.asm) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 179 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmExitGrock: client 179 (0x7f82ac078620), grock RES ora.prod-rac02.ASM2.asm, member 0 [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.ASM2.asm [ CSSD]2013-05-23 11:05:17.432 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(180/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 180 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 180 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmExitGrock: client 180 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(181/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 181 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.HWPROD.HWPROD2.inst new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.HWPROD.HWPROD2.inst) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 181 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmExitGrock: client 181 (0x7f82ac078620), grock RES ora.HWPROD.HWPROD2.inst, member 0 [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.HWPROD.HWPROD2.inst [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 176 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmExitGrock: client 176 (0x7f82ac077c10), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.435 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(182/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 182 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac077c10 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac077d80/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(183/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 183 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.436 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 183 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.437 [1199044928] >TRACE: clssgmExitGrock: client 183 (0x7f82ac078620), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:17.437 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.437 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.448 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(184/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 184 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 184 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmExitGrock: client 184 (0x7f82ac078620), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.449 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(185/0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 185 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac078620 with con 0x7f82ac077320, requested num -1 [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac078790/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.450 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 182 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmExitGrock: client 182 (0x7f82ac077c10), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(186/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 186 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac077c10 with con 0x7f82ac0779c0, requested num -1 [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac077d80/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.451 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(187/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 187 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 187 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmExitGrock: client 187 (0x7f82ac079030), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.452 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(188/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 188 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.469 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 188 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.470 [1199044928] >TRACE: clssgmExitGrock: client 188 (0x7f82ac079030), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.470 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.470 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(189/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 189 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 189 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmExitGrock: client 189 (0x7f82ac079030), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.471 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(190/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 190 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.gsd new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.gsd) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 190 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmExitGrock: client 190 (0x7f82ac079030), grock RES ora.prod-rac02.gsd, member 0 [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.gsd [ CSSD]2013-05-23 11:05:17.472 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 186 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmExitGrock: client 186 (0x7f82ac077c10), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(191/0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 191 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac077c10 with con 0x7f82ac0779c0, requested num -1 [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.473 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac077d80/_CRS_RDB) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(192/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 192 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.474 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 192 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.475 [1199044928] >TRACE: clssgmExitGrock: client 192 (0x7f82ac079030), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.475 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.479 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(193/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 193 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.491 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 193 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.492 [1199044928] >TRACE: clssgmExitGrock: client 193 (0x7f82ac079030), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.492 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.492 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(194/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 194 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 194 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmExitGrock: client 194 (0x7f82ac079030), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.494 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(195/0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 195 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.ons new client 0x7f82ac079030 with con 0x7f82ac077840, requested num -1 [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac0791a0/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.ons) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 195 (0x7f82ac079030) [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmExitGrock: client 195 (0x7f82ac079030), grock RES ora.prod-rac02.ons, member 0 [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0794a0) in global grock RES ora.prod-rac02.ons [ CSSD]2013-05-23 11:05:17.495 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82ac0794a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 191 (0x7f82ac077c10) [ CSSD]2013-05-23 11:05:17.496 [1199044928] >TRACE: clssgmExitGrock: client 191 (0x7f82ac077c10), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:17.496 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078080) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:17.496 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac078080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:17.508 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07cb60) allocated [ CSSD]2013-05-23 11:05:17.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:17.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07cb60 - 1,2,3 [ CSSD]2013-05-23 11:05:17.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0779c0) proc(0x7f82ac07cb60) pid(2590) version 11:1:1:4 [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac07cb60), client(1/0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac0781a0 with con 0x7f82ac07c9c0, requested num -1 [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07d2d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:17.517 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:17.524 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:17.524 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0781a0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:05:17.524 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07d5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:17.524 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac07d5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:18.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:18.322 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac081670) allocated [ CSSD]2013-05-23 11:05:18.323 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:18.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac081670 - 1,2,3 [ CSSD]2013-05-23 11:05:18.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac07d200) proc(0x7f82ac081670) pid(2626) version 11:1:1:4 [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac081670), client(1/0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0781a0 with con 0x7f82ac0814c0, requested num -1 [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac081df0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:18.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:18.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:18.338 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0781a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:05:18.338 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0820f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:18.338 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0820f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:18.349 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac077570 [ CSSD]2013-05-23 11:05:18.349 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac077570) con(0x7f82ac0724b0) skgpid ospid 2579 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:18.382 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:18.541 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac081670 [ CSSD]2013-05-23 11:05:18.541 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac081670) con(0x7f82ac07d200) skgpid ospid 2626 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:18.843 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:05:18.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:18.976 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:19.861 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac074610) allocated [ CSSD]2013-05-23 11:05:19.862 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:19.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac074610 - 1,2,3 [ CSSD]2013-05-23 11:05:19.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0724b0) proc(0x7f82ac074610) pid(2694/2694) version 11:1:1:4 [ CSSD]2013-05-23 11:05:19.869 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac074610), client(1/0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:19.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:19.869 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:19.869 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 65 [ CSSD]2013-05-23 11:05:19.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0781a0) [ CSSD]2013-05-23 11:05:19.893 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0781a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:05:19.893 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0781a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:05:19.893 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 64 [ CSSD]2013-05-23 11:05:19.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac074610 [ CSSD]2013-05-23 11:05:19.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac074610) con(0x7f82ac0724b0) skgpid 2694 ospid 2694 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:20.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:20.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:20.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07cb60 [ CSSD]2013-05-23 11:05:20.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07cb60) con(0x7f82ac0779c0) skgpid ospid 2590 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:20.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 185 (0x7f82ac078620) [ CSSD]2013-05-23 11:05:20.771 [1199044928] >TRACE: clssgmExitGrock: client 185 (0x7f82ac078620), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:20.771 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac078a90) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:20.771 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac078a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.771 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(196/0x7f82ac076c00) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 196 (0x7f82ac076c00) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmJoinGrock: global grock _CRS_RDB new client 0x7f82ac076c00 with con 0x7f82ac0724b0, requested num -1 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock _CRS_RDB [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac076d70/_CRS_RDB) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(_CRS_RDB) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(197/0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 197 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac076a70 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073030/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 197 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmExitGrock: client 197 (0x7f82ac076a70), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:20.772 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073330) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.773 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac073330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.803 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(198/0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 198 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac076a70 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073030/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 198 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmExitGrock: client 198 (0x7f82ac076a70), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073330) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.804 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac073330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(199/0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 199 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.vip new client 0x7f82ac076a70 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073030/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.vip) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 199 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmExitGrock: client 199 (0x7f82ac076a70), grock RES ora.prod-rac02.vip, member 0 [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073330) in global grock RES ora.prod-rac02.vip [ CSSD]2013-05-23 11:05:20.805 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82ac073330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.807 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(200/0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 200 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.807 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac076a70 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:20.807 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.807 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073030/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 200 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmExitGrock: client 200 (0x7f82ac076a70), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073330) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.808 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac073330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmRegisterClient: proc(4/0x7f82b41a3f30), client(201/0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 201 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmJoinGrock: global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr new client 0x7f82ac076a70 with con 0x7f82ac06e270, requested num -1 [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(1) grock (0x7f82ac073030/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Local) node(1) flags 0x12 0x12 [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 201 (0x7f82ac076a70) [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmExitGrock: client 201 (0x7f82ac076a70), grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member 0 [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac073330) in global grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr [ CSSD]2013-05-23 11:05:20.809 [1199044928] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82ac073330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 196 (0x7f82ac076c00) [ CSSD]2013-05-23 11:05:20.810 [1199044928] >TRACE: clssgmExitGrock: client 196 (0x7f82ac076c00), grock _CRS_RDB, member 0 [ CSSD]2013-05-23 11:05:20.810 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077070) in global grock _CRS_RDB [ CSSD]2013-05-23 11:05:20.810 [1199044928] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82ac077070) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 135 (0x7f82ac06e4b0) [ CSSD]2013-05-23 11:05:20.811 [1199044928] >TRACE: clssgmExitGrock: client 135 (0x7f82ac06e4b0), grock _ORA_CRS_MEMBER_prod-rac02, member 0 [ CSSD]2013-05-23 11:05:20.811 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac072b60) in global grock _ORA_CRS_MEMBER_prod-rac02 [ CSSD]2013-05-23 11:05:20.811 [1199044928] >TRACE: clssgmRemoveMember: grock _ORA_CRS_MEMBER_prod-rac02, member number 0 (0x7f82ac072b60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 134 (0x7f82ac06dfc0) [ CSSD]2013-05-23 11:05:20.812 [1199044928] >TRACE: clssgmExitGrock: client 134 (0x7f82ac06dfc0), grock _ORA_CRS_FAILOVER, member 0 [ CSSD]2013-05-23 11:05:20.812 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06d9f0) in global grock _ORA_CRS_FAILOVER [ CSSD]2013-05-23 11:05:20.812 [1199044928] >TRACE: clssgmRemoveMember: grock _ORA_CRS_FAILOVER, member number 0 (0x7f82ac06d9f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:20.812 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:05:22.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0724b0) allocated [ CSSD]2013-05-23 11:05:22.043 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:22.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0724b0 - 1,2,3 [ CSSD]2013-05-23 11:05:22.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac0724b0) pid(2756) version 11:1:1:4 [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac0724b0), client(1/0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac06e580 with con 0x7f82ac06ced0, requested num -1 [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac073c50/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:22.084 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:22.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.085 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06e580), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:05:22.085 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cd50) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:22.085 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac06cd50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac0724b0), client(2/0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac06e580 with con 0x7f82ac06ced0, requested num -1 [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac073c50/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:22.128 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:22.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:22.155 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac06e580) [ CSSD]2013-05-23 11:05:22.155 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac06e580), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:05:22.155 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cd50) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:22.155 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac06cd50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac06cbe0) [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac06cbe0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac06cbe0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06c560 [ CSSD]2013-05-23 11:05:22.218 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06c560) con(0x7f82ac06a1e0) skgpid 2549 ospid 2549 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:22.259 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0724b0 [ CSSD]2013-05-23 11:05:22.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0724b0) con(0x7f82ac06d530) skgpid ospid 2756 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:23.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:23.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:24.099 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cbe0) allocated [ CSSD]2013-05-23 11:05:24.100 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:24.100 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cbe0 - 1,2,3 [ CSSD]2013-05-23 11:05:24.100 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cbe0) pid(2806) version 11:1:1:4 [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cbe0), client(1/0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac069b10 with con 0x7f82ac06d600, requested num -1 [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:24.133 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:24.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.134 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069b10), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:05:24.134 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06ce90) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:24.134 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac06ce90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cbe0), client(2/0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac069b10 with con 0x7f82ac06d600, requested num -1 [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:24.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:24.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:24.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:24.183 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac069b10), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:05:24.183 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06ce90) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:24.183 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac06ce90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:24.290 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cbe0 [ CSSD]2013-05-23 11:05:24.290 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cbe0) con(0x7f82ac06c940) skgpid ospid 2806 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:25.322 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cbe0) allocated [ CSSD]2013-05-23 11:05:25.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:25.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cbe0 - 1,2,3 [ CSSD]2013-05-23 11:05:25.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cbe0) pid(2849) version 11:1:1:4 [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cbe0), client(1/0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac069b10 with con 0x7f82ac06d600, requested num -1 [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:25.365 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:25.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.366 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069b10), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:05:25.366 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06ce90) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:25.366 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac06ce90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cbe0), client(2/0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac069b10 with con 0x7f82ac06d600, requested num -1 [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:25.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:25.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac069b10) [ CSSD]2013-05-23 11:05:25.440 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac069b10), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:05:25.440 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06ce90) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:25.440 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac06ce90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:25.527 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cbe0 [ CSSD]2013-05-23 11:05:25.527 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cbe0) con(0x7f82ac06c940) skgpid ospid 2849 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:26.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:28.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:28.873 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:05:28.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:28.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:30.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:32.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:32.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cef0) allocated [ CSSD]2013-05-23 11:05:32.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:32.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cef0 - 1,2,3 [ CSSD]2013-05-23 11:05:32.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cef0) pid(2938) version 11:1:1:4 [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cef0), client(1/0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82ac06d600 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:32.793 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:32.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.794 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06d600), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:05:32.794 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cbe0) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:05:32.794 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82ac06cbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cef0), client(2/0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82ac06d600 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:32.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:32.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:32.864 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82ac06d600), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:05:32.864 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cbe0) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:05:32.864 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82ac06cbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:32.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cef0 [ CSSD]2013-05-23 11:05:32.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cef0) con(0x7f82ac06c940) skgpid ospid 2938 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:33.572 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cef0) allocated [ CSSD]2013-05-23 11:05:33.573 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:33.573 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cef0 - 1,2,3 [ CSSD]2013-05-23 11:05:33.573 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cef0) pid(2990) version 11:1:1:4 [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac06cef0), client(1/0x7f82ac06d600) [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06d600 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:33.578 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:33.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:33.583 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06d600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:05:33.583 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:33.583 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06cbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:33.786 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cef0 [ CSSD]2013-05-23 11:05:33.786 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cef0) con(0x7f82ac06c940) skgpid ospid 2990 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:33.982 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:33.982 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:34.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 62 [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3540 [ CSSD]2013-05-23 11:05:35.303 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3540) con(0x7f82b42ccc30) skgpid 32666 ospid 32666 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:35.809 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cef0) allocated [ CSSD]2013-05-23 11:05:35.810 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:35.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cef0 - 1,2,3 [ CSSD]2013-05-23 11:05:35.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cef0) pid(3045) version 11:1:1:4 [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82ac06cef0), client(1/0x7f82ac06d600) [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac06d600 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:35.816 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:35.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:35.822 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06d600), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:05:35.822 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:35.822 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06cbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:36.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cef0 [ CSSD]2013-05-23 11:05:36.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cef0) con(0x7f82ac06c940) skgpid ospid 3045 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:36.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:38.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:38.884 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:05:38.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:38.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:40.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:42.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:43.986 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:43.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:44.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:46.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:48.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:48.824 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cef0) allocated [ CSSD]2013-05-23 11:05:48.825 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:48.826 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cef0 - 1,2,3 [ CSSD]2013-05-23 11:05:48.826 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac06cef0) pid(3182) version 11:1:1:4 [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82ac06cef0), client(1/0x7f82ac06d600) [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06d600 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac076e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:48.831 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:48.836 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06d600) [ CSSD]2013-05-23 11:05:48.836 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06d600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:05:48.836 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06cbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:48.836 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06cbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:48.861 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac074560) allocated [ CSSD]2013-05-23 11:05:48.861 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:48.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac074560 - 1,2,3 [ CSSD]2013-05-23 11:05:48.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dfe0) proc(0x7f82ac074560) pid(3187/3187) version 11:1:1:4 [ CSSD]2013-05-23 11:05:48.867 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac074560), client(1/0x7f82ac077400) [ CSSD]2013-05-23 11:05:48.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac077400) [ CSSD]2013-05-23 11:05:48.867 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:48.867 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 63 [ CSSD]2013-05-23 11:05:48.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:05:48.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:48.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:49.038 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cef0 [ CSSD]2013-05-23 11:05:49.038 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cef0) con(0x7f82ac06c940) skgpid ospid 3182 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:49.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0724b0) allocated [ CSSD]2013-05-23 11:05:49.579 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:49.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0724b0 - 1,2,3 [ CSSD]2013-05-23 11:05:49.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c940) proc(0x7f82ac0724b0) pid(3235/3235) version 11:1:1:4 [ CSSD]2013-05-23 11:05:49.594 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac0724b0), client(1/0x7f82ac06c060) [ CSSD]2013-05-23 11:05:49.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac06c060) [ CSSD]2013-05-23 11:05:49.595 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:49.595 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:05:50.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:51.061 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d9e0) allocated [ CSSD]2013-05-23 11:05:51.062 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:05:51.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d9e0 - 1,2,3 [ CSSD]2013-05-23 11:05:51.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06bfb0) proc(0x7f82ac07d9e0) pid(3252) version 11:1:1:4 [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac07d9e0), client(1/0x7f82ac07e090) [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac07e090) [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac07e090 with con 0x7f82ac07d7e0, requested num -1 [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07e200/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:51.070 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:51.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac07e090) [ CSSD]2013-05-23 11:05:51.078 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac07e090), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:05:51.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07e500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:05:51.078 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac07e500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:51.280 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d9e0 [ CSSD]2013-05-23 11:05:51.280 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d9e0) con(0x7f82ac06bfb0) skgpid ospid 3252 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:52.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:52.989 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:52.989 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:05:53.198 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d9e0) allocated [ CSSD]2013-05-23 11:05:53.199 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:53.200 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d9e0 - 1,2,3 [ CSSD]2013-05-23 11:05:53.200 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06bfb0) proc(0x7f82ac07d9e0) pid(3305) version 11:1:1:4 [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac07d9e0), client(1/0x7f82ac07e090) [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac07e090) [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac07e090 with con 0x7f82ac07d7e0, requested num -1 [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07e200/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:05:53.204 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:05:53.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac07e090) [ CSSD]2013-05-23 11:05:53.209 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac07e090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:05:53.209 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07e500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:05:53.209 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac07e500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:05:53.411 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d9e0 [ CSSD]2013-05-23 11:05:53.411 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d9e0) con(0x7f82ac06bfb0) skgpid ospid 3305 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:05:54.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:54.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d9e0) allocated [ CSSD]2013-05-23 11:05:54.943 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:54.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d9e0 - 1,2,3 [ CSSD]2013-05-23 11:05:54.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06bfb0) proc(0x7f82ac07d9e0) pid(2553/2553) version 11:1:1:4 [ CSSD]2013-05-23 11:05:54.948 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac07d9e0), client(1/0x7f82ac07d8b0) [ CSSD]2013-05-23 11:05:54.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac07d8b0) [ CSSD]2013-05-23 11:05:54.948 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:54.948 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 65 [ CSSD]2013-05-23 11:05:55.096 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac079510) allocated [ CSSD]2013-05-23 11:05:55.096 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:05:55.097 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac079510 - 1,2,3 [ CSSD]2013-05-23 11:05:55.097 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac07e480) proc(0x7f82ac079510) pid(2551/2551) version 11:1:1:4 [ CSSD]2013-05-23 11:05:55.101 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac079510), client(1/0x7f82ac079b00) [ CSSD]2013-05-23 11:05:55.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac079b00) [ CSSD]2013-05-23 11:05:55.101 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:05:55.102 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 66 [ CSSD]2013-05-23 11:05:56.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:57.991 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:05:57.991 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:05:58.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:05:58.914 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:00.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:02.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:02.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:02.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:04.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:04.086 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:04.086 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:04.086 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3390) version 11:1:1:4 [ CSSD]2013-05-23 11:06:04.092 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:04.092 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:04.092 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0835e0 with con 0x7f82ac082da0, requested num -1 [ CSSD]2013-05-23 11:06:04.092 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:04.092 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac083750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:06:04.093 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:04.093 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:04.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:04.100 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0835e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:06:04.100 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac083a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:04.100 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac083a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:04.302 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:06:04.302 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid ospid 3390 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:04.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:06.313 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:06.314 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:06.315 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:06.315 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3443) version 11:1:1:4 [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac0835e0 with con 0x7f82ac082da0, requested num -1 [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac083750/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:06.331 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:06.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0835e0) [ CSSD]2013-05-23 11:06:06.338 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0835e0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:06:06.338 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac083a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:06.338 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac083a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:06.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:06.541 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:06:06.541 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid ospid 3443 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:07.995 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:07.995 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:08.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:08.924 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:10.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:11.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:11.548 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:11.549 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:11.549 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3521/3521) version 11:1:1:4 [ CSSD]2013-05-23 11:06:11.555 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.555 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:11.555 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:06:11.612 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid 3521 ospid 3521 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:11.770 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:11.771 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:11.771 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:11.771 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3524/3524) version 11:1:1:4 [ CSSD]2013-05-23 11:06:11.776 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.776 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:11.776 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:06:11.824 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid 3524 ospid 3524 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:12.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:12.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:12.997 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:14.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:15.532 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:15.533 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:15.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:15.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3558/3558) version 11:1:1:4 [ CSSD]2013-05-23 11:06:15.549 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac083560) [ CSSD]2013-05-23 11:06:15.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:15.549 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:15.549 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:06:15.562 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid 3558 ospid 3558 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:15.695 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac082f30) allocated [ CSSD]2013-05-23 11:06:15.696 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:15.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac082f30 - 1,2,3 [ CSSD]2013-05-23 11:06:15.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac079990) proc(0x7f82ac082f30) pid(3561/3561) version 11:1:1:4 [ CSSD]2013-05-23 11:06:15.705 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac082f30), client(1/0x7f82ac083560) [ CSSD]2013-05-23 11:06:15.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:06:15.705 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:15.705 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:06:16.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:17.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:17.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:18.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:18.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2699110) [ CSSD]2013-05-23 11:06:18.717 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2699110), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:06:18.717 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2699110), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:06:18.717 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 50 [ CSSD]2013-05-23 11:06:18.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268c340) [ CSSD]2013-05-23 11:06:18.720 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268c340), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:06:18.720 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268c340), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:06:18.720 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:06:18.721 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f630 [ CSSD]2013-05-23 11:06:18.721 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f630) con(0x266f260) skgpid 30023 ospid 30023 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:18.968 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:19.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac077400) [ CSSD]2013-05-23 11:06:19.015 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac077400), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:06:19.015 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac077400), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:06:19.015 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 65 [ CSSD]2013-05-23 11:06:19.016 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac074560 [ CSSD]2013-05-23 11:06:19.016 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac074560) con(0x7f82ac06dfe0) skgpid 3187 ospid 3187 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:19.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0740a0) allocated [ CSSD]2013-05-23 11:06:19.334 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:19.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0740a0 - 1,2,3 [ CSSD]2013-05-23 11:06:19.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d600) proc(0x7f82ac0740a0) pid(3593) version 11:1:1:4 [ CSSD]2013-05-23 11:06:19.340 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac0740a0), client(1/0x7f82ac073f70) [ CSSD]2013-05-23 11:06:19.340 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac073f70) [ CSSD]2013-05-23 11:06:19.340 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac073f70 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:06:19.340 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:19.340 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac083ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:06:19.341 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:19.341 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:19.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac073f70) [ CSSD]2013-05-23 11:06:19.346 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac073f70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:06:19.346 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac083dc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:19.346 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac083dc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:19.549 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0740a0 [ CSSD]2013-05-23 11:06:19.549 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0740a0) con(0x7f82ac06d600) skgpid ospid 3593 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:20.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:21.581 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac074040) allocated [ CSSD]2013-05-23 11:06:21.582 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:21.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac074040 - 1,2,3 [ CSSD]2013-05-23 11:06:21.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d600) proc(0x7f82ac074040) pid(3647) version 11:1:1:4 [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac074040), client(1/0x7f82ac073f70) [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac073f70) [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac073f70 with con 0x7f82ac06dfe0, requested num -1 [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac083ac0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:21.588 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:21.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac073f70) [ CSSD]2013-05-23 11:06:21.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac073f70), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:06:21.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac074390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:21.595 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac074390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:21.797 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac074040 [ CSSD]2013-05-23 11:06:21.797 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac074040) con(0x7f82ac06d600) skgpid ospid 3647 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:22.420 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac074040) allocated [ CSSD]2013-05-23 11:06:22.421 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:22.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac074040 - 1,2,3 [ CSSD]2013-05-23 11:06:22.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dfe0) proc(0x7f82ac074040) pid(3583/3583) version 11:1:1:4 [ CSSD]2013-05-23 11:06:22.427 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac074040), client(1/0x7f82ac073de0) [ CSSD]2013-05-23 11:06:22.427 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac073de0) [ CSSD]2013-05-23 11:06:22.427 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:22.427 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 66 [ CSSD]2013-05-23 11:06:22.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:23.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:23.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:24.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:26.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:28.002 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:28.002 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:28.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:28.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:30.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:32.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:33.004 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:33.004 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:34.580 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0860a0) allocated [ CSSD]2013-05-23 11:06:34.581 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:34.581 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0860a0 - 1,2,3 [ CSSD]2013-05-23 11:06:34.581 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d00) proc(0x7f82ac0860a0) pid(3784) version 11:1:1:4 [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac0860a0), client(1/0x7f82ac086750) [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086750) [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086750 with con 0x7f82ac085ef0, requested num -1 [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0868c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:34.588 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:34.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086750) [ CSSD]2013-05-23 11:06:34.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086750), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:06:34.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086bc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:34.596 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086bc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:34.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0860a0 [ CSSD]2013-05-23 11:06:34.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0860a0) con(0x7f82ac083d00) skgpid ospid 3784 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:34.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:36.831 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0860a0) allocated [ CSSD]2013-05-23 11:06:36.832 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:36.833 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0860a0 - 1,2,3 [ CSSD]2013-05-23 11:06:36.833 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d00) proc(0x7f82ac0860a0) pid(3850) version 11:1:1:4 [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac0860a0), client(1/0x7f82ac086750) [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086750) [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac086750 with con 0x7f82ac085ef0, requested num -1 [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0868c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:36.850 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:36.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086750) [ CSSD]2013-05-23 11:06:36.857 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086750), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:06:36.857 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086bc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:36.857 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac086bc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:36.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:37.060 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0860a0 [ CSSD]2013-05-23 11:06:37.060 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0860a0) con(0x7f82ac083d00) skgpid ospid 3850 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:38.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:38.005 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:38.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:39.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:40.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:42.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:43.007 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:43.007 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:44.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:47.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:48.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:48.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:48.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0860a0) allocated [ CSSD]2013-05-23 11:06:48.917 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:48.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0860a0 - 1,2,3 [ CSSD]2013-05-23 11:06:48.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d00) proc(0x7f82ac0860a0) pid(3981/3981) version 11:1:1:4 [ CSSD]2013-05-23 11:06:48.925 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac0860a0), client(1/0x7f82ac0865d0) [ CSSD]2013-05-23 11:06:48.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0865d0) [ CSSD]2013-05-23 11:06:48.925 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:06:48.925 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:06:49.022 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:49.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:49.834 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b050) allocated [ CSSD]2013-05-23 11:06:49.835 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:49.835 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b050 - 1,2,3 [ CSSD]2013-05-23 11:06:49.835 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086be0) proc(0x7f82ac08b050) pid(3993) version 11:1:1:4 [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b050), client(1/0x7f82ac08b700) [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b700) [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac08b700 with con 0x7f82ac08aea0, requested num -1 [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b870/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:49.841 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:49.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b700) [ CSSD]2013-05-23 11:06:49.848 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b700), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:06:49.848 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:49.848 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac08bb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:50.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b050 [ CSSD]2013-05-23 11:06:50.051 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b050) con(0x7f82ac086be0) skgpid ospid 3993 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:51.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:52.095 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:06:52.096 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:06:52.097 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:06:52.097 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4050) version 11:1:1:4 [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b160), client(1/0x7f82ac08b740) [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac08b740 with con 0x7f82ac08afd0, requested num -1 [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b8b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:52.103 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:52.110 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:06:52.110 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b740), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:06:52.110 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:06:52.110 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac08bbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:52.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:06:52.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4050 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:53.011 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:53.011 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:53.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:53.453 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:06:53.454 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:06:53.455 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:06:53.455 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4103) version 11:1:1:4 [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b160), client(1/0x7f82ac08b740) [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac08b740 with con 0x7f82ac08afb0, requested num -1 [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b8b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:06:53.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:06:53.478 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:06:53.478 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b740), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:06:53.478 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:06:53.478 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac08bbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:06:53.681 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:06:53.681 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4103 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:06:55.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:57.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:06:58.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:06:58.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:06:59.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:06:59.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:01.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:01.205 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:07:01.206 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:01.206 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:07:01.206 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4164) version 11:1:1:4 [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b160), client(1/0x7f82ac08b740) [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac08b740 with con 0x7f82ac08afb0, requested num -1 [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b8b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:01.213 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:01.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:01.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b740), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:01.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:01.220 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac08bbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:01.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:07:01.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4164 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:03.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:03.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:03.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:05.086 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:07:05.086 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:05.087 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:07:05.087 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4219) version 11:1:1:4 [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b160), client(1/0x7f82ac08b740) [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac08b740 with con 0x7f82ac08afd0, requested num -1 [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b8b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:05.094 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:05.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:05.102 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b740), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:05.102 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:05.102 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac08bbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:05.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:05.304 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:07:05.304 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4219 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:07.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:07.347 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:07:07.348 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:07.349 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:07:07.349 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4272) version 11:1:1:4 [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac08b160), client(1/0x7f82ac08b740) [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac08b740 with con 0x7f82ac08afb0, requested num -1 [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac08b8b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:07.356 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:07.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac08b740) [ CSSD]2013-05-23 11:07:07.363 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac08b740), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:07:07.363 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac08bbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:07.363 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac08bbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:07.565 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:07:07.565 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4272 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:08.017 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:08.017 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:09.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:09.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:11.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:11.785 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:07:11.786 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:11.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:07:11.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4382) version 11:1:1:4 [ CSSD]2013-05-23 11:07:13.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:13.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:13.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:15.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:17.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:17.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:07:17.347 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4382 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:17.772 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac08b160) allocated [ CSSD]2013-05-23 11:07:17.773 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:17.773 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac08b160 - 1,2,3 [ CSSD]2013-05-23 11:07:17.773 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086740) proc(0x7f82ac08b160) pid(4737) version 11:1:1:4 [ CSSD]2013-05-23 11:07:18.021 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:18.021 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:18.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac08b160 [ CSSD]2013-05-23 11:07:18.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac08b160) con(0x7f82ac086740) skgpid ospid 4737 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:19.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0865d0) [ CSSD]2013-05-23 11:07:19.023 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0865d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:19.023 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0865d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:19.023 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:07:19.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0860a0 [ CSSD]2013-05-23 11:07:19.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0860a0) con(0x7f82ac083d00) skgpid 3981 ospid 3981 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:19.063 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:19.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:20.338 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac086100) allocated [ CSSD]2013-05-23 11:07:20.338 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:20.339 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac086100 - 1,2,3 [ CSSD]2013-05-23 11:07:20.339 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d60) proc(0x7f82ac086100) pid(4859) version 11:1:1:4 [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac086100), client(1/0x7f82ac086830) [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086830 with con 0x7f82ac085f50, requested num -1 [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0869a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:20.345 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:20.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:20.352 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:20.352 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:20.352 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:20.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac086100 [ CSSD]2013-05-23 11:07:20.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac086100) con(0x7f82ac083d60) skgpid ospid 4859 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:21.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:22.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:22.023 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:07:22.597 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac086100) allocated [ CSSD]2013-05-23 11:07:22.598 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:22.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac086100 - 1,2,3 [ CSSD]2013-05-23 11:07:22.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d60) proc(0x7f82ac086100) pid(4928) version 11:1:1:4 [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac086100), client(1/0x7f82ac0868d0) [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0868d0) [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac0868d0 with con 0x7f82ac085f50, requested num -1 [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac086a40/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:22.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:22.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0868d0) [ CSSD]2013-05-23 11:07:22.613 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0868d0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:07:22.613 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086d40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:22.613 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac086d40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:22.715 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac087fe0) allocated [ CSSD]2013-05-23 11:07:22.716 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:22.716 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac087fe0 - 1,2,3 [ CSSD]2013-05-23 11:07:22.716 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac086860) proc(0x7f82ac087fe0) pid(4969/4969) version 11:1:1:4 [ CSSD]2013-05-23 11:07:22.733 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82ac087fe0), client(1/0x7f82ac08b280) [ CSSD]2013-05-23 11:07:22.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac08b280) [ CSSD]2013-05-23 11:07:22.733 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:07:22.733 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:07:22.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac08b280) [ CSSD]2013-05-23 11:07:22.750 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac08b280), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:22.750 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac08b280), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:22.750 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:07:22.751 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac087fe0 [ CSSD]2013-05-23 11:07:22.751 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac087fe0) con(0x7f82ac086860) skgpid 4969 ospid 4969 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:22.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac086100 [ CSSD]2013-05-23 11:07:22.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac086100) con(0x7f82ac083d60) skgpid ospid 4928 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:23.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:25.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:27.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:27.025 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:27.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:29.083 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:29.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:30.702 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac086180) allocated [ CSSD]2013-05-23 11:07:30.702 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:30.703 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac086180 - 1,2,3 [ CSSD]2013-05-23 11:07:30.703 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d60) proc(0x7f82ac086180) pid(5091) version 11:1:1:4 [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac086180), client(1/0x7f82ac086890) [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086890) [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086890 with con 0x7f82ac085f70, requested num -1 [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac086a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:30.710 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:30.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086890) [ CSSD]2013-05-23 11:07:30.718 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086890), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:30.718 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:30.718 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:30.921 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac086180 [ CSSD]2013-05-23 11:07:30.921 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac086180) con(0x7f82ac083d60) skgpid ospid 5091 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:31.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:32.027 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:32.027 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:33.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:35.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:35.589 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac086100) allocated [ CSSD]2013-05-23 11:07:35.590 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:35.590 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac086100 - 1,2,3 [ CSSD]2013-05-23 11:07:35.590 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d60) proc(0x7f82ac086100) pid(5331) version 11:1:1:4 [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac086100), client(1/0x7f82ac086830) [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086830 with con 0x7f82ac085f50, requested num -1 [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0869a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:35.597 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:35.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:35.605 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:35.605 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:35.605 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:35.807 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac086100 [ CSSD]2013-05-23 11:07:35.807 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac086100) con(0x7f82ac083d60) skgpid ospid 5331 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:37.028 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:37.028 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:37.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:37.852 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac086100) allocated [ CSSD]2013-05-23 11:07:37.852 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:37.853 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac086100 - 1,2,3 [ CSSD]2013-05-23 11:07:37.853 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac083d60) proc(0x7f82ac086100) pid(5393) version 11:1:1:4 [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82ac086100), client(1/0x7f82ac086830) [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac086830 with con 0x7f82ac085f50, requested num -1 [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0869a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:37.870 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:37.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086830) [ CSSD]2013-05-23 11:07:37.878 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086830), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:07:37.878 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:37.878 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac086ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:38.080 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac086100 [ CSSD]2013-05-23 11:07:38.080 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac086100) con(0x7f82ac083d60) skgpid ospid 5393 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:39.100 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:39.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:41.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:42.031 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:42.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:43.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:43.853 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26505e0) [ CSSD]2013-05-23 11:07:43.853 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26505e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:07:43.853 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26505e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.853 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 49 [ CSSD]2013-05-23 11:07:43.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2681030) [ CSSD]2013-05-23 11:07:43.856 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2681030), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:07:43.856 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2681030), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.856 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 48 [ CSSD]2013-05-23 11:07:43.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:43.861 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac00ede0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:07:43.861 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac00ede0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.861 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 47 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac023a00) [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac023a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac023a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 65 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0274a0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26802a0) [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26802a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26802a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 64 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0274a0) con(0x7f82ac020310) skgpid 27274 ospid 27274 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dec00 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dec00) con(0x26ce3f0) skgpid 31148 ospid 31148 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2680b90) [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2680b90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2680b90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:43.865 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:07:43.866 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cfc10 [ CSSD]2013-05-23 11:07:43.866 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cfc10) con(0x2678970) skgpid 31150 ospid 31150 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:45.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:45.764 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01da90) allocated [ CSSD]2013-05-23 11:07:45.765 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:45.766 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01da90 - 1,2,3 [ CSSD]2013-05-23 11:07:45.766 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac01da90) pid(5514/5514) version 11:1:1:4 [ CSSD]2013-05-23 11:07:45.783 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac01da90), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:45.783 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:45.783 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:07:45.783 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01da90 [ CSSD]2013-05-23 11:07:45.917 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01da90) con(0x7f82ac020310) skgpid 5514 ospid 5514 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:47.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:47.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:47.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:48.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01da90) allocated [ CSSD]2013-05-23 11:07:48.961 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:48.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01da90 - 1,2,3 [ CSSD]2013-05-23 11:07:48.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac020310) proc(0x7f82ac01da90) pid(5541/5541) version 11:1:1:4 [ CSSD]2013-05-23 11:07:48.978 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82ac01da90), client(1/0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:48.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:07:48.978 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:07:48.978 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:07:49.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:49.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:50.854 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac085d90) allocated [ CSSD]2013-05-23 11:07:50.855 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:50.855 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac085d90 - 1,2,3 [ CSSD]2013-05-23 11:07:50.855 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01f620) proc(0x7f82ac085d90) pid(5561) version 11:1:1:4 [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac085d90), client(1/0x7f82ac086490) [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086490 with con 0x7f82ac085bf0, requested num -1 [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac086600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:50.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:50.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:50.869 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:50.869 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:50.869 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:51.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac085d90 [ CSSD]2013-05-23 11:07:51.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac085d90) con(0x7f82ac01f620) skgpid ospid 5561 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:51.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:52.034 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:52.034 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:53.115 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac085d90) allocated [ CSSD]2013-05-23 11:07:53.116 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:07:53.116 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac085d90 - 1,2,3 [ CSSD]2013-05-23 11:07:53.116 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01f620) proc(0x7f82ac085d90) pid(5629) version 11:1:1:4 [ CSSD]2013-05-23 11:07:53.123 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac085d90), client(1/0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.123 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82ac086490 with con 0x7f82ac085bf0, requested num -1 [ CSSD]2013-05-23 11:07:53.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:53.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac086600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:07:53.124 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:53.124 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:53.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.131 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086490), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:07:53.131 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:07:53.131 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac086900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:53.334 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac085d90 [ CSSD]2013-05-23 11:07:53.334 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac085d90) con(0x7f82ac01f620) skgpid ospid 5629 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:53.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:53.728 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac085d90) allocated [ CSSD]2013-05-23 11:07:53.729 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:53.730 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac085d90 - 1,2,3 [ CSSD]2013-05-23 11:07:53.730 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01f620) proc(0x7f82ac085d90) pid(5676) version 11:1:1:4 [ CSSD]2013-05-23 11:07:53.736 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac085d90), client(1/0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.736 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.736 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac086490 with con 0x7f82ac085bf0, requested num -1 [ CSSD]2013-05-23 11:07:53.736 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:53.736 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac086600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:07:53.737 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:07:53.737 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:07:53.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac086490) [ CSSD]2013-05-23 11:07:53.744 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac086490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:07:53.744 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac086900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:07:53.744 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac086900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:07:53.817 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac087f50) allocated [ CSSD]2013-05-23 11:07:53.818 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:07:53.819 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac087f50 - 1,2,3 [ CSSD]2013-05-23 11:07:53.819 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0864b0) proc(0x7f82ac087f50) pid(5684/5684) version 11:1:1:4 [ CSSD]2013-05-23 11:07:53.825 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac087f50), client(1/0x7f82ac08af70) [ CSSD]2013-05-23 11:07:53.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac08af70) [ CSSD]2013-05-23 11:07:53.825 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:07:53.825 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 65 [ CSSD]2013-05-23 11:07:53.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac08af70) [ CSSD]2013-05-23 11:07:53.897 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac08af70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:07:53.898 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac08af70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:07:53.898 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 64 [ CSSD]2013-05-23 11:07:53.898 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac087f50 [ CSSD]2013-05-23 11:07:53.898 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac087f50) con(0x7f82ac0864b0) skgpid 5684 ospid 5684 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:53.947 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac085d90 [ CSSD]2013-05-23 11:07:53.947 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac085d90) con(0x7f82ac01f620) skgpid ospid 5676 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:07:55.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:57.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:07:57.037 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:07:57.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:07:59.126 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:07:59.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:00.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac085df0) allocated [ CSSD]2013-05-23 11:08:00.991 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:00.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac085df0 - 1,2,3 [ CSSD]2013-05-23 11:08:00.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01f620) proc(0x7f82ac085df0) pid(5621/5621) version 11:1:1:4 [ CSSD]2013-05-23 11:08:00.997 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac085df0), client(1/0x7f82ac086370) [ CSSD]2013-05-23 11:08:00.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac086370) [ CSSD]2013-05-23 11:08:00.997 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:08:00.997 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 65 [ CSSD]2013-05-23 11:08:01.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:02.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:02.038 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:03.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:03.734 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0880e0) allocated [ CSSD]2013-05-23 11:08:03.735 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:03.735 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0880e0 - 1,2,3 [ CSSD]2013-05-23 11:08:03.735 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0864e0) proc(0x7f82ac0880e0) pid(5618/5618) version 11:1:1:4 [ CSSD]2013-05-23 11:08:03.752 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82ac0880e0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:08:03.752 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:08:03.752 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:08:03.752 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 66 [ CSSD]2013-05-23 11:08:05.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:06.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:08:06.093 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:06.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:08:06.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(5809) version 11:1:1:4 [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:06.108 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:06.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:06.113 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:08:06.113 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:06.113 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:06.316 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:08:06.316 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 5809 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:06.697 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82ac085df0), client(2/0x7f82b4204870) [ CSSD]2013-05-23 11:08:06.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 11:08:06.697 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:08:06.697 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:08:07.040 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:07.040 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:07.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:08.368 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:08:08.369 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:08.370 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:08:08.370 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(5863) version 11:1:1:4 [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:08.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:08.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:08:08.392 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:08:08.392 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:08.392 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:08.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:08:08.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 5863 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:09.139 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:08:09.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:11.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:12.042 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:12.042 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:13.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:15.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:17.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:17.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:17.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:19.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:08:19.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:08:19.229 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:19.230 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:08:19.230 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(5999) version 11:1:1:4 [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b00d0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:19.238 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:19.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:08:19.245 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:08:19.245 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4286740) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:08:19.245 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b4286740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:19.351 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 11:08:19.353 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:19.353 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 11:08:19.353 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42830a0) pid(6004) version 11:1:1:4 [ CSSD]2013-05-23 11:08:19.369 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:08:19.371 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:08:19.373 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:08:19.374 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 11:08:19.374 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b4257120) skgpid ospid 6004 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:19.447 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:08:19.447 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 5999 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:19.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00ede0) [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00ede0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 65 [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01da90 [ CSSD]2013-05-23 11:08:20.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01da90) con(0x7f82ac020310) skgpid 5541 ospid 5541 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:21.352 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:08:21.353 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:21.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:08:21.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(6039) version 11:1:1:4 [ CSSD]2013-05-23 11:08:21.359 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:08:21.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:08:21.359 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:08:21.359 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:21.359 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:08:21.360 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:21.360 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:21.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:08:21.366 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:08:21.366 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:21.366 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:21.569 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:08:21.569 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 6039 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:21.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:22.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:22.046 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:23.624 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:08:23.625 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:23.625 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:08:23.625 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(6130) version 11:1:1:4 [ CSSD]2013-05-23 11:08:23.631 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:23.632 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:23.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:08:23.639 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:08:23.639 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:23.639 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:23.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:23.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:08:23.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 6130 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:25.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:27.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:27.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:27.656 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:08:27.657 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:27.657 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:08:27.657 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(6128/6128) version 11:1:1:4 [ CSSD]2013-05-23 11:08:27.673 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:08:27.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:08:27.673 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:08:27.673 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 66 [ CSSD]2013-05-23 11:08:27.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:29.166 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:08:29.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:31.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:32.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:32.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:32.421 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b4207a80), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 11:08:32.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:08:32.421 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:08:32.421 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:08:33.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:35.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:36.604 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:08:36.604 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:36.605 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:08:36.605 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c5f40) pid(6290) version 11:1:1:4 [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42c5f40), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:36.611 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:36.618 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:08:36.618 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:08:36.618 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:36.618 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:36.820 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:08:36.820 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42a29f0) skgpid ospid 6290 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:37.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:37.052 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:37.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:38.883 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:08:38.883 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:38.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:08:38.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42833d0) pid(6345) version 11:1:1:4 [ CSSD]2013-05-23 11:08:38.900 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42833d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:08:38.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:38.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41edd50 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 11:08:38.901 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:38.901 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:08:38.901 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:38.901 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:38.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:38.908 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:08:38.908 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:38.908 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:39.111 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:08:39.111 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42a29f0) skgpid ospid 6345 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:39.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:08:39.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:41.455 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:08:41.456 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:41.457 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:08:41.457 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a3ea0) pid(6416) version 11:1:1:4 [ CSSD]2013-05-23 11:08:41.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:42.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:42.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:42.152 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:08:42.152 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42a29f0) skgpid ospid 6416 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:43.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:46.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:46.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:46.056 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:08:46.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac083560) [ CSSD]2013-05-23 11:08:46.631 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:46.631 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac083560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:46.631 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 65 [ CSSD]2013-05-23 11:08:46.632 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac082f30 [ CSSD]2013-05-23 11:08:46.632 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac082f30) con(0x7f82ac079990) skgpid 3561 ospid 3561 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:48.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ea090) [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ea090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ea090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 64 [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6150 [ CSSD]2013-05-23 11:08:48.743 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6150) con(0x26e9340) skgpid 31812 ospid 31812 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac01f880) [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac01f880), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac01f880), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008660 [ CSSD]2013-05-23 11:08:48.744 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008660) con(0x7f82ac00f010) skgpid 31810 ospid 31810 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:48.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac021d90) [ CSSD]2013-05-23 11:08:48.746 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac021d90), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:08:48.746 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac021d90), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.746 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 48 [ CSSD]2013-05-23 11:08:48.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2678360) [ CSSD]2013-05-23 11:08:48.749 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2678360), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:08:48.749 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2678360), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.749 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 47 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266eb60) [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266eb60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266eb60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 62 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmDeadProc: proc 0x26509b0 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26509b0) con(0x26a6570) skgpid 30025 ospid 30025 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eedb0) [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eedb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eedb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 61 [ CSSD]2013-05-23 11:08:48.757 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee370 [ CSSD]2013-05-23 11:08:48.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee370) con(0x26e9f10) skgpid 31816 ospid 31816 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:49.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 11:08:49.156 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:49.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 11:08:49.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42583a0) pid(6646/6646) version 11:1:1:4 [ CSSD]2013-05-23 11:08:49.163 [1199044928] >TRACE: clssgmRegisterClient: proc(92/0x7f82b42583a0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:08:49.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:08:49.163 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:08:49.163 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 62 [ CSSD]2013-05-23 11:08:49.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:08:50.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:51.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:51.057 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:51.853 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d410) allocated [ CSSD]2013-05-23 11:08:51.854 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:51.854 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d410 - 1,2,3 [ CSSD]2013-05-23 11:08:51.854 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b427d410) pid(6674) version 11:1:1:4 [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b427d410), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:51.861 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:51.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:08:51.868 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:08:51.868 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dfe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:51.868 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dfe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:52.071 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d410 [ CSSD]2013-05-23 11:08:52.071 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d410) con(0x7f82b42be650) skgpid ospid 6674 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:52.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:53.993 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d410) allocated [ CSSD]2013-05-23 11:08:53.994 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:08:53.995 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d410 - 1,2,3 [ CSSD]2013-05-23 11:08:53.995 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b427d410) pid(6727) version 11:1:1:4 [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b427d410), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:54.012 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:54.020 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:08:54.020 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:08:54.020 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dac0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:08:54.020 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dac0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:54.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:54.144 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b4520) allocated [ CSSD]2013-05-23 11:08:54.144 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:08:54.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b4520 - 1,2,3 [ CSSD]2013-05-23 11:08:54.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42b4520) pid(6736) version 11:1:1:4 [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b42b4520), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41edd50 with con 0x7f82b42b5a20, requested num -1 [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:08:54.152 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:08:54.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:08:54.159 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:08:54.159 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:08:54.159 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:08:54.222 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d410 [ CSSD]2013-05-23 11:08:54.222 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d410) con(0x7f82b427c5d0) skgpid ospid 6727 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:54.361 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b4520 [ CSSD]2013-05-23 11:08:54.361 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b4520) con(0x7f82b42be650) skgpid ospid 6736 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:08:56.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:08:56.060 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:08:56.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:58.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:08:59.206 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:00.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:01.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:01.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:02.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:04.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:04.508 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d410) allocated [ CSSD]2013-05-23 11:09:04.511 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:04.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d410 - 1,2,3 [ CSSD]2013-05-23 11:09:04.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b427d410) pid(6644/6644) version 11:1:1:4 [ CSSD]2013-05-23 11:09:04.518 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b427d410), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:09:04.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:09:04.518 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:09:04.518 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 63 [ CSSD]2013-05-23 11:09:05.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:09:05.335 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:05.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:09:05.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c00) proc(0x7f82b429e6d0) pid(6865) version 11:1:1:4 [ CSSD]2013-05-23 11:09:05.465 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ccf90) allocated [ CSSD]2013-05-23 11:09:05.466 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:05.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ccf90 - 1,2,3 [ CSSD]2013-05-23 11:09:05.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e8f0) proc(0x7f82b42ccf90) pid(6875) version 11:1:1:4 [ CSSD]2013-05-23 11:09:05.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:09:05.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 1 [ CSSD]2013-05-23 11:09:05.489 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ccf90 [ CSSD]2013-05-23 11:09:05.489 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ccf90) con(0x7f82b429e8f0) skgpid ospid 6875 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5282/0x7f82b4207f20) [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5282 (0x7f82b4207f20) [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207f20 with con 0x7f82b429e8f0, requested num -1 [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:05.568 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:09:05.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5282 (0x7f82b4207f20) [ CSSD]2013-05-23 11:09:05.574 [1199044928] >TRACE: clssgmExitGrock: client 5282 (0x7f82b4207f20), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:09:05.574 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:09:05.574 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:05.575 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:09:05.575 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42b5c00) skgpid ospid 6865 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:06.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:06.063 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:06.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:07.098 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:09:07.099 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:07.099 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:09:07.099 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dac0) proc(0x7f82b429e6d0) pid(6891) version 11:1:1:4 [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b429e6d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:07.116 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:07.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:09:07.124 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:09:07.124 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:07.124 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:07.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:09:07.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429dac0) skgpid ospid 6891 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:08.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:09.219 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:09.388 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:09:09.389 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:09.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:09:09.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c00) proc(0x7f82b429e6d0) pid(6952) version 11:1:1:4 [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b429e6d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41edd50 with con 0x7f82b429e8f0, requested num -1 [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:09.396 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:09.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:09.404 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:09:09.404 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:09.404 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:09.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:09:09.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42b5c00) skgpid ospid 6952 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:10.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:11.065 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:11.065 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:12.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:14.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:16.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:16.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:16.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:18.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:19.233 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:20.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 62 [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 11:09:20.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cbf30) skgpid 6646 ospid 6646 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:21.069 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:21.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:22.359 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:09:22.361 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:22.361 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:09:22.361 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c5f40) pid(7082) version 11:1:1:4 [ CSSD]2013-05-23 11:09:22.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b42c5f40), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4283180, requested num -1 [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:22.367 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:22.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:22.374 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:09:22.374 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:22.374 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:22.577 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:09:22.577 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42a29f0) skgpid ospid 7082 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:24.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:24.649 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:09:24.650 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:24.651 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:09:24.651 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42833d0) pid(7141) version 11:1:1:4 [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b42833d0), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b4207f20 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:24.657 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:24.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:09:24.663 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:09:24.663 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c5f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:24.663 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42c5f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:24.866 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:09:24.866 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42cbf30) skgpid ospid 7141 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:26.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:26.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:26.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:28.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:29.245 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:30.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:30.073 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:09:30.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:32.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:34.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:35.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:35.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:36.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:37.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 11:09:37.611 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:37.612 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 11:09:37.612 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42583a0) pid(7272) version 11:1:1:4 [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b42583a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:37.619 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:37.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:09:37.626 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:09:37.626 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42833d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:37.626 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42833d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:37.828 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 11:09:37.828 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cbf30) skgpid ospid 7272 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:38.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:39.256 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:39.901 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:09:39.902 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:39.902 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:09:39.902 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a3ea0) pid(7327) version 11:1:1:4 [ CSSD]2013-05-23 11:09:39.909 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b42a3ea0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41edd50 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:39.910 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:39.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:39.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:09:39.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:39.918 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:40.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:40.076 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:40.120 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:09:40.120 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42cbf30) skgpid ospid 7327 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:40.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:42.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:44.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:45.078 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:45.078 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:46.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:48.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:49.195 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:09:49.196 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:49.197 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:09:49.197 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c5f40) pid(7430/7430) version 11:1:1:4 [ CSSD]2013-05-23 11:09:49.213 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b42c5f40), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:09:49.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:09:49.213 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:09:49.214 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 63 [ CSSD]2013-05-23 11:09:49.270 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:50.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:50.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:50.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:52.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:52.865 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:09:52.866 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:52.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:09:52.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dac0) proc(0x7f82b429e6d0) pid(7461) version 11:1:1:4 [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b429e6d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:52.873 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:52.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:09:52.881 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:09:52.881 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:52.881 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:53.061 [1199044928] >TRACE: clssgmRegisterClient: proc(93/0x7f82b427d410), client(2/0x7f82b4207f20) [ CSSD]2013-05-23 11:09:53.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207f20) [ CSSD]2013-05-23 11:09:53.061 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:09:53.061 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:09:53.084 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:09:53.084 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429dac0) skgpid ospid 7461 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:53.474 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:09:53.475 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:53.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:09:53.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dac0) proc(0x7f82b429e6d0) pid(6121/6121) version 11:1:1:4 [ CSSD]2013-05-23 11:09:53.492 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b429e6d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:09:53.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:09:53.492 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:09:53.492 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 64 [ CSSD]2013-05-23 11:09:54.265 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 11:09:54.266 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:54.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 11:09:54.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b39e0) pid(7508) version 11:1:1:4 [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82b42b39e0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:54.273 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:54.280 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:09:54.280 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:09:54.280 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1a60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:09:54.280 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1a60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:54.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 11:09:54.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42bad40) skgpid ospid 7508 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:54.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:55.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:09:55.082 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:09:55.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 11:09:55.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:09:55.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 11:09:55.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a1690) pid(7523) version 11:1:1:4 [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82b42a1690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b41c8ba0 with con 0x7f82b42a1b00, requested num -1 [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb6d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:09:55.173 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:09:55.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:09:55.181 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:09:55.181 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:09:55.181 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42a1980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:09:55.384 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 11:09:55.384 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42bad40) skgpid ospid 7523 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:09:55.503 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b38d0) allocated [ CSSD]2013-05-23 11:09:55.503 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:09:55.504 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b38d0 - 1,2,3 [ CSSD]2013-05-23 11:09:55.504 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b38d0) pid(6642/6642) version 11:1:1:4 [ CSSD]2013-05-23 11:09:55.520 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82b42b38d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:09:55.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:09:55.520 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:09:55.520 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 65 [ CSSD]2013-05-23 11:09:56.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:58.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:09:59.284 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:09:59.769 [1199044928] >TRACE: clssgmRegisterClient: proc(95/0x7f82b42b38d0), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 11:09:59.769 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 11:09:59.769 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:09:59.769 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:10:00.084 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:00.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:00.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:01.052 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb50) allocated [ CSSD]2013-05-23 11:10:01.053 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:01.053 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb50 - 1,2,3 [ CSSD]2013-05-23 11:10:01.053 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ec20) proc(0x7f82b41fdb50) pid(7623) version 11:1:1:4 [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b41fdb50), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82b42aee50 with con 0x7f82b41fd9b0, requested num -1 [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5a50/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:01.088 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:01.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:10:01.089 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:10:01.089 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5d50) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:10:01.089 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82b42d5d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b41fdb50), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82b41c8ba0 with con 0x7f82b41fd9b0, requested num -1 [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5a50/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:01.115 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:01.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:10:01.181 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82b41c8ba0), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:10:01.181 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5d50) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:10:01.181 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82b42d5d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:01.262 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb50 [ CSSD]2013-05-23 11:10:01.262 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb50) con(0x7f82b429ec20) skgpid ospid 7623 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:02.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:04.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:05.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:05.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:06.365 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb50) allocated [ CSSD]2013-05-23 11:10:06.366 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:06.367 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb50 - 1,2,3 [ CSSD]2013-05-23 11:10:06.367 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ec20) proc(0x7f82b41fdb50) pid(6630/6630) version 11:1:1:4 [ CSSD]2013-05-23 11:10:06.383 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b41fdb50), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:10:06.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:10:06.383 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:10:06.383 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 66 [ CSSD]2013-05-23 11:10:06.399 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 11:10:06.400 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:06.401 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 11:10:06.401 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fdf40) proc(0x7f82b42d87c0) pid(6119/6119) version 11:1:1:4 [ CSSD]2013-05-23 11:10:06.407 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42d87c0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:10:06.407 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:10:06.407 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:10:06.407 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 67 [ CSSD]2013-05-23 11:10:06.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:08.118 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ce6a0) allocated [ CSSD]2013-05-23 11:10:08.119 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:08.119 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ce6a0 - 1,2,3 [ CSSD]2013-05-23 11:10:08.119 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8e90) proc(0x7f82b42ce6a0) pid(7895) version 11:1:1:4 [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmRegisterClient: proc(98/0x7f82b42ce6a0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42ce4f0, requested num -1 [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ceea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:08.123 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:08.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:10:08.129 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:10:08.129 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:08.129 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:08.331 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ce6a0 [ CSSD]2013-05-23 11:10:08.331 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ce6a0) con(0x7f82b42d8e90) skgpid ospid 7895 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:08.491 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42d87c0), client(2/0x7f82b4286810) [ CSSD]2013-05-23 11:10:08.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 11:10:08.491 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:10:08.491 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 50 [ CSSD]2013-05-23 11:10:08.655 [1199044928] >TRACE: clssgmRegisterClient: proc(96/0x7f82b41fdb50), client(2/0x7f82b42aee50) [ CSSD]2013-05-23 11:10:08.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42aee50) [ CSSD]2013-05-23 11:10:08.655 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:10:08.655 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 51 [ CSSD]2013-05-23 11:10:08.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:09.065 [1199044928] >TRACE: clssgmRegisterClient: proc(94/0x7f82b429e6d0), client(2/0x7f82b42d8f40) [ CSSD]2013-05-23 11:10:09.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d8f40) [ CSSD]2013-05-23 11:10:09.065 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:10:09.065 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 52 [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aaf90) [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aaf90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aaf90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 66 [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aa9d0 [ CSSD]2013-05-23 11:10:09.245 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aa9d0) con(0x26e15e0) skgpid 21050 ospid 21050 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:09.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:10.087 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:10.087 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:10.424 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf210) allocated [ CSSD]2013-05-23 11:10:10.425 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:10.425 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf210 - 1,2,3 [ CSSD]2013-05-23 11:10:10.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4203690) proc(0x7f82b42cf210) pid(7951) version 11:1:1:4 [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmRegisterClient: proc(97/0x7f82b42cf210), client(1/0x7f82b4204710) [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b4204710 with con 0x7f82b42cf060, requested num -1 [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d91c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:10.431 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:10.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 11:10:10.437 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204710), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:10:10.437 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:10.437 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42cfa60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:10.640 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf210 [ CSSD]2013-05-23 11:10:10.640 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf210) con(0x7f82b4203690) skgpid ospid 7951 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:10.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:12.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:13.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26def20) [ CSSD]2013-05-23 11:10:13.873 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26def20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:13.873 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26def20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:13.873 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 51 [ CSSD]2013-05-23 11:10:13.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac01fd10) [ CSSD]2013-05-23 11:10:13.876 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac01fd10), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:13.876 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac01fd10), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:13.876 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 50 [ CSSD]2013-05-23 11:10:13.879 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac016010) [ CSSD]2013-05-23 11:10:13.879 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac016010), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:13.879 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac016010), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:13.879 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 65 [ CSSD]2013-05-23 11:10:13.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b1f0 [ CSSD]2013-05-23 11:10:13.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b1f0) con(0x7f82ac027ab0) skgpid 617 ospid 617 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:13.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac024c30) [ CSSD]2013-05-23 11:10:13.886 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac024c30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:13.886 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac024c30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:13.887 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 64 [ CSSD]2013-05-23 11:10:13.887 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f920 [ CSSD]2013-05-23 11:10:13.887 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f920) con(0x7f82ac00ed30) skgpid 27276 ospid 27276 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:14.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:14.089 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:10:14.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:16.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac06f2b0) [ CSSD]2013-05-23 11:10:16.032 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac06f2b0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.032 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac06f2b0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.032 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 49 [ CSSD]2013-05-23 11:10:16.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0719d0) [ CSSD]2013-05-23 11:10:16.033 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0719d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.033 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0719d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.033 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 48 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05f5f0) [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05f5f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05f5f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 63 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05e6b0) [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05e6b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05e6b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 62 [ CSSD]2013-05-23 11:10:16.034 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac04e6c0 [ CSSD]2013-05-23 11:10:16.035 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0538f0 [ CSSD]2013-05-23 11:10:16.035 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac04e6c0) con(0x7f82ac045810) skgpid 2513 ospid 2513 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.035 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0538f0) con(0x7f82ac04f160) skgpid 2498 ospid 2498 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac06f700) [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac06f700), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac06f700), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 47 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac06f590) [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac06f590), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac06f590), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 46 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac071860) [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac071860), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac071860), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.133 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 45 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac06f870) [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac06f870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac06f870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 44 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac06f420) [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac06f420), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac06f420), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.134 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 43 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05f480) [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05f480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05f480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 61 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05df40) [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05df40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05df40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 60 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0585a0 [ CSSD]2013-05-23 11:10:16.135 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0585a0) con(0x7f82ac054040) skgpid 2515 ospid 2515 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac032290) [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac032290), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac032290), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 59 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac044d00 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05e820) [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05e820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05e820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 58 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac044d00) con(0x7f82ac03c070) skgpid 2500 ospid 2500 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0313c0) [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0313c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0313c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 57 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac02bf40 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac02bf40) con(0x7f82ac0123f0) skgpid 2510 ospid 2510 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac008cc0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0532a0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac008cc0) con(0x7f82ac019040) skgpid 2496 ospid 2496 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0532a0) con(0x7f82ac04a580) skgpid 2508 ospid 2508 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac072270) [ CSSD]2013-05-23 11:10:16.253 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac072270), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.253 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac072270), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.253 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 42 [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006eb0) [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006eb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006eb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 56 [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a2d0 [ CSSD]2013-05-23 11:10:16.255 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a2d0) con(0x7f82ac0211d0) skgpid 2517 ospid 2517 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac071f90) [ CSSD]2013-05-23 11:10:16.395 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac071f90), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.395 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac071f90), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.395 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 41 [ CSSD]2013-05-23 11:10:16.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac032780) [ CSSD]2013-05-23 11:10:16.396 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac032780), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.396 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac032780), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.396 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 55 [ CSSD]2013-05-23 11:10:16.397 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac030ab0 [ CSSD]2013-05-23 11:10:16.397 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac030ab0) con(0x7f82ac02c6b0) skgpid 2519 ospid 2519 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0716f0) [ CSSD]2013-05-23 11:10:16.495 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0716f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.495 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0716f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.495 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 40 [ CSSD]2013-05-23 11:10:16.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05fa60) [ CSSD]2013-05-23 11:10:16.496 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05fa60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.496 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05fa60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.496 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 54 [ CSSD]2013-05-23 11:10:16.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac05d2d0 [ CSSD]2013-05-23 11:10:16.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac05d2d0) con(0x7f82ac058d10) skgpid 2521 ospid 2521 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac072100) [ CSSD]2013-05-23 11:10:16.616 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac072100), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.616 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac072100), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.616 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 39 [ CSSD]2013-05-23 11:10:16.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac031da0) [ CSSD]2013-05-23 11:10:16.617 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac031da0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.617 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac031da0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.617 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 53 [ CSSD]2013-05-23 11:10:16.618 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006930 [ CSSD]2013-05-23 11:10:16.618 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006930) con(0x7f82ac009650) skgpid 2523 ospid 2523 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac071cb0) [ CSSD]2013-05-23 11:10:16.716 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac071cb0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.716 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac071cb0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.716 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 38 [ CSSD]2013-05-23 11:10:16.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05dad0) [ CSSD]2013-05-23 11:10:16.717 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05dad0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.717 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05dad0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.717 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 52 [ CSSD]2013-05-23 11:10:16.718 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0401b0 [ CSSD]2013-05-23 11:10:16.718 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0401b0) con(0x7f82ac0375d0) skgpid 2525 ospid 2525 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0726f0) [ CSSD]2013-05-23 11:10:16.818 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0726f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.818 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0726f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.818 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 37 [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0318b0) [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0318b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0318b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 51 [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac013120 [ CSSD]2013-05-23 11:10:16.820 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac013120) con(0x7f82ac002220) skgpid 2533 ospid 2533 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac071e20) [ CSSD]2013-05-23 11:10:16.937 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac071e20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:16.937 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac071e20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.937 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 36 [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05d0a0) [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05d0a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05d0a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 50 [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac03b710 [ CSSD]2013-05-23 11:10:16.939 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac03b710) con(0x7f82ac032d90) skgpid 2535 ospid 2535 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:16.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:17.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac071b40) [ CSSD]2013-05-23 11:10:17.038 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac071b40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:10:17.038 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac071b40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:10:17.038 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 35 [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac05ec90) [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac05ec90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac05ec90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 49 [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac049950 [ CSSD]2013-05-23 11:10:17.039 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac049950) con(0x7f82ac040bc0) skgpid 2537 ospid 2537 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:18.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:19.091 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:19.091 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:19.105 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf180) allocated [ CSSD]2013-05-23 11:10:19.106 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:19.106 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf180 - 1,2,3 [ CSSD]2013-05-23 11:10:19.106 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4203ea0) proc(0x7f82b42cf180) pid(8019/8019) version 11:1:1:4 [ CSSD]2013-05-23 11:10:19.112 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82b42cf180), client(1/0x7f82b42cf710) [ CSSD]2013-05-23 11:10:19.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cf710) [ CSSD]2013-05-23 11:10:19.112 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:10:19.112 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 50 [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 49 [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:10:19.262 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42a29f0) skgpid 7430 ospid 7430 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:19.310 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:19.493 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 11:10:19.494 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:19.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 11:10:19.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42583a0) pid(8017/8017) version 11:1:1:4 [ CSSD]2013-05-23 11:10:19.510 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82b42583a0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:10:19.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:10:19.511 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:10:19.511 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 50 [ CSSD]2013-05-23 11:10:20.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:22.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:23.362 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42db740) allocated [ CSSD]2013-05-23 11:10:23.363 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:23.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42db740 - 1,2,3 [ CSSD]2013-05-23 11:10:23.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cf880) proc(0x7f82b42db740) pid(8095) version 11:1:1:4 [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42db740), client(1/0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c69c0 with con 0x7f82b42cf660, requested num -1 [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c6b30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:23.368 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:23.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:23.374 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c69c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:10:23.374 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c6e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:23.374 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c6e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:23.576 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42db740 [ CSSD]2013-05-23 11:10:23.576 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42db740) con(0x7f82b42cf880) skgpid ospid 8095 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:24.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:24.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:25.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:25.673 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42db740) allocated [ CSSD]2013-05-23 11:10:25.674 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:25.674 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42db740 - 1,2,3 [ CSSD]2013-05-23 11:10:25.674 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cf880) proc(0x7f82b42db740) pid(8156) version 11:1:1:4 [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42db740), client(1/0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b42c69c0 with con 0x7f82b42cf660, requested num -1 [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c6b30/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:25.680 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:25.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c69c0) [ CSSD]2013-05-23 11:10:25.686 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c69c0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:10:25.686 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c6e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:25.686 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42c6e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:25.888 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42db740 [ CSSD]2013-05-23 11:10:25.888 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42db740) con(0x7f82b42cf880) skgpid ospid 8156 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:26.926 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82b42cf180), client(2/0x7f82b42d91c0) [ CSSD]2013-05-23 11:10:26.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d91c0) [ CSSD]2013-05-23 11:10:26.926 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:10:26.926 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:10:27.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:29.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:29.094 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:29.094 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:29.326 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:31.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:31.523 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x7f82b42583a0), client(2/0x7f82b42d9690) [ CSSD]2013-05-23 11:10:31.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9690) [ CSSD]2013-05-23 11:10:31.523 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:10:31.523 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:10:33.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:34.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:34.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:35.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:37.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:38.448 [1182259520] >TRACE: clssnmConnComplete: properties node 2 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:10:38.448 [1182259520] >TRACE: clssnmUpdGMenhMsg: cleared data for node 2 [ CSSD]2013-05-23 11:10:38.448 [1182259520] >TRACE: clssnmUpdGMenhMsg: updated data for node 2 with size 82 version 1 [ CSSD]2013-05-23 11:10:38.448 [1182259520] >TRACE: clssnmSendConnAck: connected to node 2, prod-rac02, con (0x7f82b42d95e0), state 0 [ CSSD]2013-05-23 11:10:38.448 [1182259520] >TRACE: clssnmConnComplete: connected to node 2, prod-rac02, con (0x7f82b42d95e0), ninfcon (0x7f82b42d95e0), state 0, flags 0x40d, ICIN 174631045, properties 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:10:38.608 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9460) allocated [ CSSD]2013-05-23 11:10:38.608 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:38.609 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9460 - 1,2,3 [ CSSD]2013-05-23 11:10:38.609 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7140) proc(0x7f82b42c9460) pid(8296) version 11:1:1:4 [ CSSD]2013-05-23 11:10:38.623 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42c9460), client(1/0x7f82b42c9c30) [ CSSD]2013-05-23 11:10:38.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c9c30) [ CSSD]2013-05-23 11:10:38.623 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c9c30 with con 0x7f82b42c9330, requested num -1 [ CSSD]2013-05-23 11:10:38.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:38.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9da0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:10:38.624 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:38.624 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:38.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c9c30) [ CSSD]2013-05-23 11:10:38.629 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c9c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:10:38.629 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca0a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:38.629 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca0a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:38.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9460 [ CSSD]2013-05-23 11:10:38.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9460) con(0x7f82b42c7140) skgpid ospid 8296 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:38.930 [1182259520] >TRACE: clssnmHandleJoin: node 2 JOINING, state 0->1 ninfcon 0x7f82b42d95e0 [ CSSD]2013-05-23 11:10:39.097 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:39.098 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:39.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmDoSyncUpdate: Initiating sync 174631051 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (27000)ms [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (11) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetupAckWait: node(1) is ALIVE [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetupAckWait: node(2) is ALIVE [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631051) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: List of nodes that have ACKed my sync: NULL [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmHandleSync: diskTimeout set to (27000)ms [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmQueueClientEvent: Sending Event(2), type 2, incarn 174631050 [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmQueueClientEvent: Node[1] state = 3, birth = 174631047, unique = 1367734820 [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmQueueClientEvent: Node[2] state = 1, birth = 0, unique = 1369321838 [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmHandleSync: Acknowledging sync: src[1] srcName[prod-rac01] seq[13] sync[174631051] [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmSendAck: node 1, prod-rac01, syncSeqNo(174631051) type(11) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631051) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmWaitForAcks: Ack message type(11), ackCount(2) [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmHandleAck: src[1] dest[1] dom[0] seq[0] sync[174631051] type[11] ackCount(1) [ CSSD]2013-05-23 11:10:39.307 [3136792288] >TRACE: clssgmStartNMMon: node 1 active, birth 174631047 [ CSSD]2013-05-23 11:10:39.307 [3136792288] >USER: NMEVENT_SUSPEND [00][00][00][02] [ CSSD]2013-05-23 11:10:39.307 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 5, changes 37 [ CSSD]2013-05-23 11:10:39.307 [3136792288] >TRACE: clssgmSuspendAllGrocks: Issue SUSPEND [ CSSD]2013-05-23 11:10:39.307 [1182259520] >TRACE: clssnmHandleAck: src[2] dest[1] dom[0] seq[0] sync[174631051] type[11] ackCount(0) [ CSSD]2013-05-23 11:10:39.307 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSendSync: syncSeqNo(174631051) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: List of nodes that have ACKed my sync: 1,2 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmWaitForAcks: done, msg type(11) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetMinMaxVersion: node 1 product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetMinMaxVersion: node 2 product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetMinMaxVersion: properties common to all nodes: 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetMinMaxVersion: min product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetMinMaxVersion: max product/protocol (11.1/1.4) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmNeedConfReq: No configuration to change [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmDoSyncUpdate: node(2) is transitioning from joining state to active state [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (13) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmDoSyncUpdate: Wait for 0 vote ack(s) [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmCheckDskInfo: Checking disk info... [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmEvict: Start [ CSSD]2013-05-23 11:10:39.307 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(1) master(1) event(2), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmWaitOnEvictions: Start [ CSSD]2013-05-23 11:10:39.307 [1173866816] >TRACE: clssnmSetupAckWait: Ack message type (15) [ CSSD]2013-05-23 11:10:39.308 [1173866816] >TRACE: clssnmBldSendUpdate: syncSeqNo(174631051) [ CSSD]2013-05-23 11:10:39.308 [1173866816] >TRACE: clssnmBldSendUpdate: using msg version 3 [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [1173866816] >TRACE: clssnmWaitForAcks: Ack message type(15), ackCount(2) [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmHandleUpdate: sync[174631051] src[1], msgvers 3 icin 174631045 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmHandleUpdate: common prop (max 14) got 1,2,3,4,5,6,7,8,9,10,13 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmUpdateNodeState: node 1, state (3/3) unique (1367734820/1367734820) prevConuni(0) birth (174631047/174631047) (old/new) [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmUpdateNodeState: node 2, state (2/3) unique (1369321838/1369321838) prevConuni(0) birth (174631051/174631051) (old/new) [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmUpdateNodeState: update node 2 with data unknown version size 82 off 89 [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssgmBldUpdMsg: already in Version 1 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmSendAck: node 1, prod-rac01, syncSeqNo(174631051) type(15) [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmQueueClientEvent: Sending Event(1), type 1, incarn 174631051 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmQueueClientEvent: Node[1] state = 3, birth = 174631047, unique = 1367734820 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmQueueClientEvent: Node[2] state = 3, birth = 174631051, unique = 1369321838 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >USER: clssnmHandleUpdate: SYNC(174631051) from node(1) completed [ CSSD]2013-05-23 11:10:39.308 [1182259520] >USER: clssnmHandleUpdate: NODE 1 (prod-rac01) IS ACTIVE MEMBER OF CLUSTER [ CSSD]2013-05-23 11:10:39.308 [1182259520] >USER: clssnmHandleUpdate: NODE 2 (prod-rac02) IS ACTIVE MEMBER OF CLUSTER [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmHandleAck: src[1] dest[1] dom[0] seq[0] sync[174631051] type[15] ackCount(1) [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [1182259520] >TRACE: clssnmHandleAck: src[2] dest[1] dom[0] seq[0] sync[174631051] type[15] ackCount(0) [ CSSD]2013-05-23 11:10:39.308 [1173866816] >TRACE: clssnmWaitForAcks: done, msg type(15) [ CSSD]2013-05-23 11:10:39.308 [1173866816] >TRACE: clssnmDoSyncUpdate: Sync 174631051 complete! [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(ORA_CLSRD_1_HWPROD) count(1) master(0) event(2), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.308 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(1) master(1) event(2), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(2), incarn 33, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.309 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(1) master(0) event(2), incarn 11, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(1) master(0) event(2), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(1) master(0) event(2), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(1) master(1) event(2), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(1) master(0) event(2), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(1) master(0) event(2), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(1) master(1) event(2), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmSuspendAllGrocks: done [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 2, changes 38 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 174631050, changes 13 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmCleanupNodeContexts(): cleaning up nodes, rcfg(174631050) [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmCleanupNodeContexts(): successful cleanup of nodes rcfg(174631050) [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmStartNMMon: completed node cleanup [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmStartNMMon: node 1 active, birth 174631047 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmStartNMMon: node 2 active, birth 174631051 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmUpdateEventValue: Reconfig Event val 1, changes 13 [ CSSD]2013-05-23 11:10:39.310 [3136792288] >TRACE: clssgmUpdateEventValue: CmInfo State val 3, changes 39 [ CSSD]2013-05-23 11:10:39.310 [1249401152] >TRACE: clssgmReconfigThread: started for reconfig (174631051) [ CSSD]2013-05-23 11:10:39.310 [1249401152] >USER: NMEVENT_RECONFIG [00][00][00][06] [ CSSD]2013-05-23 11:10:39.310 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 4, from 3, changes 40 [ CSSD]2013-05-23 11:10:39.310 [1249401152] >TRACE: clssgmResumeAllGrocks: Issue RESUME [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(1) master(1) event(3), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(ORA_CLSRD_1_HWPROD) count(1) master(0) event(3), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.311 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(1) master(1) event(3), incarn 11, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(3), incarn 33, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(1) master(0) event(3), incarn 11, mbrc 1, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(1) master(0) event(3), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.312 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(1) master(0) event(3), incarn 9, mbrc 1, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(1) master(1) event(3), incarn 9, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(1) master(0) event(3), incarn 15, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(1) master(0) event(3), incarn 10, mbrc 1, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(1) master(1) event(3), incarn 7, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmResumeAllGrocks: done [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmCMReconfig: setting cmInfo->incarn_clssgmctx to 174631051 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 6, from 4, changes 41 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmEstablishConnections: 2 nodes in cluster incarn 174631051 [ CSSD]2013-05-23 11:10:39.313 [1249401152] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 0, changes 14 [ CSSD]2013-05-23 11:10:39.313 [1123510592] >TRACE: clssgmPeerListener: new incarn 174631051. old 174631050 [ CSSD]2013-05-23 11:10:39.313 [1123510592] >TRACE: clssgmConnectToNode: connecting to node(2) [ CSSD]2013-05-23 11:10:39.313 [1123510592] >TRACE: clssgmConnectToNode: node 2 clsc (ADDRESS=(PROTOCOL=tcp)(DEV=12)(HOST=10.10.10.2)(PORT=12060)) - size 61 ver 1 [ CSSD]2013-05-23 11:10:39.313 [1123510592] >TRACE: clssgmConnectToNode: node 2 data (ADDRESS=(PROTOCOL=tcp)(DEV=12)(HOST=10.10.10.2)(PORT=12060)) - size 61 ver 1 [ CSSD]2013-05-23 11:10:39.313 [1123510592] >TRACE: clssgmPeerListener: connected to 1 of 2 [ CSSD]2013-05-23 11:10:39.321 [1123510592] >TRACE: clssgmPeerListener: connected to 1 of 2 [ CSSD]2013-05-23 11:10:39.321 [1123510592] >TRACE: clssgmInitialRecv: properties node 2 len 16 off 68 [ CSSD]2013-05-23 11:10:39.321 [1123510592] >TRACE: clssgmInitialRecv: conns done (2/2) [ CSSD]2013-05-23 11:10:39.321 [1123510592] >TRACE: clssgmUpdateEventValue: ConnectedNodes val 174631051, changes 15 [ CSSD]2013-05-23 11:10:39.321 [1123510592] >TRACE: clssgmInitialRecv: still connected to node 2, properties 1,2,3,4,5,6,7 [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmWaitChangeEventValue: ev(ConnectedNodes) changed to 174631051 [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmEstablishConnections: (2/2) connected, incarn(174631051) [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 42 [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7 [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmEstablishMasterNode: MASTER for 174631051 is node(1) birth(174631047) [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 43 [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status [ CSSD]2013-05-23 11:10:39.321 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODHWPROD, id 83, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.322 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IG+ASMSYS$USERS, id 14, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.322 [1249401152] >TRACE: clssgmCopyoutMemberInfo: _ORA_CRS_MEMBER_prod-rac01, id 1718830, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.322 [1249401152] >TRACE: clssgmCopyoutMemberInfo: crs_version, id 3, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.323 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ocr_prod-rac, id 2, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.323 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODHWPRODXDB, id 82, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.323 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODSYS$USERS, id 80, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.323 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ORA_CLSRD_1_HWPROD, id 94, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.324 [1249401152] >TRACE: clssgmCopyoutMemberInfo: ORA_CLSRD_1_HWPROD, id 1718879, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.324 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DB+ASM, id 9, grp priv data 0, members 1, msgsize 632 [ CSSD]2013-05-23 11:10:39.324 [1249401152] >TRACE: clssgmCopyoutMemberInfo: HB+ASM, id 12, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.324 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG+ASM, id 7, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.325 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IG+ASMSYS$BACKGROUND, id 13, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.325 [1249401152] >TRACE: clssgmCopyoutMemberInfo: MASTER#DISKMON#GROUP, id 6, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.325 [1249401152] >TRACE: clssgmCopyoutMemberInfo: VT+ASM, id 11, grp priv data 100, members 1, msgsize 652 [ CSSD]2013-05-23 11:10:39.325 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG+ASM0, id 8, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.325 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_DATA, id 16, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: OSM_ALL, id 15, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DAALL_DB, id 10, grp priv data 0, members 2, msgsize 576 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: CRSDMAIN, id 4, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: EVMDMAIN, id 5, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_REDOA, id 71, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.326 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_REDOB, id 72, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.327 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DBHWPROD, id 78, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.327 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DGHWPROD, id 76, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.327 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODSYS$BACKGROUND, id 79, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.327 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DGHWPROD0, id 77, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.328 [1249401152] >TRACE: clssgmCopyoutMemberInfo: IGHWPRODALL, id 81, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.328 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_SBYREDOA, id 19, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.328 [1249401152] >TRACE: clssgmCopyoutMemberInfo: DG_SBYREDOB, id 73, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.328 [1249401152] >TRACE: clssgmCopyoutMemberInfo: #CSS_CLSSOMON, id 1, grp priv data 0, members 1, msgsize 552 [ CSSD]2013-05-23 11:10:39.328 [1249401152] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete [ CSSD]2013-05-23 11:10:39.337 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:39.337 [1199044928] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174631051, changes 5 [ CSSD]2013-05-23 11:10:39.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(108) src(2) dest(1) size(72) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 44 [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 45 [ CSSD]CLSS-3000: reconfiguration successful, incarnation 174631051 with 2 nodes [ CSSD]CLSS-3001: local node number 1, master node number 1 [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CSS_INTERNAL_NODE_GROUP) count(2) master(1) event(1), incarn 174631051, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmQueueGrockEvent: groupName(CSS_INTERNAL_NODE_GROUP) count(2) master(1) event(1), incarn 174631051, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmReconfigThread: completed for reconfig(174631051), with status(1) [ CSSD]2013-05-23 11:10:39.367 [1249401152] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 14 [ CSSD]2013-05-23 11:10:39.367 [3136792288] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 60 [ CSSD]2013-05-23 11:10:39.367 [3136792288] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 15 [ CSSD]2013-05-23 11:10:39.367 [3136792288] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174631051) [ CSSD]2013-05-23 11:10:39.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0000002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0001002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.456 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:39.456 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(#CSS_CLSSOMON) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:39.456 [1123510592] >TRACE: clssgmAddMember: member (2/0x7f82b4207080) added. pbsz(0) prsz(0) flags 0x1000 to grock (0x26632d0/#CSS_CLSSOMON) [ CSSD]2013-05-23 11:10:39.457 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(#CSS_CLSSOMON) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.457 [1123510592] >TRACE: clssgmCommonAddMember: global group grock #CSS_CLSSOMON member(2/Remote) node(2) flags 0x1000 0x1000000 [ CSSD]2013-05-23 11:10:39.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0002002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(452) tag(0003002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(452) [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ocr_prod-rac) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmAddMember: member (2/0x7f82b42db530) added. pbsz(32) prsz(0) flags 0x0 to grock (0x2658020/ocr_prod-rac) [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(ocr_prod-rac) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x18, state 0x0 [ CSSD]2013-05-23 11:10:39.792 [1123510592] >TRACE: clssgmCommonAddMember: global group grock ocr_prod-rac member(2/Remote) node(2) flags 0x0 0x80600 [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0004002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(crs_version) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmAddMember: member (0/0x7f82b42db7d0) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2657a30/crs_version) [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(crs_version) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:39.795 [1123510592] >TRACE: clssgmCommonAddMember: global group grock crs_version member(0/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:39.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0005002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(676) tag(0006002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:39.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(676) [ CSSD]2013-05-23 11:10:39.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(CRSDMAIN) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:39.807 [1123510592] >TRACE: clssgmAddMember: member (2/0x7f82b42c6fb0) added. pbsz(128) prsz(128) flags 0x0 to grock (0x265ee10/CRSDMAIN) [ CSSD]2013-05-23 11:10:39.808 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:39.808 [1123510592] >TRACE: clssgmCommonAddMember: global group grock CRSDMAIN member(2/Remote) node(2) flags 0x0 0x200 [ CSSD]2013-05-23 11:10:39.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0007002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(1432) tag(0008002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(1432) [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(EVMDMAIN) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmAddMember: member (2/0x7f82b42c7170) added. pbsz(504) prsz(508) flags 0x0 to grock (0x265e880/EVMDMAIN) [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:40.442 [1123510592] >TRACE: clssgmCommonAddMember: global group grock EVMDMAIN member(2/Remote) node(2) flags 0x0 0x200 [ CSSD]2013-05-23 11:10:40.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0009002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:40.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:40.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(MASTER#DISKMON#GROUP#MX) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:40.450 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c79d0/MASTER#DISKMON#GROUP#MX) [ CSSD]2013-05-23 11:10:40.450 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock MASTER#DISKMON#GROUP#MX member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:40.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(492) tag(000a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:40.451 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(492) [ CSSD]2013-05-23 11:10:40.451 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(MASTER#DISKMON#GROUP) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:40.451 [1123510592] >TRACE: clssgmAddMember: member (2/0x7f82b42c7da0) added. pbsz(72) prsz(0) flags 0x0 to grock (0x265bd10/MASTER#DISKMON#GROUP) [ CSSD]2013-05-23 11:10:40.452 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(2) master(1) event(1), incarn 8, mbrc 2, to member 1, events 0x78, state 0x0 [ CSSD]2013-05-23 11:10:40.452 [1123510592] >TRACE: clssgmCommonAddMember: global group grock MASTER#DISKMON#GROUP member(2/Remote) node(2) flags 0x0 0x1e00 [ CSSD]2013-05-23 11:10:40.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:40.453 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:40.453 [1123510592] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP#MX, member number 0 (0x7f82b42c7740) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:40.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8150) allocated [ CSSD]2013-05-23 11:10:40.917 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:40.917 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8150 - 1,2,3 [ CSSD]2013-05-23 11:10:40.917 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7800) proc(0x7f82b42c8150) pid(8352) version 11:1:1:4 [ CSSD]2013-05-23 11:10:40.921 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42c8150), client(1/0x7f82b42c78b0) [ CSSD]2013-05-23 11:10:40.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c78b0) [ CSSD]2013-05-23 11:10:40.921 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b42c78b0 with con 0x7f82b42ca650, requested num -1 [ CSSD]2013-05-23 11:10:40.921 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:40.921 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cacd0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:40.922 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:40.922 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:40.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c78b0) [ CSSD]2013-05-23 11:10:40.926 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c78b0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:10:40.926 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca4d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:40.926 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42ca4d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:41.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(629) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock EVMDMAIN, member 2 node 2, birth 7 [ CSSD]2013-05-23 11:10:41.023 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(EVMDMAIN) count(2) master(1) event(6), incarn 2, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:10:41.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.128 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8150 [ CSSD]2013-05-23 11:10:41.128 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8150) con(0x7f82b42c7800) skgpid ospid 8352 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:41.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:41.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.552 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c82b0/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.552 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.604 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.604 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42c8030) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.626 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.626 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.626 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c7f60/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.626 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0010002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac01.vip) [ CSSD]2013-05-23 11:10:41.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0011002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.629 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.629 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.vip, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0012002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.632 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:41.632 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0013002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.633 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.633 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0014002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.636 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac01.gsd) [ CSSD]2013-05-23 11:10:41.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0015002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.637 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.637 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.gsd, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0016002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.639 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:10:41.639 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0017002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.640 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.640 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0018002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.644 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.644 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.644 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac01.ons) [ CSSD]2013-05-23 11:10:41.644 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0019002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.645 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.645 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ons, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.647 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.647 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.647 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:10:41.647 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.648 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.648 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.652 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) [ CSSD]2013-05-23 11:10:41.652 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.653 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.656 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:41.656 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.657 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.657 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0020002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.ASM1.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.660 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac01.ASM1.asm) [ CSSD]2013-05-23 11:10:41.660 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ASM1.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0021002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.661 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.661 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ASM1.asm, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0022002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.664 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.664 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.664 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:41.664 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0023002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.665 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.665 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0024002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.db) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.HWPROD.db) [ CSSD]2013-05-23 11:10:41.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.db member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0025002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.670 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.670 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.db, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0026002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.672 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.672 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD1.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.672 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.HWPROD.HWPROD1.inst) [ CSSD]2013-05-23 11:10:41.672 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD1.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0027002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.674 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD1.inst, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0028002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.676 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.676 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.676 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:10:41.676 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0029002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.677 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.677 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42c7970) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.680 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.680 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42c8330) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.681 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c7f60/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.681 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:41.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:41.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.783 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42c8330) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_ORA_CRS_BOOT) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.797 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c7f60/_ORA_CRS_BOOT) [ CSSD]2013-05-23 11:10:41.797 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _ORA_CRS_BOOT member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_ORA_CRS_MEMBER_prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.798 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c7670/_ORA_CRS_MEMBER_prod-rac02) [ CSSD]2013-05-23 11:10:41.798 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _ORA_CRS_MEMBER_prod-rac02 member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.805 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82b42c8700/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.805 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0030002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac01.vip) [ CSSD]2013-05-23 11:10:41.807 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0031002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.808 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.808 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.vip, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0032002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.815 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.815 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.815 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:41.816 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0033002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.816 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.816 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0034002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.829 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac01.gsd) [ CSSD]2013-05-23 11:10:41.829 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0035002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.831 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.831 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.gsd, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.833 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:41.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:41.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:41.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0036002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.837 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:10:41.837 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0037002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.838 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.838 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0038002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.849 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac01.ons) [ CSSD]2013-05-23 11:10:41.849 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0039002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.850 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ons, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.857 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.857 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.857 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:10:41.857 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.858 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.859 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.869 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr) [ CSSD]2013-05-23 11:10:41.869 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.870 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.870 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.LISTENER_PROD-RAC01.lsnr, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.877 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.877 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.877 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:41.877 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.878 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0040002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac01.ASM1.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.892 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac01.ASM1.asm) [ CSSD]2013-05-23 11:10:41.892 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac01.ASM1.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0041002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.893 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.893 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac01.ASM1.asm, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0042002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.901 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:41.901 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0043002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.902 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.902 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0044002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.db) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.914 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.HWPROD.db) [ CSSD]2013-05-23 11:10:41.914 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.db member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0045002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.915 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.915 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.db, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0046002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD1.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.922 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.HWPROD.HWPROD1.inst) [ CSSD]2013-05-23 11:10:41.922 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD1.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0047002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.923 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.923 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD1.inst, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0048002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.931 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x7f82b42c8ad0/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:10:41.931 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0049002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.932 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.932 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x7f82b42c8ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.944 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.944 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x7f82b42c7c00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.947 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.948 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.948 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.948 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:41.948 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.949 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.949 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.957 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.957 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.957 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:41.957 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.958 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.958 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0050002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.959 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.959 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.959 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:41.959 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0051002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.960 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.960 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0052002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.961 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.961 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.961 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:41.961 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:41.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0053002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.962 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.962 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.962 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6730/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:41.962 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0054002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.963 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.963 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x26583f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0055002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.970 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.970 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.970 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6730/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:41.970 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0056002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.971 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.972 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x26583f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:41.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0057002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.973 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:41.973 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:41.973 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6730/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:41.973 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:41.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0058002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:41.974 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:41.974 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:42.003 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.003 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.029 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae00) allocated [ CSSD]2013-05-23 11:10:42.030 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:42.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae00 - 1,2,3 [ CSSD]2013-05-23 11:10:42.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8ae0) proc(0x7f82b42cae00) pid(8432) version 11:1:1:4 [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42cae00), client(1/0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac02 new client 0x7f82b42dc0d0 with con 0x7f82b42cacd0, requested num -1 [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc240/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac02) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:42.038 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:42.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:42.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dc0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac02, member 0 [ CSSD]2013-05-23 11:10:42.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac02 [ CSSD]2013-05-23 11:10:42.044 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82b42dc540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:42.255 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.255 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae00 [ CSSD]2013-05-23 11:10:42.255 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae00) con(0x7f82b42c8ae0) skgpid ospid 8432 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:42.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:42.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0059002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:42.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:42.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:42.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2659cc0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:10:42.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:42.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:42.345 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:42.345 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:42.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:42.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:42.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:42.467 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2659cc0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:42.467 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:42.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:42.482 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:42.482 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:43.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:44.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:44.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:45.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:45.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.713 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.713 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.714 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:45.714 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:45.715 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.715 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:45.715 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:45.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0060002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.716 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.716 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0061002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.732 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.732 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.732 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:45.732 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:45.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0062002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.733 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.733 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0063002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.vip) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.734 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.vip) [ CSSD]2013-05-23 11:10:45.734 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.vip member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:45.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0064002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.735 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.735 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.vip, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0065002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.737 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:45.737 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:45.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0066002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.739 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.739 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.782 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:45.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0067002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.797 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:45.797 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:45.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0068002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.831 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.831 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:45.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0069002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.858 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:45.858 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:45.858 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2659cc0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:45.858 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:45.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:45.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:45.862 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:46.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:46.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:46.139 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:46.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:46.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.140 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:46.140 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:46.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:46.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:46.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:46.311 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:46.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:46.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:46.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.845 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:46.845 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:46.845 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:46.845 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:46.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:46.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:46.846 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr) [ CSSD]2013-05-23 11:10:46.846 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:46.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0070002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.847 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:46.848 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.LISTENER_PROD-RAC02.lsnr, member number 0 (0x26eedb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:46.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0071002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:46.849 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:46.849 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x264fe70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:47.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:48.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(554) tag(0072002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:48.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(554) [ CSSD]2013-05-23 11:10:48.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG+ASM) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:10:48.851 [1123510592] >TRACE: clssgmAddMember: member (1/0x265f1e0) added. pbsz(10) prsz(124) flags 0x0 to grock (0x265af50/DG+ASM) [ CSSD]2013-05-23 11:10:48.852 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM) count(2) master(0) event(1), incarn 12, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:48.852 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG+ASM member(1/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:48.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0073002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:48.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0074002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(554) tag(0075002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(554) [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG+ASM0) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmAddMember: member (1/0x264fe70) added. pbsz(10) prsz(124) flags 0x0 to grock (0x265cb40/DG+ASM0) [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG+ASM0) count(2) master(0) event(1), incarn 12, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:48.897 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG+ASM0 member(1/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:48.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0076002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:48.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0077002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(551) tag(0078002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(551) [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DB+ASM) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmAddMember: member (1/0x26eedb0) added. pbsz(11) prsz(120) flags 0x0 to grock (0x265a130/DB+ASM) [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DB+ASM) count(2) master(0) event(1), incarn 16, mbrc 2, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:10:49.089 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DB+ASM member(1/Remote) node(2) flags 0x0 0x81a00 [ CSSD]2013-05-23 11:10:49.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0079002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(434) tag(007a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(434) [ CSSD]2013-05-23 11:10:49.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DAALL_DB) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:49.097 [1123510592] >TRACE: clssgmAddMember: member (1/0x2660d60) added. pbsz(14) prsz(0) flags 0x0 to grock (0x265dfe0/DAALL_DB) [ CSSD]2013-05-23 11:10:49.097 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DAALL_DB member(1/Remote) node(2) flags 0x0 0x100 [ CSSD]2013-05-23 11:10:49.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:49.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:49.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:10:49.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:10:49.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmRegisterClient: proc(10/0x7f82b41c7e50), client(8/0x7f82b42c9090) [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 8 (0x7f82b42c9090) [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmJoinGrock: global grock VT+ASM new client 0x7f82b42c9090 with con 0x7f82b42c8880, requested num 0 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock VT+ASM [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmAddMember: Adding fencing for member 0, group VT+ASM, death 1, SAGE 0 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmAddMember: member (0/0x7f82b42c8700) added. pbsz(0) prsz(0) flags 0x0 to grock (0x265c3f0/VT+ASM) [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(1), incarn 34, mbrc 2, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(1), incarn 34, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:49.230 [1199044928] >TRACE: clssgmCommonAddMember: global group grock VT+ASM member(0/Local) node(1) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:49.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:10:49.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 3 [ CSSD]2013-05-23 11:10:49.231 [1199044928] >TRACE: clssgmMasterGrpDataUpdt: grock VT+ASM, type 3, incarn 21, len 100 [ CSSD]2013-05-23 11:10:49.231 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(8), incarn 22, mbrc 0, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 3 [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmMasterGrpDataUpdt: grock VT+ASM, type 3, incarn 22, len 100 [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(8), incarn 23, mbrc 0, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 8 (0x7f82b42c9090) [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmExitGrock: client 8 (0x7f82b42c9090), grock VT+ASM, member 0 [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8700) in global grock VT+ASM [ CSSD]2013-05-23 11:10:49.232 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(2), incarn 34, mbrc 2, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.233 [1199044928] >TRACE: clssgmRemoveMember: grock VT+ASM, member number 0 (0x7f82b42c8700) node number 1 state 0x14 member refcnt 0 grock type 2 [ CSSD]2013-05-23 11:10:49.233 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(1) master(1) event(1), incarn 35, mbrc 1, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41baf90), type 1 [ CSSD]2013-05-23 11:10:49.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.349 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(528) tag(007d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(528) [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(VT+ASM) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmAddMember: member (2/0x26a6b20) added. pbsz(0) prsz(108) flags 0x0 to grock (0x265c3f0/VT+ASM) [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(VT+ASM) count(2) master(1) event(1), incarn 36, mbrc 2, to member 1, events 0x60, state 0x0 [ CSSD]2013-05-23 11:10:49.638 [1123510592] >TRACE: clssgmCommonAddMember: global group grock VT+ASM member(2/Remote) node(2) flags 0x0 0x1800 [ CSSD]2013-05-23 11:10:49.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(424) tag(007e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(424) [ CSSD]2013-05-23 11:10:49.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(HB+ASM) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:49.639 [1123510592] >TRACE: clssgmAddMember: member (2/0x2661b20) added. pbsz(0) prsz(4) flags 0x0 to grock (0x265a870/HB+ASM) [ CSSD]2013-05-23 11:10:49.639 [1123510592] >TRACE: clssgmCommonAddMember: global group grock HB+ASM member(2/Remote) node(2) flags 0x0 0x100 [ CSSD]2013-05-23 11:10:49.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(227) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock VT+ASM, member 2 node 2, birth 35 [ CSSD]2013-05-23 11:10:49.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:10:49.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:49.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IG+ASMSYS$BACKGROUND) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:49.869 [1123510592] >TRACE: clssgmAddMember: member (2/0x265e590) added. pbsz(0) prsz(0) flags 0x0 to grock (0x265b630/IG+ASMSYS$BACKGROUND) [ CSSD]2013-05-23 11:10:49.870 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$BACKGROUND) count(2) master(1) event(1), incarn 12, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:49.870 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IG+ASMSYS$BACKGROUND member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:49.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0080002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:49.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:49.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IG+ASMSYS$USERS) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:10:49.871 [1123510592] >TRACE: clssgmAddMember: member (2/0x26591b0) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2656b70/IG+ASMSYS$USERS) [ CSSD]2013-05-23 11:10:49.871 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IG+ASMSYS$USERS) count(2) master(1) event(1), incarn 12, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:10:49.871 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IG+ASMSYS$USERS member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:50.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(501) tag(0081002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(501) [ CSSD]2013-05-23 11:10:50.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(OSM_ALL) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.000 [1123510592] >TRACE: clssgmAddMember: member (1/0x26636a0) added. pbsz(81) prsz(0) flags 0x0 to grock (0x265d900/OSM_ALL) [ CSSD]2013-05-23 11:10:50.000 [1123510592] >TRACE: clssgmCommonAddMember: global group grock OSM_ALL member(1/Remote) node(2) flags 0x0 0x100 [ CSSD]2013-05-23 11:10:50.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0082002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:50.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:50.236 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:50.236 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:50.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0083002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.237 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:50.238 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x2656880) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:50.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0084002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(633) tag(0085002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(633) [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG_DATA) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmAddMember: member (1/0x2658ad0) added. pbsz(171) prsz(42) flags 0x0 to grock (0x265d220/DG_DATA) [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_DATA) count(2) master(0) event(1), incarn 16, mbrc 2, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:50.888 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG_DATA member(1/Remote) node(2) flags 0x0 0x40000000 [ CSSD]2013-05-23 11:10:50.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0086002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0087002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0088002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(633) tag(0089002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(633) [ CSSD]2013-05-23 11:10:50.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG_REDOA) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.893 [1123510592] >TRACE: clssgmAddMember: member (1/0x2656880) added. pbsz(171) prsz(42) flags 0x0 to grock (0x265f4f0/DG_REDOA) [ CSSD]2013-05-23 11:10:50.894 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOA) count(2) master(0) event(1), incarn 11, mbrc 2, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:50.894 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG_REDOA member(1/Remote) node(2) flags 0x0 0x40000000 [ CSSD]2013-05-23 11:10:50.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(633) tag(008d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(633) [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG_REDOB) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmAddMember: member (1/0x268bf00) added. pbsz(171) prsz(42) flags 0x0 to grock (0x265fbd0/DG_REDOB) [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_REDOB) count(2) master(0) event(1), incarn 11, mbrc 2, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:50.898 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG_REDOB member(1/Remote) node(2) flags 0x0 0x40000000 [ CSSD]2013-05-23 11:10:50.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0090002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(633) tag(0091002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(633) [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG_SBYREDOA) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmAddMember: member (1/0x26a6690) added. pbsz(171) prsz(42) flags 0x0 to grock (0x2662510/DG_SBYREDOA) [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOA) count(2) master(0) event(1), incarn 16, mbrc 2, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:50.903 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG_SBYREDOA member(1/Remote) node(2) flags 0x0 0x40000000 [ CSSD]2013-05-23 11:10:50.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0092002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0093002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0094002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(633) tag(0095002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(633) [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DG_SBYREDOB) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmAddMember: member (1/0x26e8f30) added. pbsz(171) prsz(42) flags 0x0 to grock (0x2662bf0/DG_SBYREDOB) [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DG_SBYREDOB) count(2) master(0) event(1), incarn 11, mbrc 2, to member 0, events 0x4, state 0x0 [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DG_SBYREDOB member(1/Remote) node(2) flags 0x0 0x40000000 [ CSSD]2013-05-23 11:10:50.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0096002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:50.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0097002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:51.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:51.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:51.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:10:53.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:53.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:53.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:10:53.869 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf20) allocated [ CSSD]2013-05-23 11:10:53.869 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:10:53.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf20 - 1,2,3 [ CSSD]2013-05-23 11:10:53.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8ba0) proc(0x7f82b42caf20) pid(8588) version 11:1:1:4 [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42caf20), client(1/0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42dc0d0 with con 0x7f82b42cad90, requested num -1 [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc240/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:53.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:53.883 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dc0d0) [ CSSD]2013-05-23 11:10:53.883 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dc0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:10:53.883 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:53.883 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:54.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf20 [ CSSD]2013-05-23 11:10:54.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf20) con(0x7f82b42c8ba0) skgpid ospid 8588 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:54.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:54.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:54.529 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ca470) allocated [ CSSD]2013-05-23 11:10:54.530 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:10:54.530 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ca470 - 1,2,3 [ CSSD]2013-05-23 11:10:54.530 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc140) proc(0x7f82b42ca470) pid(8637) version 11:1:1:4 [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42ca470), client(1/0x7f82b42cab70) [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cab70) [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cab70 with con 0x7f82b42ca340, requested num -1 [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cace0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:10:54.538 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:54.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cab70) [ CSSD]2013-05-23 11:10:54.546 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cab70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:10:54.546 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dca70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:10:54.546 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dca70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:10:54.748 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ca470 [ CSSD]2013-05-23 11:10:54.748 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ca470) con(0x7f82b42dc140) skgpid ospid 8637 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:10:55.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:55.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:55.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:10:57.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:57.389 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0098002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:57.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:57.390 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:57.390 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:57.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0099002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:57.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:57.391 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:10:57.391 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:57.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009a002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:57.392 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x26ee7f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:57.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009b002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:57.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:57.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:10:57.401 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:57.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009c002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.401 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:57.401 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x26ee7f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:57.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009d002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:57.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ons) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:57.403 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.ons) [ CSSD]2013-05-23 11:10:57.403 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ons member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:57.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009e002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:57.404 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x2657e00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:57.482 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.482 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:57.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009f002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.555 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:57.555 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:57.555 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2659cc0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:10:57.555 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:57.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a0002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.560 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:57.560 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x2657e00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:57.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:57.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:10:58.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a1002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.923 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.923 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ons, member number 0 (0x26ee7f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:58.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.932 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.932 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a2002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.978 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.978 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x26583f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:58.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a3002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:58.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:58.980 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x2659cc0/_CRS_RDB) [ CSSD]2013-05-23 11:10:58.980 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:10:58.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:58.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a4002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.981 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:58.981 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:58.981 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:10:58.981 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:58.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a5002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.982 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.982 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:58.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a6002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:58.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:58.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:10:58.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:58.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a7002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.994 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.994 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:58.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a8002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.995 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:58.995 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.ASM2.asm) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:58.995 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.prod-rac02.ASM2.asm) [ CSSD]2013-05-23 11:10:58.995 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.ASM2.asm member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:58.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a9002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.996 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.996 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.ASM2.asm, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:58.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00aa002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:58.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.HWPROD.HWPROD2.inst) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:58.998 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26b6150/RES ora.HWPROD.HWPROD2.inst) [ CSSD]2013-05-23 11:10:58.998 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.HWPROD.HWPROD2.inst member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:58.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ab002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:58.999 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:58.999 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x2657e00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:59.062 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:59.063 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:10:59.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:10:59.107 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:10:59.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ac002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:59.152 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:59.152 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.DATABASES.hwprod) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:59.152 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2659cc0/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:10:59.152 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:10:59.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ad002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:59.165 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:10:59.165 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x2657e00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:10:59.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:10:59.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ae002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:59.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:59.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRD_2_HWPROD) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:10:59.353 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x2659cc0/ORA_CLSRD_2_HWPROD) [ CSSD]2013-05-23 11:10:59.353 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRD_2_HWPROD member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00af002a) incarnation(174631051) [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRD_2_HWPROD) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmAddMember: new master 0 for group(ORA_CLSRD_2_HWPROD) [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmAddMember: member (0/0x26ee7f0) added. pbsz(0) prsz(0) flags 0x0 to grock (0x26b6730/ORA_CLSRD_2_HWPROD) [ CSSD]2013-05-23 11:10:59.355 [1123510592] >TRACE: clssgmCommonAddMember: global group grock ORA_CLSRD_2_HWPROD member(0/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:10:59.361 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 1 [ CSSD]2013-05-23 11:10:59.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:10:59.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:00.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b0002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:00.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.DATABASES.hwprod) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:00.220 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2657480/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:11:00.220 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:00.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b1002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.224 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:00.224 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x268c410) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:00.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b2002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:00.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.DATABASES.hwprod) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:00.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2657480/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:11:00.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:00.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b3002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.276 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:00.276 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x268c410) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:00.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b4002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b5002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.770 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:00.770 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:00.771 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2657480/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:00.771 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:00.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b6002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:00.777 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:00.777 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268c410) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:00.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b7002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:01.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:01.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:01.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:03.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:03.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:03.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:04.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:04.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(556) tag(00b8002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(556) [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DGHWPROD) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmAddMember: member (1/0x268c410) added. pbsz(12) prsz(124) flags 0x0 to grock (0x2660990/DGHWPROD) [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD) count(2) master(0) event(1), incarn 10, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:04.471 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DGHWPROD member(1/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:04.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b9002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ba002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(556) tag(00bb002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(556) [ CSSD]2013-05-23 11:11:04.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DGHWPROD0) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:11:04.558 [1123510592] >TRACE: clssgmAddMember: member (1/0x26e1fa0) added. pbsz(12) prsz(124) flags 0x0 to grock (0x2661750/DGHWPROD0) [ CSSD]2013-05-23 11:11:04.559 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DGHWPROD0) count(2) master(0) event(1), incarn 10, mbrc 2, to member 0, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:04.559 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DGHWPROD0 member(1/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:04.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00bc002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00bd002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00be002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(553) tag(00bf002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(553) [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DBHWPROD) memberNo(1) node(2) type(2). [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmAddMember: member (1/0x266e910) added. pbsz(13) prsz(120) flags 0x0 to grock (0x26602b0/DBHWPROD) [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(DBHWPROD) count(2) master(0) event(1), incarn 12, mbrc 2, to member 0, events 0x68, state 0x0 [ CSSD]2013-05-23 11:11:04.831 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DBHWPROD member(1/Remote) node(2) flags 0x0 0x81a00 [ CSSD]2013-05-23 11:11:04.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c0002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(436) tag(00c1002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:04.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(436) [ CSSD]2013-05-23 11:11:04.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(DAALL_DB) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 11:11:04.836 [1123510592] >TRACE: clssgmAddMember: member (3/0x26aafe0) added. pbsz(16) prsz(0) flags 0x0 to grock (0x265dfe0/DAALL_DB) [ CSSD]2013-05-23 11:11:04.836 [1123510592] >TRACE: clssgmCommonAddMember: global group grock DAALL_DB member(3/Remote) node(2) flags 0x0 0x100 [ CSSD]2013-05-23 11:11:05.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c2002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:05.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c3002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:05.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:05.909 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dbbd0) allocated [ CSSD]2013-05-23 11:11:05.909 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:05.910 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dbbd0 - 1,2,3 [ CSSD]2013-05-23 11:11:05.910 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8c70) proc(0x7f82b42dbbd0) pid(8746) version 11:1:1:4 [ CSSD]2013-05-23 11:11:05.954 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42dbbd0), client(1/0x7f82b42dc130) [ CSSD]2013-05-23 11:11:05.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dc130) [ CSSD]2013-05-23 11:11:05.954 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x7f82b42dc130 with con 0x7f82b42db990, requested num -1 [ CSSD]2013-05-23 11:11:05.954 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:11:05.954 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc2a0/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:11:05.955 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:05.955 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:05.956 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dc130) [ CSSD]2013-05-23 11:11:05.956 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dc130), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:11:05.956 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc5a0) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:11:05.956 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x7f82b42dc5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:05.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:05.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42dbbd0), client(2/0x7f82b42c7b30) [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x7f82b42c7b30) [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x7f82b42c7b30 with con 0x7f82b42db990, requested num -1 [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc200/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:05.999 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:06.025 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x7f82b42c7b30) [ CSSD]2013-05-23 11:11:06.025 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x7f82b42c7b30), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:11:06.025 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc500) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:11:06.026 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x7f82b42dc500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c4002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IGHWPRODSYS$BACKGROUND) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmAddMember: member (2/0x2657480) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2661070/IGHWPRODSYS$BACKGROUND) [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$BACKGROUND) count(2) master(1) event(1), incarn 10, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:06.111 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODSYS$BACKGROUND member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c5002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IGHWPRODSYS$USERS) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmAddMember: member (2/0x2657640) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2658de0/IGHWPRODSYS$USERS) [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS$USERS) count(2) master(1) event(1), incarn 10, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:06.112 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODSYS$USERS member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:06.126 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dbbd0 [ CSSD]2013-05-23 11:11:06.126 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dbbd0) con(0x7f82b42c8c70) skgpid ospid 8746 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:06.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c6002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:06.359 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:06.359 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:06.359 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x26cdce0/_CRS_RDB) [ CSSD]2013-05-23 11:11:06.359 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:11:06.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c7002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:06.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:06.360 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x2698ea0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:07.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:07.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:07.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:08.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c8002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:09.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:09.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:09.126 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dbbd0) allocated [ CSSD]2013-05-23 11:11:09.128 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:11:09.128 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dbbd0 - 1,2,3 [ CSSD]2013-05-23 11:11:09.128 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8c70) proc(0x7f82b42dbbd0) pid(8865) version 11:1:1:4 [ CSSD]2013-05-23 11:11:09.135 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x7f82b42dbbd0), client(1/0x7f82b42dc200) [ CSSD]2013-05-23 11:11:09.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dc200) [ CSSD]2013-05-23 11:11:09.135 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42dc200 with con 0x7f82b42cae60, requested num -1 [ CSSD]2013-05-23 11:11:09.135 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:09.135 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc370/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:11:09.136 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:09.136 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:09.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df130) allocated [ CSSD]2013-05-23 11:11:09.143 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dc200) [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dc200), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc670) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc670) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df130 - 1,2,3 [ CSSD]2013-05-23 11:11:09.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cadb0) proc(0x7f82b42df130) pid(8864/8864) version 11:1:1:4 [ CSSD]2013-05-23 11:11:09.159 [1199044928] >TRACE: clssgmRegisterClient: proc(82/0x7f82b42df130), client(1/0x268c030) [ CSSD]2013-05-23 11:11:09.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268c030) [ CSSD]2013-05-23 11:11:09.159 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:11:09.159 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 51 [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268c030) [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268c030), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268c030), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 50 [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df130 [ CSSD]2013-05-23 11:11:09.317 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df130) con(0x7f82b42cadb0) skgpid 8864 ospid 8864 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:09.345 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dbbd0 [ CSSD]2013-05-23 11:11:09.345 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dbbd0) con(0x7f82b42c8c70) skgpid ospid 8865 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:09.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:09.377 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:09.706 [1199044928] >TRACE: clssgmAllocProc: (0x26e9530) allocated [ CSSD]2013-05-23 11:11:09.706 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:09.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e9530 - 1,2,3 [ CSSD]2013-05-23 11:11:09.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee5b0) proc(0x26e9530) pid(8938/8938) version 11:1:1:4 [ CSSD]2013-05-23 11:11:09.713 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x26e9530), client(1/0x268c030) [ CSSD]2013-05-23 11:11:09.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268c030) [ CSSD]2013-05-23 11:11:09.713 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:11:09.713 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 51 [ CSSD]2013-05-23 11:11:09.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:09.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:11.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:11.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:11.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:13.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:13.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:13.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:14.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:14.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:15.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c9002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:15.259 [1199044928] >TRACE: clssgmAllocProc: (0x26e1be0) allocated [ CSSD]2013-05-23 11:11:15.260 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:15.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1be0 - 1,2,3 [ CSSD]2013-05-23 11:11:15.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2657940) proc(0x26e1be0) pid(8986/8986) version 11:1:1:4 [ CSSD]2013-05-23 11:11:15.277 [1199044928] >TRACE: clssgmRegisterClient: proc(82/0x26e1be0), client(1/0x26916b0) [ CSSD]2013-05-23 11:11:15.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26916b0) [ CSSD]2013-05-23 11:11:15.277 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:11:15.277 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 52 [ CSSD]2013-05-23 11:11:15.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26916b0) [ CSSD]2013-05-23 11:11:15.293 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26916b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:11:15.293 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26916b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:15.293 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 51 [ CSSD]2013-05-23 11:11:15.293 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1be0 [ CSSD]2013-05-23 11:11:15.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1be0) con(0x2657940) skgpid 8986 ospid 8986 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:15.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ca002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:15.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:15.535 [1199044928] >TRACE: clssgmAllocProc: (0x26e4e80) allocated [ CSSD]2013-05-23 11:11:15.536 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:15.537 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4e80 - 1,2,3 [ CSSD]2013-05-23 11:11:15.537 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9350) proc(0x26e4e80) pid(8990/8990) version 11:1:1:4 [ CSSD]2013-05-23 11:11:15.553 [1199044928] >TRACE: clssgmRegisterClient: proc(82/0x26e4e80), client(1/0x26916b0) [ CSSD]2013-05-23 11:11:15.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26916b0) [ CSSD]2013-05-23 11:11:15.553 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:11:15.553 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 52 [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26916b0) [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26916b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26916b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 51 [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4e80 [ CSSD]2013-05-23 11:11:15.630 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4e80) con(0x26e9350) skgpid 8990 ospid 8990 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:16.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00cb002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:16.017 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:16.017 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:16.017 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:16.017 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:16.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00cc002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:16.024 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:16.024 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9350) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:16.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:16.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:17.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:18.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:18.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:18.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:18.119 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:11:18.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x264ffd0) [ CSSD]2013-05-23 11:11:18.767 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x264ffd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:11:18.767 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x264ffd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:18.767 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 50 [ CSSD]2013-05-23 11:11:18.768 [1199044928] >TRACE: clssgmDeadProc: proc 0x268f970 [ CSSD]2013-05-23 11:11:18.768 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268f970) con(0x26e1530) skgpid 2670 ospid 2670 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:19.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:19.592 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:20.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:20.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:21.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:22.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:22.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:23.123 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:23.123 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:23.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:24.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:24.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:24.380 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:11:24.381 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:11:24.382 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:11:24.382 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(9145) version 11:1:1:4 [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x2659ac0), client(1/0x26e9980) [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e9980 with con 0x25bd5e0, requested num -1 [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9af0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:24.388 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:24.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:11:24.395 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9980), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:11:24.395 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e9df0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:24.396 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e9df0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:24.598 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:11:24.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid ospid 9145 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:24.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cd002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:24.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ce002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:25.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:26.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:26.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:27.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:28.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:28.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:28.126 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:28.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:29.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:29.618 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:30.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:30.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00cf002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IGHWPRODALL) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmAddMember: member (2/0x2657940) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2661e30/IGHWPRODALL) [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODALL) count(2) master(1) event(1), incarn 10, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:31.161 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODALL member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:31.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d0002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:31.263 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:31.263 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:31.263 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:31.263 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:31.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d1002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:31.269 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:31.269 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x25bd510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d2002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IGHWPRODHWPRODXDB) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmAddMember: member (2/0x25bd510) added. pbsz(0) prsz(0) flags 0x0 to grock (0x2658700/IGHWPRODHWPRODXDB) [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPRODXDB) count(2) master(1) event(1), incarn 10, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:31.414 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODHWPRODXDB member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d3002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(IGHWPRODHWPROD) memberNo(2) node(2) type(2). [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmAddMember: member (2/0x26e9350) added. pbsz(0) prsz(0) flags 0x0 to grock (0x26564b0/IGHWPRODHWPROD) [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODHWPROD) count(2) master(1) event(1), incarn 10, mbrc 2, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 11:11:31.415 [1123510592] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODHWPROD member(2/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 11:11:31.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:32.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:32.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:33.129 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:33.129 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:33.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:34.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:34.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:34.430 [1199044928] >TRACE: clssgmAllocProc: (0x26e9980) allocated [ CSSD]2013-05-23 11:11:34.431 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:34.431 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e9980 - 1,2,3 [ CSSD]2013-05-23 11:11:34.431 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e9980) pid(9266/9266) version 11:1:1:4 [ CSSD]2013-05-23 11:11:34.448 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x26e9980), client(1/0x268fa20) [ CSSD]2013-05-23 11:11:34.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:34.448 [1199044928] >TRACE: clssgmRegisterShared: grp DG_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:11:34.448 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_DATA member 0 share type 1, refcount 8 [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268fa20), grp DG_DATA, member 0 [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268fa20), grp DG_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_DATA member 0 refcount is 7 [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e9980 [ CSSD]2013-05-23 11:11:34.548 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e9980) con(0x2660e70) skgpid 9266 ospid 9266 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:35.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:36.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:36.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:37.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:37.132 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:11:37.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:38.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:38.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:38.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d4002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:38.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d5002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:39.633 [1199044928] >TRACE: clssgmAllocProc: (0x26e9980) allocated [ CSSD]2013-05-23 11:11:39.634 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:11:39.635 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e9980 - 1,2,3 [ CSSD]2013-05-23 11:11:39.635 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e9980) pid(9304) version 11:1:1:4 [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x26e9980), client(1/0x268fa20) [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce190, requested num -1 [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:39.641 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:39.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:39.649 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:11:39.649 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:39.649 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:39.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:39.824 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:39.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e9980 [ CSSD]2013-05-23 11:11:39.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e9980) con(0x2660e70) skgpid ospid 9304 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:40.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:40.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:41.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:42.135 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:42.135 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:42.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:42.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:43.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:44.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:44.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:45.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac069750) [ CSSD]2013-05-23 11:11:45.330 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac069750), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:11:45.330 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac069750), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:11:45.330 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 49 [ CSSD]2013-05-23 11:11:45.331 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac068ab0 [ CSSD]2013-05-23 11:11:45.331 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac068ab0) con(0x7f82ac060070) skgpid 26315 ospid 26315 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:45.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:46.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:46.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:46.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d6002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:46.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:46.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:46.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:46.531 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:46.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d7002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:46.538 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:46.538 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264ff60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:47.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:47.138 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:47.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:48.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:48.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:49.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:49.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:50.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:50.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:51.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:52.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:52.142 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:52.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:52.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:53.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:54.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:54.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:54.785 [1199044928] >TRACE: clssgmAllocProc: (0x26e9980) allocated [ CSSD]2013-05-23 11:11:54.786 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:11:54.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e9980 - 1,2,3 [ CSSD]2013-05-23 11:11:54.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e9980) pid(9462) version 11:1:1:4 [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x26e9980), client(1/0x268fa20) [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce190, requested num -1 [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:54.794 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:54.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:54.802 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:11:54.802 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e9fb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:54.802 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e9fb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:54.886 [1199044928] >TRACE: clssgmAllocProc: (0x261bb80) allocated [ CSSD]2013-05-23 11:11:54.887 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:11:54.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bb80 - 1,2,3 [ CSSD]2013-05-23 11:11:54.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce010) proc(0x261bb80) pid(9470) version 11:1:1:4 [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x261bb80), client(1/0x268fa20) [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:11:54.893 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:54.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 11:11:54.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:11:54.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:11:54.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:11:55.005 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e9980 [ CSSD]2013-05-23 11:11:55.005 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e9980) con(0x2660e70) skgpid ospid 9462 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:55.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bb80 [ CSSD]2013-05-23 11:11:55.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bb80) con(0x26ce010) skgpid ospid 9470 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:11:55.512 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.513 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.640 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.721 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.721 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d8002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:55.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:55.763 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x261b8e0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:11:55.763 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:11:55.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d9002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.798 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:55.798 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:55.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00da002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.830 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:55.830 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.HWPROD.HWPROD2.inst, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:55.832 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00db002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:55.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(_CRS_RDB) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:55.832 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x26b6150/_CRS_RDB) [ CSSD]2013-05-23 11:11:55.832 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock _CRS_RDB member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:11:55.832 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00dc002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:55.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:55.833 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26911e0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:11:55.833 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:11:55.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00dd002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.834 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:55.834 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:55.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00de002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:55.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:55.860 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26911e0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:11:55.860 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:11:55.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00df002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:55.862 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:55.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e0002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:55.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(RES ora.prod-rac02.gsd) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:55.863 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x12) node(2) grock (0x26911e0/RES ora.prod-rac02.gsd) [ CSSD]2013-05-23 11:11:55.863 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock RES ora.prod-rac02.gsd member(0/Remote) node(2) flags 0x12 0x12 [ CSSD]2013-05-23 11:11:55.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e1002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:55.865 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:55.865 [1123510592] >TRACE: clssgmRemoveMember: grock _CRS_RDB, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:55.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:55.956 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:55.956 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:56.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e2002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.035 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:56.035 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:56.035 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:56.035 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:56.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e3002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.042 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:56.042 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:56.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:56.252 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:56.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e4002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.275 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:56.275 [1123510592] >TRACE: clssgmRemoveMember: grock RES ora.prod-rac02.gsd, member number 0 (0x26a6570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:56.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:56.277 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(249) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock CRSDMAIN, member 2 node 2, birth 7 [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmQueueGrockEvent: groupName(CRSDMAIN) count(2) master(1) event(6), incarn 2, mbrc 1, to member 1, events 0x8, state 0x0 [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e5002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:56.277 [1123510592] >TRACE: clssgmRemoveMember: grock _ORA_CRS_BOOT, member number 0 (0x7f82b42c8330) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:56.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:56.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:57.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:11:57.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:11:57.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:11:58.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:11:58.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:11:58.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e6002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:58.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:11:58.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:11:58.979 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:11:58.980 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:11:58.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e7002a) incarnation(174631051) [ CSSD]2013-05-23 11:11:58.987 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:11:58.987 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:11:59.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:11:59.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:00.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:00.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:00.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e8002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:00.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e9002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:00.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:00.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.DATABASES.hwprod) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:00.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:12:00.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:00.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ea002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:00.808 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:00.808 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:12:01.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00eb002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:01.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:01.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:01.779 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:12:01.779 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:01.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ec002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:01.786 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:01.786 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:12:01.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:02.148 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:02.148 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:02.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:02.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:03.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:04.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:04.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:05.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:06.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:06.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:07.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:07.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:07.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:08.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:08.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:09.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:12:09.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:10.139 [1199044928] >TRACE: clssgmAllocProc: (0x26ce010) allocated [ CSSD]2013-05-23 11:12:10.141 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:12:10.141 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce010 - 1,2,3 [ CSSD]2013-05-23 11:12:10.141 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x264ff60) proc(0x26ce010) pid(9657) version 11:1:1:4 [ CSSD]2013-05-23 11:12:10.147 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x26ce010), client(1/0x26b6210) [ CSSD]2013-05-23 11:12:10.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:10.147 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b6210 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 11:12:10.147 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:10.147 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:12:10.148 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:10.148 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:10.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:10.156 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b6210), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:12:10.156 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:10.156 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:10.359 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce010 [ CSSD]2013-05-23 11:12:10.359 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce010) con(0x264ff60) skgpid ospid 9657 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:10.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:10.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:11.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ed002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:11.203 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:12:11.204 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:11.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:12:11.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(9726) version 11:1:1:4 [ CSSD]2013-05-23 11:12:11.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:12.154 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:12.154 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:12.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:12.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:13.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:12:13.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid ospid 9726 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:13.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:14.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:14.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:16.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:16.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:16.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:17.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ee002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:17.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:17.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:17.027 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:12:17.027 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:17.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ef002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:17.033 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:17.033 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:12:17.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:17.157 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:18.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:18.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:18.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:19.947 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:12:20.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:20.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:20.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:21.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:21.159 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:12:21.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f0002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:22.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:22.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:22.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:24.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:24.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:24.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:25.231 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:12:25.232 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:25.232 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:12:25.232 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(10173) version 11:1:1:4 [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x2659ac0), client(1/0x26b6210) [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x26b6210 with con 0x26e4d00, requested num -1 [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9c20/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:25.285 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:25.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:25.287 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b6210), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:12:25.287 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce0e0) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:12:25.287 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x26ce0e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:25.329 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x2659ac0), client(2/0x26b6210) [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x26b6210) [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x26b6210 with con 0x26e4d00, requested num -1 [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9c20/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:25.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:25.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x26b6210) [ CSSD]2013-05-23 11:12:25.358 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x26b6210), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:12:25.358 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce0e0) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:12:25.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x26ce0e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:25.393 [1199044928] >TRACE: clssgmAllocProc: (0x26b6150) allocated [ CSSD]2013-05-23 11:12:25.394 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:12:25.394 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6150 - 1,2,3 [ CSSD]2013-05-23 11:12:25.394 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4d00) proc(0x26b6150) pid(10202) version 11:1:1:4 [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmRegisterClient: proc(81/0x26b6150), client(1/0x261c530) [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c530) [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c530 with con 0x26dee00, requested num -1 [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c6a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:25.400 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:25.407 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c530) [ CSSD]2013-05-23 11:12:25.407 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c530), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:12:25.407 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c9a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:25.407 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c9a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:25.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:12:25.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid ospid 10173 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:25.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6150 [ CSSD]2013-05-23 11:12:25.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6150) con(0x26e4d00) skgpid ospid 10202 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:26.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:26.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:26.161 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:26.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:26.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:28.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:28.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:28.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:29.986 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:12:30.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:30.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:30.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:31.163 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:31.164 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:31.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f1002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:32.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:32.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f2002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:32.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:32.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:32.276 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:12:32.276 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:32.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f3002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:32.283 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:32.283 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:12:32.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:32.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:34.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:34.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:34.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:36.166 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:36.166 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:36.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:36.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:36.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:38.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:38.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:38.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:40.009 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:12:40.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:40.646 [1199044928] >TRACE: clssgmAllocProc: (0x26ce010) allocated [ CSSD]2013-05-23 11:12:40.647 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:12:40.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce010 - 1,2,3 [ CSSD]2013-05-23 11:12:40.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x264ff60) proc(0x26ce010) pid(10366) version 11:1:1:4 [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x26ce010), client(1/0x26b6210) [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b6210 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:40.654 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:40.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b6210) [ CSSD]2013-05-23 11:12:40.662 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b6210), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:12:40.662 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:40.662 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:40.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:40.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:40.864 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce010 [ CSSD]2013-05-23 11:12:40.864 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce010) con(0x264ff60) skgpid ospid 10366 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:41.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:41.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:41.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f4002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:42.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:42.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:42.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac079b00) [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac079b00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac079b00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac079510 [ CSSD]2013-05-23 11:12:43.887 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac079510) con(0x7f82ac07e480) skgpid 2551 ospid 2551 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac07d8b0) [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac07d8b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac07d8b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d9e0 [ CSSD]2013-05-23 11:12:43.890 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d9e0) con(0x7f82ac06bfb0) skgpid 2553 ospid 2553 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:44.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:44.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:44.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:46.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:46.171 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:46.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:46.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:46.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:47.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f5002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:47.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:47.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:47.525 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:12:47.525 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:47.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f6002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:47.532 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:47.532 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:12:48.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:48.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:48.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:49.351 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:12:49.352 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:49.353 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:12:49.353 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(10474/10474) version 11:1:1:4 [ CSSD]2013-05-23 11:12:49.359 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x2659ac0), client(1/0x26b63e0) [ CSSD]2013-05-23 11:12:49.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b63e0) [ CSSD]2013-05-23 11:12:49.359 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:12:49.359 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:12:50.029 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:12:50.173 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:50.173 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:12:50.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:50.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:50.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:51.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f7002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:52.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:52.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:52.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:54.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:54.910 [1199044928] >TRACE: clssgmAllocProc: (0x261bfa0) allocated [ CSSD]2013-05-23 11:12:54.911 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:54.911 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bfa0 - 1,2,3 [ CSSD]2013-05-23 11:12:54.911 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9ef0) proc(0x261bfa0) pid(10519/10519) version 11:1:1:4 [ CSSD]2013-05-23 11:12:54.918 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x261bfa0), client(1/0x261c1c0) [ CSSD]2013-05-23 11:12:54.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 11:12:54.918 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:12:54.918 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:12:54.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:54.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c1c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c1c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bfa0 [ CSSD]2013-05-23 11:12:55.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bfa0) con(0x26e9ef0) skgpid 10519 ospid 10519 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:55.048 [1199044928] >TRACE: clssgmAllocProc: (0x26de920) allocated [ CSSD]2013-05-23 11:12:55.049 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:55.050 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de920 - 1,2,3 [ CSSD]2013-05-23 11:12:55.050 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9e20) proc(0x26de920) pid(10521) version 11:1:1:4 [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x26de920), client(1/0x26dee00) [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dee00) [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dee00 with con 0x26de800, requested num -1 [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c460/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:55.056 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:55.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dee00) [ CSSD]2013-05-23 11:12:55.063 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dee00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:12:55.063 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:55.063 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:55.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:12:55.176 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:12:55.261 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd30) allocated [ CSSD]2013-05-23 11:12:55.262 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:55.262 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd30 - 1,2,3 [ CSSD]2013-05-23 11:12:55.262 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261c1c0) proc(0x26cdd30) pid(10532/10532) version 11:1:1:4 [ CSSD]2013-05-23 11:12:55.265 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de920 [ CSSD]2013-05-23 11:12:55.265 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de920) con(0x26e9e20) skgpid ospid 10521 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:55.279 [1199044928] >TRACE: clssgmRegisterClient: proc(80/0x26cdd30), client(1/0x26dea80) [ CSSD]2013-05-23 11:12:55.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26dea80) [ CSSD]2013-05-23 11:12:55.279 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:12:55.279 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26dea80) [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26dea80), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26dea80), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd30 [ CSSD]2013-05-23 11:12:55.382 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd30) con(0x261c1c0) skgpid 10532 ospid 10532 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:55.598 [1199044928] >TRACE: clssgmAllocProc: (0x261bd60) allocated [ CSSD]2013-05-23 11:12:55.599 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:12:55.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bd60 - 1,2,3 [ CSSD]2013-05-23 11:12:55.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261c5a0) proc(0x261bd60) pid(10536/10536) version 11:1:1:4 [ CSSD]2013-05-23 11:12:55.606 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x261bd60), client(1/0x26cddd0) [ CSSD]2013-05-23 11:12:55.606 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 11:12:55.606 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:12:55.606 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 49 [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cddd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cddd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 48 [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bd60 [ CSSD]2013-05-23 11:12:55.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bd60) con(0x261c5a0) skgpid 10536 ospid 10536 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:55.898 [1199044928] >TRACE: clssgmAllocProc: (0x261bd60) allocated [ CSSD]2013-05-23 11:12:55.899 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:12:55.900 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bd60 - 1,2,3 [ CSSD]2013-05-23 11:12:55.900 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261c5a0) proc(0x261bd60) pid(10545) version 11:1:1:4 [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x261bd60), client(1/0x26de920) [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de920) [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de920 with con 0x261bc40, requested num -1 [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dea90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:12:55.906 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:55.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de920) [ CSSD]2013-05-23 11:12:55.913 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de920), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:12:55.913 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ded90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:12:55.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ded90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:12:56.116 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bd60 [ CSSD]2013-05-23 11:12:56.116 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bd60) con(0x261c5a0) skgpid ospid 10545 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:12:56.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:56.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:56.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:58.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:12:58.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:12:58.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:12:59.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f8002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:59.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:12:59.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:12:59.235 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e9980/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:12:59.235 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:12:59.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f9002a) incarnation(174631051) [ CSSD]2013-05-23 11:12:59.242 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:12:59.242 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6240) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:00.051 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:00.178 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:00.178 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:00.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:00.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:00.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:01.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fa002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:02.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:02.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fb002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:02.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:13:02.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:13:02.783 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e9a30/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:13:02.783 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:02.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fc002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:02.790 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:13:02.790 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6240) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:03.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:03.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:04.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:05.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:05.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:05.181 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:05.181 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:06.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:07.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:07.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:08.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:09.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:09.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:10.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:10.183 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:10.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:10.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:11.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:11.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:11.149 [1199044928] >TRACE: clssgmAllocProc: (0x261bfa0) allocated [ CSSD]2013-05-23 11:13:11.150 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:13:11.150 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bfa0 - 1,2,3 [ CSSD]2013-05-23 11:13:11.150 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9e40) proc(0x261bfa0) pid(10689) version 11:1:1:4 [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x261bfa0), client(1/0x26dedc0) [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dedc0) [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dedc0 with con 0x26ea080, requested num -1 [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650480/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:11.156 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:11.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dedc0) [ CSSD]2013-05-23 11:13:11.163 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dedc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:13:11.163 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650780) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:11.163 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650780) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:11.366 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bfa0 [ CSSD]2013-05-23 11:13:11.366 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bfa0) con(0x26e9e40) skgpid ospid 10689 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:11.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fd002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:12.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:13.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:13.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:14.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:15.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:15.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:15.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:15.186 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:16.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:17.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:17.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:18.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fe002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:18.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:13:18.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:13:18.039 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e9980/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:13:18.039 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:18.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ff002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:18.046 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:13:18.046 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6240) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:18.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:19.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:19.188 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:13:19.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:19.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b63e0) [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b63e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b63e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:13:19.461 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid 10474 ospid 10474 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:19.516 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:13:19.517 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:13:19.517 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:13:19.517 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(10806) version 11:1:1:4 [ CSSD]2013-05-23 11:13:19.523 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x2659ac0), client(1/0x26e9980) [ CSSD]2013-05-23 11:13:19.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:13:19.523 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26e9980 with con 0x26e4d00, requested num -1 [ CSSD]2013-05-23 11:13:19.523 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:13:19.523 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9af0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:13:19.524 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:19.524 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:19.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:13:19.530 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9980), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:13:19.530 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce1d0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:13:19.530 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26ce1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:19.628 [1199044928] >TRACE: clssgmAllocProc: (0x26b62d0) allocated [ CSSD]2013-05-23 11:13:19.629 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:13:19.629 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b62d0 - 1,2,3 [ CSSD]2013-05-23 11:13:19.629 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4de0) proc(0x26b62d0) pid(10811) version 11:1:1:4 [ CSSD]2013-05-23 11:13:19.644 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:13:19.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:13:19.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:13:19.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b62d0 [ CSSD]2013-05-23 11:13:19.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b62d0) con(0x26e4de0) skgpid ospid 10811 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:19.732 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:13:19.732 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid ospid 10806 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:20.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:20.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:21.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:21.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:21.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0100002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:22.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:23.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:23.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:24.190 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:24.190 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:24.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:25.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:25.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:26.405 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 11:13:26.406 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:13:26.406 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 11:13:26.406 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2659ac0) pid(10864) version 11:1:1:4 [ CSSD]2013-05-23 11:13:26.412 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x2659ac0), client(1/0x26e9980) [ CSSD]2013-05-23 11:13:26.412 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:13:26.412 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e9980 with con 0x26e4d00, requested num -1 [ CSSD]2013-05-23 11:13:26.412 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:26.412 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e9af0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:13:26.413 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:26.413 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:26.419 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e9980) [ CSSD]2013-05-23 11:13:26.419 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e9980), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:13:26.419 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce1d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:26.419 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:26.622 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 11:13:26.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2660e70) skgpid ospid 10864 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:26.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:27.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:27.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:28.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:29.192 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:29.193 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:29.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:29.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:30.132 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:30.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:31.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:31.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:31.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0101002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:32.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:33.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:33.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:33.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0102002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:33.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:13:33.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:13:33.284 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26b6150/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:13:33.284 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:33.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0103002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:33.290 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:13:33.290 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:34.195 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:34.195 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:34.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:35.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:35.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:36.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:37.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:37.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:38.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:39.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:39.198 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:39.378 [1199044928] >TRACE: clssgmAllocProc: (0x26ce010) allocated [ CSSD]2013-05-23 11:13:39.378 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:13:39.379 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce010 - 1,2,3 [ CSSD]2013-05-23 11:13:39.379 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x264ff60) proc(0x26ce010) pid(10991/10991) version 11:1:1:4 [ CSSD]2013-05-23 11:13:39.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:39.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:39.396 [1199044928] >TRACE: clssgmRegisterClient: proc(78/0x26ce010), client(1/0x26b63e0) [ CSSD]2013-05-23 11:13:39.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b63e0) [ CSSD]2013-05-23 11:13:39.396 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:13:39.396 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 48 [ CSSD]2013-05-23 11:13:40.154 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:40.781 [1199044928] >TRACE: clssgmAllocProc: (0x26de920) allocated [ CSSD]2013-05-23 11:13:40.782 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:13:40.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de920 - 1,2,3 [ CSSD]2013-05-23 11:13:40.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9d60) proc(0x26de920) pid(11020) version 11:1:1:4 [ CSSD]2013-05-23 11:13:40.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:41.390 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de920 [ CSSD]2013-05-23 11:13:41.390 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de920) con(0x26e9d60) skgpid ospid 11020 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:41.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:41.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:41.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0104002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:41.654 [1199044928] >TRACE: clssgmAllocProc: (0x26de920) allocated [ CSSD]2013-05-23 11:13:41.654 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:13:41.655 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de920 - 1,2,3 [ CSSD]2013-05-23 11:13:41.655 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9d60) proc(0x26de920) pid(11143) version 11:1:1:4 [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmRegisterClient: proc(79/0x26de920), client(1/0x261c1c0) [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c1c0 with con 0x26de800, requested num -1 [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:41.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:41.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c1c0) [ CSSD]2013-05-23 11:13:41.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c1c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:13:41.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c630) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:41.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c630) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:41.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de920 [ CSSD]2013-05-23 11:13:41.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de920) con(0x26e9d60) skgpid ospid 11143 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:42.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:43.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:43.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:44.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:44.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:44.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:45.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:45.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:46.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:47.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:47.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:48.202 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:48.202 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:13:48.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0105002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:48.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:13:48.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:13:48.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e9980/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:13:48.531 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:48.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0106002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:48.538 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:13:48.538 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6150) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:48.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b6a90) [ CSSD]2013-05-23 11:13:48.771 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b6a90), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:13:48.771 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b6a90), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.771 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 36 [ CSSD]2013-05-23 11:13:48.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac007350) [ CSSD]2013-05-23 11:13:48.774 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac007350), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:13:48.774 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac007350), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.774 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 35 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac073de0) [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac073de0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac073de0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 47 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0141d0) [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0141d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0141d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 46 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac074040 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac074040) con(0x7f82ac06dfe0) skgpid 3583 ospid 3583 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01f410 [ CSSD]2013-05-23 11:13:48.781 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01f410) con(0x7f82ac0159c0) skgpid 1640 ospid 1640 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eed10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eed10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 45 [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:13:48.783 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26ee0f0) skgpid 31814 ospid 31814 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:48.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 11:13:48.798 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:13:48.798 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.798 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 34 [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 44 [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0880e0 [ CSSD]2013-05-23 11:13:48.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0880e0) con(0x7f82ac0864e0) skgpid 5618 ospid 5618 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac086370) [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac086370), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac086370), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac085df0 [ CSSD]2013-05-23 11:13:48.805 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac085df0) con(0x7f82ac01f620) skgpid 5621 ospid 5621 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:48.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:49.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:49.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:50.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:13:50.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:51.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0107002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:51.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:51.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:52.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:53.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:53.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:53.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:53.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:54.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:55.310 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:13:55.311 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:13:55.311 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:13:55.311 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b6a30) proc(0x26eef20) pid(11348) version 11:1:1:4 [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26eef20), client(1/0x26a1fd0) [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:55.317 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:55.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:13:55.324 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a1fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:13:55.324 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6480) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:55.324 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b6480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:55.527 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:13:55.527 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26b6a30) skgpid ospid 11348 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:55.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:55.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:56.910 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:13:56.911 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:13:56.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:13:56.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26eef20) pid(11364) version 11:1:1:4 [ CSSD]2013-05-23 11:13:56.929 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26eef20), client(1/0x26a1fd0) [ CSSD]2013-05-23 11:13:56.929 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:13:56.929 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:13:56.929 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:56.929 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:13:56.930 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:13:56.930 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:56.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:13:56.936 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a1fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:13:56.936 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c1c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:13:56.936 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c1c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:13:57.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:57.139 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:13:57.139 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26ee500) skgpid ospid 11364 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:13:57.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:57.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:13:58.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:13:58.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:13:59.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:13:59.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0108002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:59.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:13:59.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:13:59.499 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:13:59.499 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:13:59.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0109002a) incarnation(174631051) [ CSSD]2013-05-23 11:13:59.506 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:13:59.506 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e4e90) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:13:59.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:13:59.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:00.196 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:01.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:01.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:01.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:01.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010a002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:03.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:03.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:03.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:03.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:03.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:03.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010b002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:03.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:14:03.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:14:03.777 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:14:03.777 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:03.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010c002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:03.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:14:03.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e4e90) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:14:05.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:05.062 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:14:05.062 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:05.063 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:14:05.063 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b6a30) proc(0x26eef20) pid(11469) version 11:1:1:4 [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26eef20), client(1/0x26a1fd0) [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c1c0/SRVM.DATABASE.DATABASES) [ CSSD]2013-05-23 11:14:05.119 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:05.120 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:05.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.121 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a1fd0), grock SRVM.DATABASE.DATABASES, member 0 [ CSSD]2013-05-23 11:14:05.121 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6480) in global grock SRVM.DATABASE.DATABASES [ CSSD]2013-05-23 11:14:05.121 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES, member number 0 (0x26b6480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26eef20), client(2/0x26a1fd0) [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.DATABASES.hwprod new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c830/SRVM.DATABASE.DATABASES.hwprod) [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.DATABASES.hwprod) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:05.165 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.DATABASES.hwprod member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:05.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.192 [1199044928] >TRACE: clssgmExitGrock: client 2 (0x26a1fd0), grock SRVM.DATABASE.DATABASES.hwprod, member 0 [ CSSD]2013-05-23 11:14:05.192 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c340) in global grock SRVM.DATABASE.DATABASES.hwprod [ CSSD]2013-05-23 11:14:05.192 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.DATABASES.hwprod, member number 0 (0x261c340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:05.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:14:05.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26b6a30) skgpid ospid 11469 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:05.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:05.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:05.662 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:14:05.663 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:05.663 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:14:05.663 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26eef20) pid(11510) version 11:1:1:4 [ CSSD]2013-05-23 11:14:05.792 [1199044928] >TRACE: clssgmAllocProc: (0x26cdc20) allocated [ CSSD]2013-05-23 11:14:05.792 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:05.793 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdc20 - 1,2,3 [ CSSD]2013-05-23 11:14:05.793 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b6610) proc(0x26cdc20) pid(11520) version 11:1:1:4 [ CSSD]2013-05-23 11:14:05.809 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:14:05.811 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:14:05.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdc20 [ CSSD]2013-05-23 11:14:05.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdc20) con(0x26b6610) skgpid ospid 11520 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:05.886 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5283/0x26a1fd0) [ CSSD]2013-05-23 11:14:05.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5283 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.886 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:14:05.887 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:14:05.887 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x261bd90/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:14:05.887 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:05.887 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:14:05.892 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5283 (0x26a1fd0) [ CSSD]2013-05-23 11:14:05.892 [1199044928] >TRACE: clssgmExitGrock: client 5283 (0x26a1fd0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:14:05.892 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26501e0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:14:05.893 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26501e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:05.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:14:05.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26ee500) skgpid ospid 11510 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:07.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:07.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:07.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:08.211 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:08.212 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:09.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:09.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:09.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:10.219 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:11.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:11.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010d002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:11.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:11.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:12.176 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:14:12.177 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:14:12.177 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:14:12.177 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26eef20) pid(11581) version 11:1:1:4 [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26eef20), client(1/0x26a1fd0) [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a1fd0 with con 0x26b6600, requested num -1 [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:12.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:12.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a1fd0) [ CSSD]2013-05-23 11:14:12.191 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a1fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:14:12.191 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c1c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:12.191 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c1c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:12.394 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:14:12.394 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26ee500) skgpid ospid 11581 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:13.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:13.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:13.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:13.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:13.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:15.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:15.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:15.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:17.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:17.216 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:14:17.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:17.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:17.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:19.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010e002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:19.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:14:19.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:14:19.034 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:14:19.034 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:19.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010f002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:19.041 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:14:19.041 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e4e90) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:14:19.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:19.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b63e0) [ CSSD]2013-05-23 11:14:19.429 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b63e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:14:19.429 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b63e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:14:19.429 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 11:14:19.430 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce010 [ CSSD]2013-05-23 11:14:19.430 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce010) con(0x264ff60) skgpid 10991 ospid 10991 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:19.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:19.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:20.253 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:21.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:21.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0110002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:21.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:21.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:22.218 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:22.218 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:23.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:23.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:23.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:25.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:25.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:25.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:27.221 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:27.221 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:27.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:27.427 [1199044928] >TRACE: clssgmAllocProc: (0x26a6540) allocated [ CSSD]2013-05-23 11:14:27.427 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:14:27.428 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a6540 - 1,2,3 [ CSSD]2013-05-23 11:14:27.428 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26a6540) pid(11750) version 11:1:1:4 [ CSSD]2013-05-23 11:14:27.444 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26a6540), client(1/0x26eebf0) [ CSSD]2013-05-23 11:14:27.444 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eebf0) [ CSSD]2013-05-23 11:14:27.444 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eebf0 with con 0x2691690, requested num -1 [ CSSD]2013-05-23 11:14:27.444 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:27.444 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:14:27.445 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:27.445 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:27.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eebf0) [ CSSD]2013-05-23 11:14:27.452 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eebf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:14:27.452 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:27.452 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:27.655 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a6540 [ CSSD]2013-05-23 11:14:27.655 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a6540) con(0x2660e70) skgpid ospid 11750 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:27.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:27.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:29.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:29.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:29.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:30.274 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:31.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:31.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0111002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:31.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:31.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:32.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:32.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:33.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:33.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:33.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:34.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0112002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:34.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:14:34.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:14:34.291 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:14:34.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:34.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0113002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:34.298 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:14:34.298 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e9440) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:14:35.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:35.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:35.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:37.225 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:37.226 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:37.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:37.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:37.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:39.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:39.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:39.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:40.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:41.042 [1199044928] >TRACE: clssgmAllocProc: (0x26a6540) allocated [ CSSD]2013-05-23 11:14:41.043 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:41.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a6540 - 1,2,3 [ CSSD]2013-05-23 11:14:41.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26a6540) pid(11900/11900) version 11:1:1:4 [ CSSD]2013-05-23 11:14:41.060 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26a6540), client(1/0x268f8a0) [ CSSD]2013-05-23 11:14:41.060 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268f8a0) [ CSSD]2013-05-23 11:14:41.060 [1199044928] >TRACE: clssgmRegisterShared: grp DG_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:14:41.060 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_DATA member 0 share type 1, refcount 8 [ CSSD]2013-05-23 11:14:41.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:41.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0114002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:41.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:41.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:42.228 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:42.228 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:42.697 [1199044928] >TRACE: clssgmAllocProc: (0x26dec80) allocated [ CSSD]2013-05-23 11:14:42.698 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:14:42.698 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dec80 - 1,2,3 [ CSSD]2013-05-23 11:14:42.698 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26dec80) pid(11919) version 11:1:1:4 [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26dec80), client(1/0x261cb10) [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x26ef0a0, requested num -1 [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:42.705 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:42.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 11:14:42.713 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:14:42.713 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:42.713 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:42.915 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dec80 [ CSSD]2013-05-23 11:14:42.915 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dec80) con(0x268fa10) skgpid ospid 11919 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:43.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:43.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:43.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:45.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:45.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:45.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:46.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:46.230 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:14:47.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:47.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:47.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:49.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:49.446 [1199044928] >TRACE: clssgmAllocProc: (0x26dec80) allocated [ CSSD]2013-05-23 11:14:49.447 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:49.447 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dec80 - 1,2,3 [ CSSD]2013-05-23 11:14:49.447 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eebf0) proc(0x26dec80) pid(12010/12010) version 11:1:1:4 [ CSSD]2013-05-23 11:14:49.463 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x26dec80), client(1/0x26ef0a0) [ CSSD]2013-05-23 11:14:49.463 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0a0) [ CSSD]2013-05-23 11:14:49.463 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:14:49.463 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 11:14:49.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0115002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:49.538 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:14:49.539 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:14:49.539 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x261bcc0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:14:49.539 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:49.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0116002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:49.546 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:14:49.546 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x261c1c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:14:49.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:49.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:50.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:14:51.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:51.233 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:51.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:51.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0117002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:52.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:52.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:53.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:54.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:54.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:55.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:55.568 [1199044928] >TRACE: clssgmAllocProc: (0x261cab0) allocated [ CSSD]2013-05-23 11:14:55.569 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:14:55.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261cab0 - 1,2,3 [ CSSD]2013-05-23 11:14:55.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261c500) proc(0x261cab0) pid(12057) version 11:1:1:4 [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x261cab0), client(1/0x266f6e0) [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f6e0) [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f6e0 with con 0x266f630, requested num -1 [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:55.586 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:55.594 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f6e0) [ CSSD]2013-05-23 11:14:55.594 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f6e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:14:55.594 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:55.594 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:55.796 [1199044928] >TRACE: clssgmDeadProc: proc 0x261cab0 [ CSSD]2013-05-23 11:14:55.796 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261cab0) con(0x261c500) skgpid ospid 12057 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:56.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:56.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:56.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:14:56.235 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:14:57.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:57.949 [1199044928] >TRACE: clssgmAllocProc: (0x261cab0) allocated [ CSSD]2013-05-23 11:14:57.950 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:14:57.950 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261cab0 - 1,2,3 [ CSSD]2013-05-23 11:14:57.950 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261c500) proc(0x261cab0) pid(12084) version 11:1:1:4 [ CSSD]2013-05-23 11:14:57.956 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x261cab0), client(1/0x266f6e0) [ CSSD]2013-05-23 11:14:57.956 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f6e0) [ CSSD]2013-05-23 11:14:57.956 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f6e0 with con 0x266f630, requested num -1 [ CSSD]2013-05-23 11:14:57.956 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:57.956 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:14:57.957 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:14:57.957 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:57.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f6e0) [ CSSD]2013-05-23 11:14:57.963 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f6e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:14:57.963 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:14:57.964 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:14:58.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:14:58.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:14:58.166 [1199044928] >TRACE: clssgmDeadProc: proc 0x261cab0 [ CSSD]2013-05-23 11:14:58.166 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261cab0) con(0x261c500) skgpid ospid 12084 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:14:59.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:14:59.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0118002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:59.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:14:59.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:14:59.746 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x261bcc0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:14:59.746 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:14:59.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0119002a) incarnation(174631051) [ CSSD]2013-05-23 11:14:59.753 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:14:59.753 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x261c1c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:00.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:00.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:00.334 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:01.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:01.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:01.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:01.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011a002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:02.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:02.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:03.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:04.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:04.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:04.621 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:15:04.622 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:15:04.622 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:15:04.622 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x266f580) pid(12178/12178) version 11:1:1:4 [ CSSD]2013-05-23 11:15:04.639 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x266f580), client(1/0x268bbc0) [ CSSD]2013-05-23 11:15:04.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268bbc0) [ CSSD]2013-05-23 11:15:04.639 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:15:04.639 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 11:15:04.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011b002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:04.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:04.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:04.795 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x2695a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:15:04.795 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:04.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011c002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:04.802 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:04.802 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268b940) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268bbc0) [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268bbc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268bbc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:15:04.978 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x268fa10) skgpid 12178 ospid 12178 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:05.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:06.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:06.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:06.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:06.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:07.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:08.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:08.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:09.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:10.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:10.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:10.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:11.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:11.243 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:11.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:11.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011d002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:12.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:12.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:13.198 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:15:13.199 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:15:13.200 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:15:13.200 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x266f580) pid(12238) version 11:1:1:4 [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x266f580), client(1/0x268bd40) [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bd40) [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bd40 with con 0x261cab0, requested num -1 [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695a90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:15:13.206 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:13.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bd40) [ CSSD]2013-05-23 11:15:13.213 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bd40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:15:13.213 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2695d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:13.213 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2695d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:15:13.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:15:13.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x268fa10) skgpid ospid 12238 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:13.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:13.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac004b40) [ CSSD]2013-05-23 11:15:13.901 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac004b40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:15:13.901 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac004b40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.901 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 33 [ CSSD]2013-05-23 11:15:13.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26a2070) [ CSSD]2013-05-23 11:15:13.904 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26a2070), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:15:13.904 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26a2070), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.904 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 32 [ CSSD]2013-05-23 11:15:13.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0171e0) [ CSSD]2013-05-23 11:15:13.908 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0171e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:15:13.908 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0171e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.909 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 11:15:13.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0174a0 [ CSSD]2013-05-23 11:15:13.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0174a0) con(0x7f82ac024a10) skgpid 11657 ospid 11657 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26959f0) [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26959f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26959f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a1200 [ CSSD]2013-05-23 11:15:13.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a1200) con(0x26a5f90) skgpid 31146 ospid 31146 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:13.938 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:15:13.938 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:15:13.938 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.938 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 31 [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:15:13.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 6128 ospid 6128 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:14.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:14.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:15.245 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:15.245 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:15:15.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:16.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:16.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:17.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:18.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:18.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:19.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0a0) [ CSSD]2013-05-23 11:15:19.508 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:15:19.508 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:15:19.508 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:15:19.509 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dec80 [ CSSD]2013-05-23 11:15:19.509 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dec80) con(0x26eebf0) skgpid 12010 ospid 12010 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:19.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:20.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011e002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:20.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:20.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:20.053 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:15:20.053 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:20.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011f002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:20.060 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:20.060 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26eeb30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:20.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:20.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:20.375 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:20.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:20.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:21.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:21.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0120002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:22.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:22.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:23.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:24.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:24.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:25.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:25.250 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:25.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:26.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:26.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:27.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:28.448 [1199044928] >TRACE: clssgmAllocProc: (0x26a67c0) allocated [ CSSD]2013-05-23 11:15:28.449 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:15:28.450 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a67c0 - 1,2,3 [ CSSD]2013-05-23 11:15:28.450 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eeb30) proc(0x26a67c0) pid(12384) version 11:1:1:4 [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26a67c0), client(1/0x261cb10) [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x26ef0a0, requested num -1 [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:15:28.456 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:28.463 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 11:15:28.463 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:15:28.463 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650ae0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:28.463 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650ae0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:15:28.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:28.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:28.665 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a67c0 [ CSSD]2013-05-23 11:15:28.665 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a67c0) con(0x26eeb30) skgpid ospid 12384 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:29.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:30.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:30.253 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:30.406 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:30.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:30.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:31.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:31.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0121002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:32.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:32.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:33.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:34.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:34.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:35.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:35.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:35.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0122002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:35.310 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:35.310 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:35.310 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:15:35.310 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:35.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0123002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:35.318 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:35.318 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26eeb30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:35.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:36.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:36.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:37.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:38.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:38.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:39.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:40.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:40.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:40.436 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:40.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:40.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:41.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0124002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:41.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:42.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:42.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:43.698 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:15:43.699 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:15:43.699 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:15:43.699 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26eef20) pid(12535) version 11:1:1:4 [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26eef20), client(1/0x261bf20) [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bf20) [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bf20 with con 0x26ce190, requested num -1 [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:15:43.716 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:43.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bf20) [ CSSD]2013-05-23 11:15:43.724 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bf20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:15:43.724 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:43.724 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:15:43.926 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:15:43.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x268fa10) skgpid ospid 12535 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:43.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:44.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:44.260 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:15:44.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:44.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:46.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:46.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:46.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:48.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:48.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:48.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:49.262 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:49.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:49.495 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:15:49.496 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:15:49.496 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:15:49.496 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26eef20) pid(12617/12617) version 11:1:1:4 [ CSSD]2013-05-23 11:15:49.512 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26eef20), client(1/0x26a6a20) [ CSSD]2013-05-23 11:15:49.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a6a20) [ CSSD]2013-05-23 11:15:49.512 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:15:49.512 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:15:50.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:50.456 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:15:50.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0125002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:50.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:50.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:50.558 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:15:50.558 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:50.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0126002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:50.564 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:50.564 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26a67c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:50.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:50.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:51.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0127002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:52.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:52.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:52.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:54.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:54.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:54.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:54.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:54.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:55.839 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:15:55.840 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:15:55.841 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:15:55.841 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bd90) proc(0x266f580) pid(12660) version 11:1:1:4 [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x266f580), client(1/0x267cea0) [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267cea0 with con 0x26cdcf0, requested num -1 [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:15:55.847 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:55.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:15:55.854 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267cea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:15:55.854 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:55.854 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:15:56.056 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:15:56.056 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x261bd90) skgpid ospid 12660 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:56.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:56.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:56.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:58.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:15:58.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:15:58.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:15:58.969 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:15:58.970 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:15:58.970 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:15:58.970 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261be70) proc(0x266f580) pid(12690) version 11:1:1:4 [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x266f580), client(1/0x267cea0) [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267cea0 with con 0x26cdcf0, requested num -1 [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:15:58.982 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:58.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:15:58.990 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267cea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:15:58.990 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:15:58.990 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:15:59.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0128002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:59.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:59.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:59.015 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26cdb70/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:15:59.015 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:59.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0129002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:59.021 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:59.021 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x267cbb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:15:59.147 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:15:59.147 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:15:59.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:15:59.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:15:59.193 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:15:59.193 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x261be70) skgpid ospid 12690 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:15:59.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:15:59.267 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:15:59.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012a002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:59.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:15:59.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:15:59.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x261bd90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:15:59.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:15:59.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012b002a) incarnation(174631051) [ CSSD]2013-05-23 11:15:59.998 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:15:59.998 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26a6890) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:00.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:00.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:00.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:00.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:01.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012c002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:02.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:02.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:02.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:04.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:04.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:04.270 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:04.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:04.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:05.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012d002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:05.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:16:05.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:16:05.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:16:05.808 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:05.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012e002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:05.813 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:16:05.814 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26a67c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:06.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:06.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:06.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:08.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:08.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:08.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:09.272 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:09.272 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:10.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:10.546 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:10.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:10.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:11.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012f002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:12.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:12.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:12.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:13.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:13.274 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:16:14.225 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:16:14.226 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:16:14.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:16:14.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261be70) proc(0x266f580) pid(12829) version 11:1:1:4 [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x266f580), client(1/0x267cea0) [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267cea0 with con 0x26cdcf0, requested num -1 [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:16:14.232 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:14.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267cea0) [ CSSD]2013-05-23 11:16:14.239 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267cea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:16:14.239 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:14.240 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:16:14.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:14.442 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:16:14.442 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x261be70) skgpid ospid 12829 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:14.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:14.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:15.995 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:16:15.996 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:16:15.997 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:16:15.997 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261be70) proc(0x266f580) pid(12884/12884) version 11:1:1:4 [ CSSD]2013-05-23 11:16:16.013 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x266f580), client(1/0x267cd20) [ CSSD]2013-05-23 11:16:16.013 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267cd20) [ CSSD]2013-05-23 11:16:16.013 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:16:16.013 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267cd20) [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267cd20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267cd20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:16:16.031 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x261be70) skgpid 12884 ospid 12884 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:16.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:16.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:16.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:18.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:18.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:18.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:18.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 11:16:18.819 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:16:18.819 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:16:18.820 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 11:16:18.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:16:18.824 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:16:18.824 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:16:18.824 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:16:18.825 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b38d0 [ CSSD]2013-05-23 11:16:18.825 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b38d0) con(0x7f82b42bad40) skgpid 6642 ospid 6642 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:18.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:18.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:19.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a6a20) [ CSSD]2013-05-23 11:16:19.565 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a6a20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:16:19.565 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a6a20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:16:19.565 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:16:19.566 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:16:19.566 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x268fa10) skgpid 12617 ospid 12617 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:20.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:20.657 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:20.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:20.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:21.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0130002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:21.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:16:21.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:16:21.054 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:16:21.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:21.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0131002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:21.060 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:16:21.060 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26eeb30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:21.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0132002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:22.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:22.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:22.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:23.279 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:23.279 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:24.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:24.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:24.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:26.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:26.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:26.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:28.145 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 11:16:28.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:16:28.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 11:16:28.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26eef20) pid(12926/12926) version 11:1:1:4 [ CSSD]2013-05-23 11:16:28.162 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26eef20), client(1/0x261bcc0) [ CSSD]2013-05-23 11:16:28.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261bcc0) [ CSSD]2013-05-23 11:16:28.162 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:16:28.162 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:16:28.282 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:28.282 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:28.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:28.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:28.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:29.476 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd00) allocated [ CSSD]2013-05-23 11:16:29.476 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:16:29.477 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd00 - 1,2,3 [ CSSD]2013-05-23 11:16:29.477 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6960) proc(0x26cdd00) pid(12999) version 11:1:1:4 [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdd00), client(1/0x267d060) [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d060) [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d060 with con 0x266f630, requested num -1 [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d1d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:16:29.493 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:29.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d060) [ CSSD]2013-05-23 11:16:29.500 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d060), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:16:29.500 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d4d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:29.500 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d4d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:16:29.703 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd00 [ CSSD]2013-05-23 11:16:29.703 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd00) con(0x26a6960) skgpid ospid 12999 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:30.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:30.677 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:31.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:31.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:32.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0133002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:32.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:33.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:33.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:33.284 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:33.284 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:34.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:35.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:35.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:36.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0134002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:36.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:16:36.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:16:36.301 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:16:36.301 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:36.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0135002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:36.307 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:16:36.307 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26a6950) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:36.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:37.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:37.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:38.115 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26eef20), client(2/0x26a6940) [ CSSD]2013-05-23 11:16:38.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26a6940) [ CSSD]2013-05-23 11:16:38.115 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:16:38.115 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 11:16:38.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:38.287 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:38.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:39.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:39.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:40.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:40.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:41.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:41.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:42.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0136002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:42.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:43.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:43.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:43.289 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:43.289 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:44.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:44.747 [1199044928] >TRACE: clssgmAllocProc: (0x26cdc60) allocated [ CSSD]2013-05-23 11:16:44.748 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:16:44.749 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdc60 - 1,2,3 [ CSSD]2013-05-23 11:16:44.749 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd6b0) proc(0x26cdc60) pid(13164) version 11:1:1:4 [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdc60), client(1/0x2650bb0) [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650bb0 with con 0x266f6d0, requested num -1 [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:16:44.756 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:44.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650bb0) [ CSSD]2013-05-23 11:16:44.762 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650bb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:16:44.762 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bd30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:44.762 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bd30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:16:44.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdc60 [ CSSD]2013-05-23 11:16:44.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdc60) con(0x26cd6b0) skgpid ospid 13164 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:45.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:45.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:46.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:47.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:47.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:48.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:48.292 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:48.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:49.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:49.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:49.539 [1199044928] >TRACE: clssgmAllocProc: (0x26cdaf0) allocated [ CSSD]2013-05-23 11:16:49.540 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:16:49.540 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdaf0 - 1,2,3 [ CSSD]2013-05-23 11:16:49.540 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd610) proc(0x26cdaf0) pid(13236/13236) version 11:1:1:4 [ CSSD]2013-05-23 11:16:49.557 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdaf0), client(1/0x267d660) [ CSSD]2013-05-23 11:16:49.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d660) [ CSSD]2013-05-23 11:16:49.557 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:16:49.557 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:16:50.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:50.728 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:16:51.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:51.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:51.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0137002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:51.548 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:16:51.548 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:16:51.548 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:16:51.548 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:51.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0138002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:51.555 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:16:51.555 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268ba30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:52.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0139002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:52.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:53.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:53.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:53.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:53.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:54.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:55.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:55.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:55.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:16:56.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:16:56.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:16:56.002 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:16:56.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013a002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:56.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:16:56.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:16:56.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x26e1090/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:16:56.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:16:56.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013b002a) incarnation(174631051) [ CSSD]2013-05-23 11:16:56.088 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:16:56.088 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x268ba30) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:16:56.104 [1199044928] >TRACE: clssgmAllocProc: (0x2678fe0) allocated [ CSSD]2013-05-23 11:16:56.104 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:16:56.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fe0 - 1,2,3 [ CSSD]2013-05-23 11:16:56.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bd50) proc(0x2678fe0) pid(13288) version 11:1:1:4 [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2678fe0), client(1/0x267c0d0) [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0d0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c240/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:16:56.112 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:16:56.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:16:56.119 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:16:56.119 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:16:56.119 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:16:56.321 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fe0 [ CSSD]2013-05-23 11:16:56.321 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fe0) con(0x268bd50) skgpid ospid 13288 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:16:56.623 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:57.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:57.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:58.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:16:58.297 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:16:58.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:16:59.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:16:59.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:16:59.994 [1199044928] >TRACE: clssgmAllocProc: (0x2678fe0) allocated [ CSSD]2013-05-23 11:16:59.995 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:16:59.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fe0 - 1,2,3 [ CSSD]2013-05-23 11:16:59.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bd50) proc(0x2678fe0) pid(13326) version 11:1:1:4 [ CSSD]2013-05-23 11:17:00.002 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2678fe0), client(1/0x267c0d0) [ CSSD]2013-05-23 11:17:00.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:00.002 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0d0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:17:00.002 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:00.002 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c240/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:00.003 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:00.003 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:00.009 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:00.009 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:00.009 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:00.009 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:00.212 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fe0 [ CSSD]2013-05-23 11:17:00.212 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fe0) con(0x268bd50) skgpid ospid 13326 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:00.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013c002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:00.240 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:17:00.240 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:17:00.240 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:17:00.240 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:00.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013d002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:00.248 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:17:00.248 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268b940) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:17:00.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:00.749 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:01.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:01.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:01.545 [1199044928] >TRACE: clssgmAllocProc: (0x2678fe0) allocated [ CSSD]2013-05-23 11:17:01.545 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:17:01.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fe0 - 1,2,3 [ CSSD]2013-05-23 11:17:01.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bd50) proc(0x2678fe0) pid(13376) version 11:1:1:4 [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2678fe0), client(1/0x267c0d0) [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0d0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c240/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:01.552 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:01.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:01.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:01.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:01.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:01.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fe0 [ CSSD]2013-05-23 11:17:01.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fe0) con(0x268bd50) skgpid ospid 13376 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:02.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013e002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:02.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:03.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:03.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:03.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:03.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:04.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:05.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:05.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:06.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:06.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013f002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:06.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:17:06.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:17:06.800 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:17:06.800 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:06.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0140002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:06.807 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:17:06.807 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268b940) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:17:07.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:07.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:08.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:08.302 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:08.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:09.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:09.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:10.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:10.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:11.110 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 11:17:11.111 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:17:11.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 11:17:11.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268baf0) proc(0x26790b0) pid(13492) version 11:1:1:4 [ CSSD]2013-05-23 11:17:11.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:11.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:12.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0141002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:12.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:13.304 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:13.305 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:13.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:13.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:14.235 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 11:17:14.235 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x268baf0) skgpid ospid 13492 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:14.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:15.245 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 11:17:15.245 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:17:15.246 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 11:17:15.246 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268baf0) proc(0x26790b0) pid(13817) version 11:1:1:4 [ CSSD]2013-05-23 11:17:15.262 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26790b0), client(1/0x267c0d0) [ CSSD]2013-05-23 11:17:15.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:15.262 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0d0 with con 0x2678fd0, requested num -1 [ CSSD]2013-05-23 11:17:15.262 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:15.262 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c240/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:15.263 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:15.263 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:15.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0d0) [ CSSD]2013-05-23 11:17:15.269 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:15.269 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:15.270 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:15.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:15.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:15.472 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 11:17:15.472 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x268baf0) skgpid ospid 13817 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:16.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:17.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:17.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:18.307 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:18.307 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:18.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:19.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:19.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d660) [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d660), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d660), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdaf0 [ CSSD]2013-05-23 11:17:19.611 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdaf0) con(0x26cd610) skgpid 13236 ospid 13236 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:20.789 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:20.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:21.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:21.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:22.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0142002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:22.048 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:17:22.048 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:17:22.048 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26507e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:17:22.048 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:22.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0143002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:22.056 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:17:22.056 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26cd2d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:17:22.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0144002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:22.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:23.309 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:23.310 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:23.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:23.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:24.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:25.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:25.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:26.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:27.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:27.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:28.312 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:28.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:28.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:29.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:29.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:30.505 [1199044928] >TRACE: clssgmAllocProc: (0x26cdaf0) allocated [ CSSD]2013-05-23 11:17:30.506 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:17:30.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdaf0 - 1,2,3 [ CSSD]2013-05-23 11:17:30.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd610) proc(0x26cdaf0) pid(14002) version 11:1:1:4 [ CSSD]2013-05-23 11:17:30.512 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdaf0), client(1/0x268bc60) [ CSSD]2013-05-23 11:17:30.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bc60) [ CSSD]2013-05-23 11:17:30.512 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bc60 with con 0x266f6d0, requested num -1 [ CSSD]2013-05-23 11:17:30.513 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:30.513 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:30.513 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:30.513 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:30.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bc60) [ CSSD]2013-05-23 11:17:30.519 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bc60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:30.519 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d4e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:30.519 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d4e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:30.722 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdaf0 [ CSSD]2013-05-23 11:17:30.722 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdaf0) con(0x26cd610) skgpid ospid 14002 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:30.809 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:30.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:31.054 [1199044928] >TRACE: clssgmAllocProc: (0x26cdab0) allocated [ CSSD]2013-05-23 11:17:31.055 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:17:31.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdab0 - 1,2,3 [ CSSD]2013-05-23 11:17:31.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e18b0) proc(0x26cdab0) pid(14051) version 11:1:1:4 [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdab0), client(1/0x267cd20) [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267cd20) [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267cd20 with con 0x26cddc0, requested num -1 [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267ce90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:31.072 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:31.079 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267cd20) [ CSSD]2013-05-23 11:17:31.079 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267cd20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:31.079 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d190) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:31.079 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d190) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:31.282 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdab0 [ CSSD]2013-05-23 11:17:31.282 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdab0) con(0x26e18b0) skgpid ospid 14051 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:31.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:31.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:32.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0145002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:32.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:33.314 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:33.315 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:33.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:33.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:34.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:35.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:35.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:36.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:37.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0146002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:37.300 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:17:37.300 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:17:37.300 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26cd2d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:17:37.300 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:37.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0147002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:37.307 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:17:37.307 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26507e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:17:37.316 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:37.317 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:17:37.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:37.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:38.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:39.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:39.764 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:40.830 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:41.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:41.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:41.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:42.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0148002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:42.319 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:42.319 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:43.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:43.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:43.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:43.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d8f40) [ CSSD]2013-05-23 11:17:43.947 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d8f40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:17:43.947 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d8f40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.947 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 11:17:43.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 11:17:43.949 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4286810), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:17:43.949 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4286810), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.949 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:17:43.950 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429dac0) skgpid 6121 ospid 6121 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:43.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:17:43.951 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:17:43.951 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.951 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:17:43.952 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 11:17:43.952 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b41fdf40) skgpid 6119 ospid 6119 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:43.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9690) [ CSSD]2013-05-23 11:17:43.952 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9690), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:17:43.952 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9690), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.953 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 11:17:43.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cbf30) skgpid 8017 ospid 8017 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:45.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:45.757 [1199044928] >TRACE: clssgmAllocProc: (0x26cdc90) allocated [ CSSD]2013-05-23 11:17:45.758 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:17:45.759 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdc90 - 1,2,3 [ CSSD]2013-05-23 11:17:45.759 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650ba0) proc(0x26cdc90) pid(14166) version 11:1:1:4 [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cdc90), client(1/0x26cddc0) [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cddc0 with con 0x266f6d0, requested num -1 [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:45.765 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:45.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 11:17:45.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cddc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:45.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d410) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:45.773 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:45.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:45.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:45.975 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdc90 [ CSSD]2013-05-23 11:17:45.975 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdc90) con(0x2650ba0) skgpid ospid 14166 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:47.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:47.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:47.322 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:47.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:47.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:49.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:49.590 [1199044928] >TRACE: clssgmAllocProc: (0x26cdc90) allocated [ CSSD]2013-05-23 11:17:49.590 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:17:49.591 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdc90 - 1,2,3 [ CSSD]2013-05-23 11:17:49.591 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650ba0) proc(0x26cdc90) pid(14239/14239) version 11:1:1:4 [ CSSD]2013-05-23 11:17:49.607 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cdc90), client(1/0x26cddc0) [ CSSD]2013-05-23 11:17:49.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 11:17:49.607 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:17:49.607 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:17:49.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:49.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:50.850 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:17:51.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:51.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:51.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:52.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0149002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:52.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:52.324 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:52.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014a002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:52.548 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:17:52.548 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:17:52.548 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:17:52.548 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:52.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014b002a) incarnation(174631051) [ CSSD]2013-05-23 11:17:52.556 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:17:52.556 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:17:53.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:53.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:53.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:55.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:55.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:55.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:56.357 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:17:56.358 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:17:56.359 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:17:56.359 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14292) version 11:1:1:4 [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678fd0), client(1/0x267c0c0) [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0c0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:17:56.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:17:56.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:17:56.383 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:17:56.383 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:17:56.383 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:17:56.587 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:17:56.587 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid ospid 14292 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:17:57.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:57.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:17:57.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:17:57.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:57.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:17:59.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:17:59.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:17:59.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:00.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014c002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:00.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:18:00.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:18:00.488 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:18:00.488 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:00.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014d002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:00.496 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:18:00.496 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:18:00.880 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:01.009 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:18:01.010 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:18:01.011 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:18:01.011 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14330) version 11:1:1:4 [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678fd0), client(1/0x267c0c0) [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0c0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:01.027 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:01.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:01.035 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:18:01.035 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:01.035 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:01.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:01.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:18:01.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid ospid 14330 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:01.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:01.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:02.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014e002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:02.329 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:02.329 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:03.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:03.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:03.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:05.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:05.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:05.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:06.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:06.331 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:18:07.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:07.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014f002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:07.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:18:07.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:18:07.798 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:18:07.798 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:07.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0150002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:07.805 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:18:07.805 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:18:07.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:07.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:09.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:09.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:09.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:10.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:11.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:11.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:11.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:11.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:11.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:12.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0151002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:13.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:13.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:13.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:15.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:15.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:15.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:16.288 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:18:16.289 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:18:16.290 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:18:16.290 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14474) version 11:1:1:4 [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678fd0), client(1/0x267c0c0) [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0c0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:16.296 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:16.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:16.303 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:18:16.303 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:16.304 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:16.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:16.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:16.506 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:18:16.506 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid ospid 14474 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:17.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:17.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:17.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:19.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:19.808 [1199044928] >TRACE: clssgmAllocProc: (0x26790a0) allocated [ CSSD]2013-05-23 11:18:19.809 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:19.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790a0 - 1,2,3 [ CSSD]2013-05-23 11:18:19.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bae0) proc(0x26790a0) pid(14545) version 11:1:1:4 [ CSSD]2013-05-23 11:18:19.816 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790a0), client(1/0x267bff0) [ CSSD]2013-05-23 11:18:19.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:18:19.817 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x267bff0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:18:19.817 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:18:19.817 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c160/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:18:19.817 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:19.817 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:19.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:18:19.825 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bff0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:18:19.825 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c460) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:18:19.825 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x267c460) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:19.935 [1199044928] >TRACE: clssgmAllocProc: (0x269ad10) allocated [ CSSD]2013-05-23 11:18:19.936 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:19.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269ad10 - 1,2,3 [ CSSD]2013-05-23 11:18:19.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bb90) proc(0x269ad10) pid(14550) version 11:1:1:4 [ CSSD]2013-05-23 11:18:19.952 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:18:19.954 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:18:19.956 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:18:19.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x269ad10 [ CSSD]2013-05-23 11:18:19.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269ad10) con(0x268bb90) skgpid ospid 14550 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:19.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:19.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:20.027 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790a0 [ CSSD]2013-05-23 11:18:20.027 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790a0) con(0x268bae0) skgpid ospid 14545 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:20.930 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:21.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:21.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:21.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:21.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:21.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:22.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0152002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:23.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0153002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:23.057 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:18:23.057 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:18:23.057 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:18:23.057 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:23.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0154002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:23.064 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:18:23.064 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:18:23.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:23.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:23.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:25.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:26.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:26.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:26.341 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:26.342 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:27.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:28.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:28.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:28.847 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:18:28.848 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:28.849 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:18:28.849 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14619/14619) version 11:1:1:4 [ CSSD]2013-05-23 11:18:28.865 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678fd0), client(1/0x267bf30) [ CSSD]2013-05-23 11:18:28.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267bf30) [ CSSD]2013-05-23 11:18:28.865 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:18:28.865 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:18:28.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267bf30) [ CSSD]2013-05-23 11:18:28.903 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267bf30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:18:28.903 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267bf30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:18:28.903 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:18:28.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:18:28.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid 14619 ospid 14619 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:29.095 [1199044928] >TRACE: clssgmAllocProc: (0x2678f00) allocated [ CSSD]2013-05-23 11:18:29.095 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:29.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f00 - 1,2,3 [ CSSD]2013-05-23 11:18:29.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678f00) pid(14622/14622) version 11:1:1:4 [ CSSD]2013-05-23 11:18:29.112 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678f00), client(1/0x267be70) [ CSSD]2013-05-23 11:18:29.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267be70) [ CSSD]2013-05-23 11:18:29.113 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:18:29.113 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267be70) [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267be70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267be70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f00 [ CSSD]2013-05-23 11:18:29.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f00) con(0x267d5a0) skgpid 14622 ospid 14622 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:29.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:30.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:30.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:30.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:30.344 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:18:30.951 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:31.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:31.541 [1199044928] >TRACE: clssgmAllocProc: (0x26790a0) allocated [ CSSD]2013-05-23 11:18:31.541 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:18:31.542 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790a0 - 1,2,3 [ CSSD]2013-05-23 11:18:31.542 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bae0) proc(0x26790a0) pid(14650) version 11:1:1:4 [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790a0), client(1/0x267bff0) [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267bff0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c160/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:31.548 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:31.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:18:31.555 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bff0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:18:31.555 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c460) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:31.555 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c460) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:31.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790a0 [ CSSD]2013-05-23 11:18:31.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790a0) con(0x268bae0) skgpid ospid 14650 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:32.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:32.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:32.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0155002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:33.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:34.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:34.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:35.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:35.346 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:35.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:36.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:36.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:37.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:38.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:38.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:38.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0156002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:38.305 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:18:38.305 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:18:38.305 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:18:38.305 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:38.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0157002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:38.313 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:18:38.313 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:18:39.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:40.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:40.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:40.348 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:40.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:40.725 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:18:40.726 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:40.726 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:18:40.726 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14766) version 11:1:1:4 [ CSSD]2013-05-23 11:18:40.990 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:41.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:18:41.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid ospid 14766 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:41.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:42.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:42.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:42.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0158002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:43.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:44.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:44.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:45.351 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:45.351 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:45.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:46.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:46.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:46.790 [1199044928] >TRACE: clssgmAllocProc: (0x2678fd0) allocated [ CSSD]2013-05-23 11:18:46.791 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:18:46.792 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fd0 - 1,2,3 [ CSSD]2013-05-23 11:18:46.792 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fd0) pid(14957) version 11:1:1:4 [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678fd0), client(1/0x267c0c0) [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0c0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:46.798 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:46.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0c0) [ CSSD]2013-05-23 11:18:46.805 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:18:46.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:46.805 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:47.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fd0 [ CSSD]2013-05-23 11:18:47.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fd0) con(0x267d5a0) skgpid ospid 14957 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:47.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:48.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:48.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:48.828 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207f20) [ CSSD]2013-05-23 11:18:48.828 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207f20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:18:48.828 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207f20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:18:48.828 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 11:18:48.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42aee50) [ CSSD]2013-05-23 11:18:48.831 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42aee50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:18:48.831 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42aee50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:18:48.831 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d410 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d410) con(0x7f82b42be650) skgpid 6644 ospid 6644 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb50 [ CSSD]2013-05-23 11:18:48.835 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb50) con(0x7f82b429ec20) skgpid 6630 ospid 6630 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:49.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:50.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:50.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:50.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:50.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:51.012 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:18:51.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:52.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:52.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:52.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0159002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:53.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015a002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:53.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:18:53.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:18:53.554 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:18:53.554 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:53.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015b002a) incarnation(174631051) [ CSSD]2013-05-23 11:18:53.562 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:18:53.562 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:18:53.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:54.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:54.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:55.355 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:18:55.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:18:55.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:56.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:56.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:56.631 [1199044928] >TRACE: clssgmAllocProc: (0x2678fc0) allocated [ CSSD]2013-05-23 11:18:56.632 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:18:56.632 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fc0 - 1,2,3 [ CSSD]2013-05-23 11:18:56.632 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fc0) pid(15069) version 11:1:1:4 [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678fc0), client(1/0x267c0b0) [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0b0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:18:56.638 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:18:56.645 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:18:56.645 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:18:56.645 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:18:56.645 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:18:56.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fc0 [ CSSD]2013-05-23 11:18:56.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fc0) con(0x267d5a0) skgpid ospid 15069 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:18:57.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:18:58.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:18:58.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:18:59.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:00.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:00.358 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:00.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:00.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:00.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015c002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:00.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:19:00.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:19:00.755 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:19:00.755 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:00.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015d002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:00.762 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:19:00.762 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:19:01.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:01.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:02.044 [1199044928] >TRACE: clssgmAllocProc: (0x2679090) allocated [ CSSD]2013-05-23 11:19:02.045 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:19:02.045 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679090 - 1,2,3 [ CSSD]2013-05-23 11:19:02.045 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bae0) proc(0x2679090) pid(15116) version 11:1:1:4 [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2679090), client(1/0x267bff0) [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267bff0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c160/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:02.051 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:02.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bff0) [ CSSD]2013-05-23 11:19:02.058 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bff0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:19:02.058 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c460) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:02.058 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c460) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:02.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679090 [ CSSD]2013-05-23 11:19:02.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679090) con(0x268bae0) skgpid ospid 15116 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:02.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:02.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:02.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015e002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:03.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:04.360 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:04.360 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:19:04.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:04.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:05.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:05.974 [1199044928] >TRACE: clssgmAllocProc: (0x2679090) allocated [ CSSD]2013-05-23 11:19:05.975 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:19:05.975 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679090 - 1,2,3 [ CSSD]2013-05-23 11:19:05.975 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bae0) proc(0x2679090) pid(15188) version 11:1:1:4 [ CSSD]2013-05-23 11:19:06.107 [1199044928] >TRACE: clssgmAllocProc: (0x269a8e0) allocated [ CSSD]2013-05-23 11:19:06.108 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:19:06.108 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a8e0 - 1,2,3 [ CSSD]2013-05-23 11:19:06.108 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bb90) proc(0x269a8e0) pid(15198) version 11:1:1:4 [ CSSD]2013-05-23 11:19:06.127 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:19:06.128 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:19:06.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a8e0 [ CSSD]2013-05-23 11:19:06.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a8e0) con(0x268bb90) skgpid ospid 15198 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5284/0x267c580) [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5284 (0x267c580) [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x267c580 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x267bcf0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:06.208 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:19:06.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5284 (0x267c580) [ CSSD]2013-05-23 11:19:06.213 [1199044928] >TRACE: clssgmExitGrock: client 5284 (0x267c580), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:19:06.213 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bff0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:19:06.214 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x267bff0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:06.215 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679090 [ CSSD]2013-05-23 11:19:06.215 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679090) con(0x268bae0) skgpid ospid 15188 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:06.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:06.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:07.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:08.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:08.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:08.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015f002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:08.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:19:08.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:19:08.805 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:19:08.805 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:08.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0160002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:08.813 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:19:08.813 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:19:09.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:09.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:09.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:10.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:10.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:11.061 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:11.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:12.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:12.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:12.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0161002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:13.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:14.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:14.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:14.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:14.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:15.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:16.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:16.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:17.297 [1199044928] >TRACE: clssgmAllocProc: (0x2678fc0) allocated [ CSSD]2013-05-23 11:19:17.298 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:19:17.298 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fc0 - 1,2,3 [ CSSD]2013-05-23 11:19:17.298 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fc0) pid(15285) version 11:1:1:4 [ CSSD]2013-05-23 11:19:17.304 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678fc0), client(1/0x267c0b0) [ CSSD]2013-05-23 11:19:17.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:19:17.305 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0b0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:19:17.305 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:17.305 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:19:17.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:17.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:17.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:19:17.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:19:17.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:17.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:17.514 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fc0 [ CSSD]2013-05-23 11:19:17.514 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fc0) con(0x267d5a0) skgpid ospid 15285 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:17.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:18.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:18.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:19.367 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:19.367 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:19.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:20.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:20.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:21.083 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:21.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:22.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0162002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:22.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:22.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:23.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:24.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0163002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:24.065 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:19:24.065 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:19:24.065 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:19:24.065 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:24.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0164002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:24.073 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:19:24.073 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:19:24.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:24.370 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:24.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:24.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:26.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:26.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:26.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:28.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:28.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:28.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:29.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:29.372 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:30.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:30.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:30.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:31.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:32.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:32.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0165002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:32.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:32.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:32.550 [1199044928] >TRACE: clssgmAllocProc: (0x2678fc0) allocated [ CSSD]2013-05-23 11:19:32.551 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:19:32.552 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678fc0 - 1,2,3 [ CSSD]2013-05-23 11:19:32.552 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678fc0) pid(15448) version 11:1:1:4 [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678fc0), client(1/0x267c0b0) [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0b0 with con 0x2678f00, requested num -1 [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:32.558 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:32.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 11:19:32.565 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:19:32.565 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678d80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:32.566 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678d80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:32.768 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678fc0 [ CSSD]2013-05-23 11:19:32.768 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678fc0) con(0x267d5a0) skgpid ospid 15448 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:33.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:33.374 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:19:34.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:34.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:34.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:36.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:36.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:36.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:38.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:38.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:38.377 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:38.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:38.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:39.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0166002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:39.325 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:19:39.325 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:19:39.325 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:19:39.325 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:39.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0167002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:39.332 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:19:39.332 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x268bd10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:19:40.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:40.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:40.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:41.143 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268f8a0) [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268f8a0), grp DG_DATA, member 0 [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268f8a0), grp DG_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_DATA member 0 refcount is 7 [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a6540 [ CSSD]2013-05-23 11:19:42.282 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a6540) con(0x2660e70) skgpid 11900 ospid 11900 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:42.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:42.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0168002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:42.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:42.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:43.379 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:43.379 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:44.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:44.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:44.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:46.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:46.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:46.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:47.800 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:19:47.801 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:19:47.801 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:19:47.801 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(15620) version 11:1:1:4 [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:47.808 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:47.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:19:47.815 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:19:47.815 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:47.815 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:48.018 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:19:48.018 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 15620 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:48.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:48.381 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:48.382 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:48.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:48.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:50.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:50.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:50.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:51.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:19:52.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:52.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0169002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:52.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:52.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:53.384 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:53.384 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:54.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:54.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016a002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:54.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:19:54.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:19:54.573 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:19:54.573 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:54.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016b002a) incarnation(174631051) [ CSSD]2013-05-23 11:19:54.580 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:19:54.580 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264ff60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:19:54.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:54.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:56.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:56.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:56.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:19:56.890 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:19:56.891 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:19:56.892 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:19:56.892 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(15729) version 11:1:1:4 [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:19:56.908 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:19:56.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:19:56.916 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:19:56.916 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:19:56.916 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:19:57.119 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:19:57.119 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 15729 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:19:58.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:19:58.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:19:58.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:19:58.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:19:58.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:00.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:00.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:00.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:01.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016c002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:01.001 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:01.001 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:01.001 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:01.001 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:01.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016d002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:01.009 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:01.009 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264ff60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:01.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:02.388 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:02.389 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:20:02.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:02.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016e002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:02.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:02.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:03.053 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:20:03.054 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:20:03.054 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:20:03.054 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(15964) version 11:1:1:4 [ CSSD]2013-05-23 11:20:03.060 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:20:03.060 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:20:03.060 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:20:03.060 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:03.060 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:20:03.061 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:20:03.061 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:03.067 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:20:03.067 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:20:03.067 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:03.067 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:20:03.269 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:20:03.269 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 15964 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:04.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:04.508 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:20:04.509 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:20:04.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:20:04.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(16016/16016) version 11:1:1:4 [ CSSD]2013-05-23 11:20:04.526 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2650970), client(1/0x26ee500) [ CSSD]2013-05-23 11:20:04.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 11:20:04.526 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:20:04.526 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:20:04.803 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid 16016 ospid 16016 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:04.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:04.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:06.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:06.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:06.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:07.391 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:07.391 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:08.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:08.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:08.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:09.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016f002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:09.830 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:09.830 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:09.830 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:09.830 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:09.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0170002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:09.837 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:09.837 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x264ff60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:10.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:10.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:10.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:11.203 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:12.394 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:12.394 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:12.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:12.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0171002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:12.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:12.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:13.962 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d91c0) [ CSSD]2013-05-23 11:20:13.962 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d91c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:20:13.962 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d91c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:20:13.962 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cf710) [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cf710), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cf710), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf180 [ CSSD]2013-05-23 11:20:13.968 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf180) con(0x7f82b4203ea0) skgpid 8019 ospid 8019 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:14.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:14.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:14.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:16.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:16.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:16.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:17.396 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:17.396 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:18.303 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:20:18.303 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:20:18.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:20:18.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(16111) version 11:1:1:4 [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:20:18.321 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:18.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:20:18.329 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:20:18.329 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:18.329 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:20:18.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:20:18.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 16111 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:18.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:18.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:18.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:20.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:21.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:21.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:21.170 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:20:21.171 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:20:21.172 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:20:21.172 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(16083/16083) version 11:1:1:4 [ CSSD]2013-05-23 11:20:21.188 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:20:21.188 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:20:21.188 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:20:21.188 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 11:20:21.223 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:22.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:22.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:22.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0172002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:22.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:23.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:23.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:24.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:25.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:25.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:25.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0173002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:25.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:25.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:25.090 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:25.090 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:25.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0174002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:25.097 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:25.097 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:26.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:27.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:27.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:27.401 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:27.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:28.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:29.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:29.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:30.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:31.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:31.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:31.234 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:32.404 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:32.404 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:32.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0175002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:32.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:33.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:33.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:33.564 [1199044928] >TRACE: clssgmAllocProc: (0x2679080) allocated [ CSSD]2013-05-23 11:20:33.565 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:20:33.565 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679080 - 1,2,3 [ CSSD]2013-05-23 11:20:33.565 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2679080) pid(16269) version 11:1:1:4 [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2679080), client(1/0x2678fd0) [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fd0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:20:33.582 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:33.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:20:33.590 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:20:33.590 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:33.590 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:20:33.792 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679080 [ CSSD]2013-05-23 11:20:33.792 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679080) con(0x2660e70) skgpid ospid 16269 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:34.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:35.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:35.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:36.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:37.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:37.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:37.406 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:37.407 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:38.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:39.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:39.199 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:40.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0176002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:40.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:40.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:40.338 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:40.339 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:40.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0177002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:40.345 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:40.345 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:40.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:41.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:41.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:41.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:42.409 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:42.409 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:42.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0178002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:42.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:43.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:43.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:44.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:45.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:45.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:46.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0179002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:46.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:46.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:46.368 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:46.368 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:46.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017a002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:46.376 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:46.377 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:46.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:47.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:47.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:47.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:47.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:48.826 [1199044928] >TRACE: clssgmAllocProc: (0x2679080) allocated [ CSSD]2013-05-23 11:20:48.827 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:20:48.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679080 - 1,2,3 [ CSSD]2013-05-23 11:20:48.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2679080) pid(16426) version 11:1:1:4 [ CSSD]2013-05-23 11:20:48.833 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2679080), client(1/0x2678fd0) [ CSSD]2013-05-23 11:20:48.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:20:48.833 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fd0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:20:48.833 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:48.833 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:20:48.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:20:48.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:48.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:20:48.840 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:20:48.840 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:48.840 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:20:48.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:49.042 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679080 [ CSSD]2013-05-23 11:20:49.042 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679080) con(0x2660e70) skgpid ospid 16426 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:49.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:49.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:50.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:51.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:51.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:51.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:20:52.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:52.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:52.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017b002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:52.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:53.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:53.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:54.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:55.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:55.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:55.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017c002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:55.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:55.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:55.588 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:20:55.588 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:55.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017d002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:55.596 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:55.596 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:57.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:57.167 [1199044928] >TRACE: clssgmAllocProc: (0x2679080) allocated [ CSSD]2013-05-23 11:20:57.168 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:20:57.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679080 - 1,2,3 [ CSSD]2013-05-23 11:20:57.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268bb90) proc(0x2679080) pid(16526) version 11:1:1:4 [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2679080), client(1/0x267c0a0) [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0a0) [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0a0 with con 0x2678fd0, requested num -1 [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:20:57.174 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:57.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0a0) [ CSSD]2013-05-23 11:20:57.181 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:20:57.181 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:20:57.181 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:20:57.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:57.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:57.383 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679080 [ CSSD]2013-05-23 11:20:57.383 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679080) con(0x268bb90) skgpid ospid 16526 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:20:57.416 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:20:57.417 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:20:59.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:20:59.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017e002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:59.279 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:20:59.279 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:20:59.279 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:20:59.279 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:20:59.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017f002a) incarnation(174631051) [ CSSD]2013-05-23 11:20:59.287 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:20:59.287 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:20:59.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:20:59.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:20:59.416 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:20:59.417 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:20:59.419 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:20:59.419 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:21:01.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:01.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0180002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:01.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:01.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:01.270 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:01.270 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:01.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0181002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:01.277 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:01.277 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:01.306 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:01.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:01.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:02.419 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:02.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:02.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0182002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:03.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:03.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:03.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:04.093 [1199044928] >TRACE: clssgmAllocProc: (0x2679080) allocated [ CSSD]2013-05-23 11:21:04.094 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:21:04.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2679080 - 1,2,3 [ CSSD]2013-05-23 11:21:04.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2679080) pid(16586) version 11:1:1:4 [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2679080), client(1/0x2678fd0) [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fd0 with con 0x268bb90, requested num -1 [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:21:04.100 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:04.107 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fd0) [ CSSD]2013-05-23 11:21:04.107 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:21:04.107 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:04.107 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:21:04.310 [1199044928] >TRACE: clssgmDeadProc: proc 0x2679080 [ CSSD]2013-05-23 11:21:04.310 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2679080) con(0x2660e70) skgpid ospid 16586 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:05.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:05.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:05.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:07.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:07.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:07.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:07.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:07.421 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:09.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:09.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:09.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:10.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0183002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:10.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:10.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:10.839 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:10.839 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:10.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0184002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:10.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:10.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26b6b00) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:11.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:11.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:11.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:11.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:12.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:12.423 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:12.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0185002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:13.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:13.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:13.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:13.549 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2650970), client(2/0x268bac0) [ CSSD]2013-05-23 11:21:13.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x268bac0) [ CSSD]2013-05-23 11:21:13.549 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:21:13.549 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 11:21:15.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:15.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:15.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:15.582 [1199044928] >TRACE: clssgmAllocProc: (0x267be50) allocated [ CSSD]2013-05-23 11:21:15.583 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:21:15.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267be50 - 1,2,3 [ CSSD]2013-05-23 11:21:15.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1850) proc(0x267be50) pid(16748/16748) version 11:1:1:4 [ CSSD]2013-05-23 11:21:15.599 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x267be50), client(1/0x26e12f0) [ CSSD]2013-05-23 11:21:15.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e12f0) [ CSSD]2013-05-23 11:21:15.599 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:21:15.599 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e12f0) [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e12f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e12f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x267be50 [ CSSD]2013-05-23 11:21:15.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267be50) con(0x26e1850) skgpid 16748 ospid 16748 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:17.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:17.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:17.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:17.426 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:17.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:19.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:19.346 [1199044928] >TRACE: clssgmAllocProc: (0x267bf20) allocated [ CSSD]2013-05-23 11:21:19.347 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:21:19.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bf20 - 1,2,3 [ CSSD]2013-05-23 11:21:19.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1920) proc(0x267bf20) pid(16781) version 11:1:1:4 [ CSSD]2013-05-23 11:21:19.354 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x267bf20), client(1/0x26e1220) [ CSSD]2013-05-23 11:21:19.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1220) [ CSSD]2013-05-23 11:21:19.354 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1220 with con 0x267be70, requested num -1 [ CSSD]2013-05-23 11:21:19.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:19.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269d8f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:21:19.355 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:21:19.355 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:19.362 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1220) [ CSSD]2013-05-23 11:21:19.362 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1220), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:21:19.362 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269dbf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:19.362 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269dbf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:21:19.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:19.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:19.565 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bf20 [ CSSD]2013-05-23 11:21:19.565 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bf20) con(0x26e1920) skgpid ospid 16781 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:21.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:21.352 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:21.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:21.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:22.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:22.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:22.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0186002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:23.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:23.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:23.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:25.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:25.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:25.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:26.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0187002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:26.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:26.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:26.087 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26e1390/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:26.087 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:26.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0188002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:26.094 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:26.094 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x26e1180) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:27.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:27.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:27.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:27.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:27.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:29.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:29.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:29.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:30.916 [1199044928] >TRACE: clssgmAllocProc: (0x267be50) allocated [ CSSD]2013-05-23 11:21:30.916 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:21:30.917 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267be50 - 1,2,3 [ CSSD]2013-05-23 11:21:30.917 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1790) proc(0x267be50) pid(16779/16779) version 11:1:1:4 [ CSSD]2013-05-23 11:21:30.933 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x267be50), client(1/0x267bdb0) [ CSSD]2013-05-23 11:21:30.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267bdb0) [ CSSD]2013-05-23 11:21:30.933 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:21:30.933 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:21:31.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:31.373 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:31.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:31.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:32.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:32.433 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:32.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0189002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:33.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:33.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:33.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:34.600 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 11:21:34.601 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:21:34.602 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 11:21:34.602 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dc00) proc(0x269e7b0) pid(16943) version 11:1:1:4 [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7b0), client(1/0x269b6a0) [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:21:34.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:34.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:21:34.615 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:21:34.615 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:34.615 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:21:34.818 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 11:21:34.818 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x269dc00) skgpid ospid 16943 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:35.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:35.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:35.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:37.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:37.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:37.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:37.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:37.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:39.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:39.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:39.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:41.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018a002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:41.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:41.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:41.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:41.337 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:41.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018b002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:41.345 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:41.345 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:41.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:41.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:41.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:42.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:42.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:42.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:42.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018c002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:43.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:43.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:43.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:45.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:45.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:45.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:47.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:47.440 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:47.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:47.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:47.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:49.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:49.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:49.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:49.856 [1199044928] >TRACE: clssgmAllocProc: (0x269e7c0) allocated [ CSSD]2013-05-23 11:21:49.856 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:21:49.857 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7c0 - 1,2,3 [ CSSD]2013-05-23 11:21:49.857 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c470) proc(0x269e7c0) pid(17086) version 11:1:1:4 [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7c0), client(1/0x267c300) [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c300 with con 0x269ec10, requested num -1 [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:21:49.863 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:49.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:21:49.870 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c300), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:21:49.870 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:49.870 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:21:50.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7c0 [ CSSD]2013-05-23 11:21:50.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7c0) con(0x267c470) skgpid ospid 17086 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:51.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:51.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:51.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:52.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:52.443 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:52.828 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:21:52.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018d002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:53.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:53.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:53.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:55.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:55.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:55.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:56.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:21:56.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:21:56.295 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:21:56.296 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:21:56.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018e002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.329 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:56.329 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:56.329 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:56.329 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:56.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018f002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.336 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:56.336 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:56.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0190002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.373 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:56.373 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:56.373 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x269d820/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:21:56.373 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:21:56.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0191002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:56.382 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:56.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0192002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:21:56.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:21:56.589 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:21:56.589 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:56.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0193002a) incarnation(174631051) [ CSSD]2013-05-23 11:21:56.597 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:21:56.597 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:21:57.427 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 11:21:57.428 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:21:57.428 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 11:21:57.428 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dc00) proc(0x269e7b0) pid(17187) version 11:1:1:4 [ CSSD]2013-05-23 11:21:57.434 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7b0), client(1/0x269b6a0) [ CSSD]2013-05-23 11:21:57.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:21:57.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 11:21:57.435 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:57.435 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:21:57.435 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:21:57.435 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:21:57.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:21:57.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:21:57.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:21:57.442 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:21:57.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:21:57.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:21:57.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:57.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:57.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:21:57.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 11:21:57.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x269dc00) skgpid ospid 17187 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:21:59.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:21:59.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:21:59.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:01.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0194002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:01.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:22:01.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:22:01.530 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:22:01.530 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:01.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0195002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:01.537 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:22:01.537 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:22:01.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:01.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:01.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:02.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:02.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:02.850 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:02.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0196002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:03.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:03.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:03.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:05.106 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 11:22:05.107 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:22:05.108 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 11:22:05.108 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dc00) proc(0x269e7b0) pid(17263) version 11:1:1:4 [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7b0), client(1/0x269b6a0) [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:22:05.114 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:05.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:22:05.121 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:22:05.121 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:05.121 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:22:05.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 11:22:05.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x269dc00) skgpid ospid 17263 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:05.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:05.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:05.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:07.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:07.451 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:07.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:07.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:07.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:09.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:09.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:09.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:11.371 [1199044928] >TRACE: clssgmAllocProc: (0x269e7c0) allocated [ CSSD]2013-05-23 11:22:11.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:22:11.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7c0 - 1,2,3 [ CSSD]2013-05-23 11:22:11.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c470) proc(0x269e7c0) pid(17382) version 11:1:1:4 [ CSSD]2013-05-23 11:22:11.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:11.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:11.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:11.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0197002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:11.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:22:11.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:22:11.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26ce330/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:22:11.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:11.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0198002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:11.844 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:22:11.844 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x269b610) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:22:12.453 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:12.454 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:12.874 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:12.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0199002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:13.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:13.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:13.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:13.954 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7c0 [ CSSD]2013-05-23 11:22:13.954 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7c0) con(0x267c470) skgpid ospid 17382 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:15.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:15.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:15.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:17.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:17.456 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:17.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:17.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:17.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:19.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:19.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:19.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:20.366 [1199044928] >TRACE: clssgmAllocProc: (0x269e7c0) allocated [ CSSD]2013-05-23 11:22:20.367 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:22:20.368 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7c0 - 1,2,3 [ CSSD]2013-05-23 11:22:20.368 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c470) proc(0x269e7c0) pid(17762) version 11:1:1:4 [ CSSD]2013-05-23 11:22:20.384 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7c0), client(1/0x267c300) [ CSSD]2013-05-23 11:22:20.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:22:20.384 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c300 with con 0x269ec10, requested num -1 [ CSSD]2013-05-23 11:22:20.384 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:20.384 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:22:20.385 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:22:20.385 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:20.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:22:20.392 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c300), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:22:20.392 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:20.393 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:22:20.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7c0 [ CSSD]2013-05-23 11:22:20.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7c0) con(0x267c470) skgpid ospid 17762 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:21.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:21.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:21.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:22.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:22.459 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:22.900 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:22.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019a002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:23.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:23.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:23.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:25.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:25.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:25.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:26.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:26.461 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:22:27.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019b002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:27.086 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:22:27.086 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:22:27.086 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:22:27.086 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:27.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019c002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:27.093 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:22:27.093 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:22:27.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:27.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:27.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:29.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:29.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:29.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:31.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:31.463 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:31.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:31.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:31.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:32.922 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:32.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019d002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:33.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:33.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:33.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:35.635 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 11:22:35.635 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:22:35.636 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 11:22:35.636 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dc00) proc(0x269e7b0) pid(17904) version 11:1:1:4 [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7b0), client(1/0x269b6a0) [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:22:35.653 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:35.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 11:22:35.660 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:22:35.660 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:35.661 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:22:35.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:35.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 11:22:35.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x269dc00) skgpid ospid 17904 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:36.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:36.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:36.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:36.466 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:37.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:38.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:38.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:39.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:40.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:40.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:41.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:41.468 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:41.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:42.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:42.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:42.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019e002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:42.335 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:22:42.335 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:22:42.335 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:22:42.335 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:42.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019f002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:42.341 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:22:42.341 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267c170) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:22:42.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:42.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a0002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:43.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:44.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:44.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:45.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:46.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:46.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:46.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:46.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:47.442 [1199044928] >TRACE: clssgmAllocProc: (0x269e7c0) allocated [ CSSD]2013-05-23 11:22:47.443 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:22:47.444 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7c0 - 1,2,3 [ CSSD]2013-05-23 11:22:47.444 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c470) proc(0x269e7c0) pid(18050/18050) version 11:1:1:4 [ CSSD]2013-05-23 11:22:47.460 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e7c0), client(1/0x267c300) [ CSSD]2013-05-23 11:22:47.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:22:47.460 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:22:47.460 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:22:47.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:48.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:48.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cddc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cddc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdc90 [ CSSD]2013-05-23 11:22:49.739 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdc90) con(0x2650ba0) skgpid 14239 ospid 14239 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:49.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:50.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:50.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:50.901 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:22:50.902 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:22:50.903 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:22:50.903 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18095) version 11:1:1:4 [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x266f640) [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f640 with con 0x267d4a0, requested num -1 [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:22:50.910 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:50.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:22:50.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:22:50.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:50.918 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:22:51.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:22:51.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18095 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:51.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:51.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:51.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:52.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:52.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:52.971 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:22:52.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a1002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:53.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:54.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:54.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:55.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:56.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:56.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:22:56.477 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:22:56.477 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:22:57.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a2002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:57.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:22:57.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:22:57.583 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:22:57.583 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:57.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a3002a) incarnation(174631051) [ CSSD]2013-05-23 11:22:57.589 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:22:57.589 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:22:57.694 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:22:57.695 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:22:57.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:22:57.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18183) version 11:1:1:4 [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x266f640) [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f640 with con 0x267d4a0, requested num -1 [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:22:57.702 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:22:57.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:22:57.709 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:22:57.709 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:22:57.709 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:22:57.912 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:22:57.912 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18183 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:22:58.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:22:58.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:22:58.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:00.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:00.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:00.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:01.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:01.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:01.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a4002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:01.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:23:01.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:23:01.783 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:23:01.783 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:01.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a5002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:01.790 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:23:01.790 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:23:02.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:02.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:02.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:02.995 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:03.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a6002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:04.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:04.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:04.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:06.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:06.165 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:23:06.166 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:23:06.166 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:23:06.166 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650b60) proc(0x266f580) pid(18255) version 11:1:1:4 [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x267d490) [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d490) [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d490 with con 0x269b6a0, requested num -1 [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:06.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:06.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d490) [ CSSD]2013-05-23 11:23:06.189 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:23:06.189 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:06.189 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:06.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:06.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:06.392 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:23:06.392 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x2650b60) skgpid ospid 18255 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:06.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:06.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:08.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:08.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:08.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:10.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:10.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:10.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:11.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:11.485 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:12.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:12.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:12.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:12.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a7002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:12.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:23:12.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:23:12.832 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:23:12.832 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:12.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a8002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:12.839 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:23:12.839 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:23:13.019 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:13.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a9002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:14.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:14.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:14.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:16.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:16.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:16.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:16.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:16.488 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:18.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:18.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:18.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:20.105 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:23:20.106 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:23:20.107 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:23:20.107 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18380) version 11:1:1:4 [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x266f640) [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x266f640 with con 0x267d4a0, requested num -1 [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:20.124 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:20.130 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:20.130 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f640), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:23:20.130 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:23:20.130 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:20.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:20.252 [1199044928] >TRACE: clssgmAllocProc: (0x26cf9c0) allocated [ CSSD]2013-05-23 11:23:20.253 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:23:20.254 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cf9c0 - 1,2,3 [ CSSD]2013-05-23 11:23:20.254 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f640) proc(0x26cf9c0) pid(18385) version 11:1:1:4 [ CSSD]2013-05-23 11:23:20.270 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:23:20.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:23:20.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:23:20.277 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cf9c0 [ CSSD]2013-05-23 11:23:20.277 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cf9c0) con(0x266f640) skgpid ospid 18385 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:20.333 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:23:20.333 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18380 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:20.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:20.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:21.427 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:23:21.428 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:23:21.429 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:23:21.429 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18410) version 11:1:1:4 [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x266f640) [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f640 with con 0x267d4a0, requested num -1 [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:21.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:21.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:21.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:23:21.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:21.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:21.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:21.490 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:21.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:23:21.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18410 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:22.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:22.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:22.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:23.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:23.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01aa002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:24.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:24.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:24.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:26.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:26.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:26.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:26.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:26.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:28.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ab002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:28.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:23:28.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:23:28.082 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:23:28.082 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:28.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ac002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:28.090 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:23:28.090 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:23:28.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:28.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:28.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:30.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:30.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:30.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:31.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:31.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:32.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:32.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:32.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:33.063 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:33.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ad002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:34.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:34.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:34.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:36.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:36.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:36.498 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:36.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:36.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:36.678 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:23:36.679 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:23:36.679 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:23:36.679 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18586) version 11:1:1:4 [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x266f640) [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f640 with con 0x267d4a0, requested num -1 [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:36.695 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:36.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f640) [ CSSD]2013-05-23 11:23:36.701 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f640), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:23:36.701 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:36.701 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:36.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:23:36.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18586 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:38.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:38.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:38.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:40.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:40.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:40.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:41.186 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:23:41.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:23:41.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:23:41.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650aa0) proc(0x267d0c0) pid(18674) version 11:1:1:4 [ CSSD]2013-05-23 11:23:41.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:41.500 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:41.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:23:41.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x2650aa0) skgpid ospid 18674 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:42.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:42.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:42.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:43.085 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:43.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ae002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:43.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01af002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:43.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:23:43.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:23:43.342 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:23:43.342 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:43.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b0002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:43.350 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:23:43.350 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:23:44.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:44.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:44.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:45.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:45.502 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:23:46.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:46.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:46.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:48.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:48.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:48.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:48.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26a6940) [ CSSD]2013-05-23 11:23:48.901 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26a6940), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:23:48.901 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26a6940), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:23:48.901 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261bcc0) [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261bcc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261bcc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 11:23:48.905 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x268fa10) skgpid 12926 ospid 12926 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:50.504 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:50.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:50.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:50.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:50.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:51.937 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 11:23:51.938 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:23:51.938 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 11:23:51.938 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26e4d00) pid(18910) version 11:1:1:4 [ CSSD]2013-05-23 11:23:51.943 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e4d00), client(1/0x26ce240) [ CSSD]2013-05-23 11:23:51.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:23:51.943 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ce240 with con 0x26eecb0, requested num -1 [ CSSD]2013-05-23 11:23:51.943 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:51.943 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:23:51.944 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:51.944 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:51.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:23:51.950 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ce240), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:23:51.950 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eeb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:51.950 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eeb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:52.153 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 11:23:52.153 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x268fa10) skgpid ospid 18910 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:52.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:52.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:52.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:53.107 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:23:53.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b1002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:54.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:54.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:54.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:55.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:23:55.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:23:56.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:56.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:56.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:23:57.956 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 11:23:57.957 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:23:57.957 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 11:23:57.957 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26e4d00) pid(18992) version 11:1:1:4 [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e4d00), client(1/0x26ce240) [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ce240 with con 0x26eecb0, requested num -1 [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:23:57.964 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:57.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:23:57.971 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ce240), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:23:57.971 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eeb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:23:57.971 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eeb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:23:58.174 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 11:23:58.174 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x268fa10) skgpid ospid 18992 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:23:58.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:23:58.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b2002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:58.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:23:58.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:23:58.601 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:23:58.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:23:58.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b3002a) incarnation(174631051) [ CSSD]2013-05-23 11:23:58.608 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:23:58.608 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:23:58.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:23:58.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:00.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:00.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:00.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:00.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:00.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:02.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b4002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:02.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:24:02.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:24:02.040 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:24:02.040 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:02.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b5002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:02.047 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:24:02.047 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x267d650) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:24:02.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:02.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:02.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:03.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:03.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b6002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:04.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:04.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:04.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:05.512 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:05.512 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:06.287 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 11:24:06.288 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:24:06.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 11:24:06.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26e4d00) pid(19067) version 11:1:1:4 [ CSSD]2013-05-23 11:24:06.407 [1199044928] >TRACE: clssgmAllocProc: (0x268b720) allocated [ CSSD]2013-05-23 11:24:06.408 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:24:06.408 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268b720 - 1,2,3 [ CSSD]2013-05-23 11:24:06.408 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eecf0) proc(0x268b720) pid(19077) version 11:1:1:4 [ CSSD]2013-05-23 11:24:06.427 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:24:06.429 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:24:06.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x268b720 [ CSSD]2013-05-23 11:24:06.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268b720) con(0x26eecf0) skgpid ospid 19077 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5285/0x26ce240) [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5285 (0x26ce240) [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26ce240 with con 0x26eecf0, requested num -1 [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26a67c0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:06.511 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:24:06.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5285 (0x26ce240) [ CSSD]2013-05-23 11:24:06.517 [1199044928] >TRACE: clssgmExitGrock: client 5285 (0x26ce240), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:24:06.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:24:06.517 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:06.518 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 11:24:06.518 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x268fa10) skgpid ospid 19067 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:06.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:06.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:06.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:07.190 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 11:24:07.191 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:24:07.192 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 11:24:07.192 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26e4d00) pid(19095) version 11:1:1:4 [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e4d00), client(1/0x26ce240) [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ce240 with con 0x26eecb0, requested num -1 [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:07.208 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:07.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ce240) [ CSSD]2013-05-23 11:24:07.215 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ce240), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:24:07.215 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eeb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:07.216 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eeb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:07.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 11:24:07.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x268fa10) skgpid ospid 19095 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:08.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:08.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:08.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:10.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:10.515 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:10.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:10.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:10.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:12.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:12.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:12.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:13.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:13.186 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 11:24:13.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:24:13.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b7002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:13.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 11:24:13.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fa10) proc(0x26e4d00) pid(18882/18882) version 11:1:1:4 [ CSSD]2013-05-23 11:24:13.204 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e4d00), client(1/0x26ef150) [ CSSD]2013-05-23 11:24:13.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef150) [ CSSD]2013-05-23 11:24:13.204 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:24:13.204 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:24:13.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b8002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:13.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:24:13.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:24:13.849 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:24:13.849 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:13.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b9002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:13.856 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:24:13.856 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac069750) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:24:14.516 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:14.517 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:24:14.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:14.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:14.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:16.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:16.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:16.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:17.963 [1199044928] >TRACE: clssgmAllocProc: (0x261bcc0) allocated [ CSSD]2013-05-23 11:24:17.964 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:24:17.964 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bcc0 - 1,2,3 [ CSSD]2013-05-23 11:24:17.964 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce1a0) proc(0x261bcc0) pid(19211/19211) version 11:1:1:4 [ CSSD]2013-05-23 11:24:17.981 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bcc0), client(1/0x26ef0b0) [ CSSD]2013-05-23 11:24:17.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:17.981 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:24:17.981 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bcc0 [ CSSD]2013-05-23 11:24:18.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bcc0) con(0x26ce1a0) skgpid 19211 ospid 19211 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:18.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:18.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:18.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:19.519 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:19.519 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:20.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:20.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:20.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:22.450 [1199044928] >TRACE: clssgmAllocProc: (0x261bcc0) allocated [ CSSD]2013-05-23 11:24:22.451 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:24:22.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bcc0 - 1,2,3 [ CSSD]2013-05-23 11:24:22.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce1a0) proc(0x261bcc0) pid(19244) version 11:1:1:4 [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bcc0), client(1/0x26ef0b0) [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26a6a70, requested num -1 [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:22.468 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:22.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:22.475 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:24:22.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:22.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:22.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bcc0 [ CSSD]2013-05-23 11:24:22.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bcc0) con(0x26ce1a0) skgpid ospid 19244 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:22.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:22.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:22.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:23.186 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:23.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ba002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:24.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:24.522 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:24.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:25.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:25.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:26.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:27.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:27.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:28.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:29.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:29.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:29.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01bb002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:29.099 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:24:29.099 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:24:29.099 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:24:29.099 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:29.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01bc002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:29.107 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:24:29.107 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:24:29.524 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:29.524 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:30.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:31.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:31.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:32.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:33.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:33.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:33.209 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:33.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bd002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:34.526 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:34.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:34.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:35.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:35.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:36.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:37.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:37.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:37.710 [1199044928] >TRACE: clssgmAllocProc: (0x261bcc0) allocated [ CSSD]2013-05-23 11:24:37.711 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:24:37.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bcc0 - 1,2,3 [ CSSD]2013-05-23 11:24:37.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce1a0) proc(0x261bcc0) pid(19389) version 11:1:1:4 [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bcc0), client(1/0x26ef0b0) [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26a6a70, requested num -1 [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:37.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:37.736 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:37.736 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:24:37.736 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:37.736 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:37.938 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bcc0 [ CSSD]2013-05-23 11:24:37.938 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bcc0) con(0x26ce1a0) skgpid ospid 19389 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:39.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:39.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:39.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:39.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:39.529 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:41.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:41.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:41.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:43.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:43.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:43.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:43.230 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:43.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01be002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:43.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:43.531 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:24:44.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01bf002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:44.349 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:24:44.349 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:24:44.349 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:24:44.349 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:44.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c0002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:44.355 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:24:44.355 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:24:45.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:45.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:45.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:47.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:47.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:47.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:48.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:48.534 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:49.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:49.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:49.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:51.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:51.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:51.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:52.982 [1199044928] >TRACE: clssgmAllocProc: (0x261bcc0) allocated [ CSSD]2013-05-23 11:24:52.982 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:24:52.983 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bcc0 - 1,2,3 [ CSSD]2013-05-23 11:24:52.983 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce1a0) proc(0x261bcc0) pid(19541) version 11:1:1:4 [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bcc0), client(1/0x26ef0b0) [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26a6a70, requested num -1 [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:52.989 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:52.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 11:24:52.997 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:24:52.997 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:52.997 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:53.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:53.199 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bcc0 [ CSSD]2013-05-23 11:24:53.199 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bcc0) con(0x26ce1a0) skgpid ospid 19541 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:53.252 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:24:53.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c1002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:53.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:53.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:54.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:54.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:55.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:56.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:56.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:57.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:58.221 [1199044928] >TRACE: clssgmAllocProc: (0x261bf00) allocated [ CSSD]2013-05-23 11:24:58.221 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:24:58.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bf00 - 1,2,3 [ CSSD]2013-05-23 11:24:58.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b720) proc(0x261bf00) pid(19620) version 11:1:1:4 [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bf00), client(1/0x268b960) [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b960) [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b960 with con 0x26a6a60, requested num -1 [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:24:58.238 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:58.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b960) [ CSSD]2013-05-23 11:24:58.244 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:24:58.244 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:24:58.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:24:58.447 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bf00 [ CSSD]2013-05-23 11:24:58.447 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bf00) con(0x268b720) skgpid ospid 19620 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:24:58.538 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:24:58.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:24:58.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:24:58.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:24:59.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:24:59.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c2002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:59.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:24:59.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:24:59.598 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:24:59.598 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:24:59.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c3002a) incarnation(174631051) [ CSSD]2013-05-23 11:24:59.605 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:24:59.606 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:00.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:00.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:01.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:02.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c4002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:02.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:25:02.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:25:02.310 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:25:02.310 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:02.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c5002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:02.317 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:25:02.317 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:02.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:02.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:02.824 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e4d00), client(2/0x26ef0a0) [ CSSD]2013-05-23 11:25:02.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 11:25:02.824 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:25:02.824 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 11:25:03.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:03.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:03.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c6002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:03.541 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:03.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:04.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:04.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:05.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:05.565 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:05.565 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:25:05.566 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:05.566 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(19707/19707) version 11:1:1:4 [ CSSD]2013-05-23 11:25:05.571 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:05.571 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:05.571 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:25:05.571 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:05.846 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid 19707 ospid 19707 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:06.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:06.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:07.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:08.240 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:08.241 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:25:08.241 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:08.241 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(19727) version 11:1:1:4 [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:25:08.247 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:08.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:08.254 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:25:08.254 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:08.254 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:25:08.456 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:08.456 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 19727 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:08.543 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:08.543 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:08.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:08.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:09.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:10.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:10.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:11.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:12.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:12.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:13.296 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:13.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:13.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c7002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:13.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:13.546 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:14.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c8002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:14.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:25:14.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:25:14.850 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:25:14.850 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:14.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c9002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:14.858 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:25:14.858 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:14.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:14.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:15.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:16.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:16.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:17.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:18.548 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:18.548 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:18.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:18.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:19.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:20.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:20.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:21.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:21.417 [1199044928] >TRACE: clssgmAllocProc: (0x266f5e0) allocated [ CSSD]2013-05-23 11:25:21.418 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:25:21.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f5e0 - 1,2,3 [ CSSD]2013-05-23 11:25:21.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f5e0) pid(19897/19897) version 11:1:1:4 [ CSSD]2013-05-23 11:25:21.424 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f5e0), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:21.424 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:21.424 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:25:21.424 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f5e0 [ CSSD]2013-05-23 11:25:22.955 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f5e0) con(0x26a6950) skgpid 19897 ospid 19897 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:22.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:22.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:23.317 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:23.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ca002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:23.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:23.490 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:23.491 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:25:23.491 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:23.491 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(19925) version 11:1:1:4 [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:25:23.497 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:23.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:23.503 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:25:23.503 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:23.503 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:25:23.550 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:23.551 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:23.706 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:23.706 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 19925 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:25.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:25.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:25.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:27.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:27.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:27.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:28.553 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:28.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:29.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:29.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:29.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:30.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cb002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:30.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:25:30.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:25:30.100 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:25:30.100 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:30.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01cc002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:30.106 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:25:30.106 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:31.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:31.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:31.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:33.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:33.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:33.337 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:33.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cd002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:33.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:33.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:33.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:35.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:35.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:35.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:37.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:37.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:37.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:38.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:38.558 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:38.741 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:38.741 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:25:38.742 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:38.742 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20071) version 11:1:1:4 [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:25:38.748 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:38.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:38.755 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:25:38.755 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:38.755 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:25:38.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:38.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 20071 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:39.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:39.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:39.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:41.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:41.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:41.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:42.560 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:42.560 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:25:43.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:43.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:43.357 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:43.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ce002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:43.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:45.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:45.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:45.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cf002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:45.348 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:25:45.348 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:25:45.348 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:25:45.348 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:45.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d0002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:45.355 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:25:45.355 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:45.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:47.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:47.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:47.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:47.563 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:47.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:49.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:49.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:49.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:51.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:51.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:51.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:52.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:52.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:53.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:53.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:53.379 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:25:53.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d1002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:53.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:54.001 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:54.002 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:25:54.003 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:54.003 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20250) version 11:1:1:4 [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:25:54.009 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:54.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:54.015 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:25:54.015 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:54.015 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:25:54.218 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:54.218 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 20250 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:55.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:55.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:55.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:57.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:57.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:57.567 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:25:57.567 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:25:57.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:25:58.493 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:25:58.494 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:25:58.495 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:25:58.495 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20322) version 11:1:1:4 [ CSSD]2013-05-23 11:25:58.501 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:25:58.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:58.501 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:25:58.501 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:58.501 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:25:58.502 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:25:58.502 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:58.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:25:58.509 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:25:58.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:25:58.509 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:25:58.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:25:58.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 20322 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:25:59.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:25:59.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:25:59.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d2002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:59.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:25:59.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:25:59.559 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:25:59.559 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:25:59.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d3002a) incarnation(174631051) [ CSSD]2013-05-23 11:25:59.566 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:25:59.566 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:25:59.697 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:25:59.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:25:59.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:25:59.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:25:59.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:00.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d4002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:00.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:00.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:00.599 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:26:00.599 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:00.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d5002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:00.605 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:00.605 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:01.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:01.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:01.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:02.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d6002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:02.569 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:02.569 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:02.569 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:26:02.569 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:02.570 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:02.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:02.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d7002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:02.576 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:02.576 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:03.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:03.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:03.401 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:03.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d8002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:03.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:05.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:05.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:05.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:07.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:07.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:07.572 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:07.572 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:07.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:09.255 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:26:09.255 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:26:09.256 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:26:09.256 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20401) version 11:1:1:4 [ CSSD]2013-05-23 11:26:09.272 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:26:09.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:09.272 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:26:09.272 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:09.272 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:26:09.273 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:26:09.273 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:09.280 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:09.280 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:26:09.280 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:09.280 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:26:09.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:09.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:09.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:26:09.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 20401 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:09.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:11.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:11.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:11.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:12.575 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:12.575 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:13.422 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:13.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d9002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:13.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:13.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:13.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:15.432 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:26:15.432 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:26:15.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:26:15.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20486/20486) version 11:1:1:4 [ CSSD]2013-05-23 11:26:15.449 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:26:15.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:15.449 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:26:15.449 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b8b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:26:15.467 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid 20486 ospid 20486 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:15.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:15.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:15.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01da002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:15.841 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:15.841 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:15.841 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:26:15.841 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:15.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01db002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:15.849 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:15.849 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:15.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:17.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:17.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:17.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:17.577 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:17.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:19.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:19.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:19.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:21.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:21.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:21.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:22.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:22.580 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:23.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:23.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01dc002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:23.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:23.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:23.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:24.525 [1199044928] >TRACE: clssgmAllocProc: (0x266f580) allocated [ CSSD]2013-05-23 11:26:24.526 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:26:24.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f580 - 1,2,3 [ CSSD]2013-05-23 11:26:24.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266f580) pid(20553) version 11:1:1:4 [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f580), client(1/0x268b8b0) [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b8b0 with con 0x261c020, requested num -1 [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:26:24.532 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:24.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b8b0) [ CSSD]2013-05-23 11:26:24.538 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:26:24.538 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:24.538 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:26:24.741 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f580 [ CSSD]2013-05-23 11:26:24.741 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f580) con(0x26a6950) skgpid ospid 20553 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:25.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:25.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:25.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:27.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:27.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:27.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:27.582 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:27.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:29.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:29.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:30.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:31.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01dd002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:31.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:31.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:31.092 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:26:31.092 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:31.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01de002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:31.099 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:31.099 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:31.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:31.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:32.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:32.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:32.585 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:33.465 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:33.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01df002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:33.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:33.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:34.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:35.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:35.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:36.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:37.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:37.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:37.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:37.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:38.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:39.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:39.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:39.773 [1199044928] >TRACE: clssgmAllocProc: (0x267d0c0) allocated [ CSSD]2013-05-23 11:26:39.774 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:26:39.774 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d0c0 - 1,2,3 [ CSSD]2013-05-23 11:26:39.774 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6880) proc(0x267d0c0) pid(20727) version 11:1:1:4 [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d0c0), client(1/0x261c030) [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c030) [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c030 with con 0x266f4b0, requested num -1 [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce7d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:26:39.791 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:39.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c030) [ CSSD]2013-05-23 11:26:39.798 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c030), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:26:39.798 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d480) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:39.798 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:26:40.001 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d0c0 [ CSSD]2013-05-23 11:26:40.001 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d0c0) con(0x26a6880) skgpid ospid 20727 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:40.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:40.469 [1199044928] >TRACE: clssgmAllocProc: (0x266eb60) allocated [ CSSD]2013-05-23 11:26:40.470 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:26:40.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266eb60 - 1,2,3 [ CSSD]2013-05-23 11:26:40.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x266eb60) pid(20515/20515) version 11:1:1:4 [ CSSD]2013-05-23 11:26:40.487 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266eb60), client(1/0x266f0d0) [ CSSD]2013-05-23 11:26:40.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f0d0) [ CSSD]2013-05-23 11:26:40.487 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:26:40.487 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:26:41.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:41.589 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:26:41.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:41.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:42.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:43.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:43.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e0002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:43.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:43.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:44.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:45.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:45.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:46.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:46.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e1002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:46.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:46.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:46.352 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:26:46.352 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:46.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e2002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:46.359 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:46.359 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:46.591 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:46.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:47.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:47.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:48.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:49.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:49.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:50.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:51.594 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:51.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:51.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:51.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:52.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:53.506 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:26:53.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e3002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:53.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:53.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:54.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:55.034 [1199044928] >TRACE: clssgmAllocProc: (0x26cfa40) allocated [ CSSD]2013-05-23 11:26:55.035 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:26:55.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfa40 - 1,2,3 [ CSSD]2013-05-23 11:26:55.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f020) proc(0x26cfa40) pid(20882) version 11:1:1:4 [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(1/0x26e89e0) [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e89e0) [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e89e0 with con 0x26cf980, requested num -1 [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e8b50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:26:55.042 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:55.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e89e0) [ CSSD]2013-05-23 11:26:55.048 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e89e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:26:55.048 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cf800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:55.049 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cf800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:26:55.251 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cfa40 [ CSSD]2013-05-23 11:26:55.251 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cfa40) con(0x266f020) skgpid ospid 20882 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:55.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:55.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:56.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:56.596 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:26:56.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:26:56.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:26:56.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:26:56.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:26:56.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:26:56.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e4002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:56.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:26:56.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:26:56.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06dbf0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:26:56.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:26:56.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e5002a) incarnation(174631051) [ CSSD]2013-05-23 11:26:56.792 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:26:56.792 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:26:57.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:57.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:26:58.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:26:58.753 [1199044928] >TRACE: clssgmAllocProc: (0x26cfa40) allocated [ CSSD]2013-05-23 11:26:58.754 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:26:58.755 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfa40 - 1,2,3 [ CSSD]2013-05-23 11:26:58.755 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f020) proc(0x26cfa40) pid(20941) version 11:1:1:4 [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(1/0x26e89e0) [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e89e0) [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e89e0 with con 0x26cf980, requested num -1 [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e8b50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:26:58.761 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:26:58.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e89e0) [ CSSD]2013-05-23 11:26:58.768 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e89e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:26:58.768 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cf800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:26:58.768 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cf800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:26:58.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cfa40 [ CSSD]2013-05-23 11:26:58.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cfa40) con(0x266f020) skgpid ospid 20941 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:26:59.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:26:59.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:00.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:01.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:01.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:01.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e6002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:01.603 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:27:01.603 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:27:01.603 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:27:01.603 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:01.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e7002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:01.611 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:27:01.611 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:27:01.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:01.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:01.882 [1199044928] >TRACE: clssgmAllocProc: (0x26cfa40) allocated [ CSSD]2013-05-23 11:27:01.883 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:01.883 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfa40 - 1,2,3 [ CSSD]2013-05-23 11:27:01.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b950) proc(0x26cfa40) pid(20979) version 11:1:1:4 [ CSSD]2013-05-23 11:27:01.900 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(1/0x26e8920) [ CSSD]2013-05-23 11:27:01.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8920) [ CSSD]2013-05-23 11:27:01.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8920 with con 0x266f020, requested num -1 [ CSSD]2013-05-23 11:27:01.900 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:01.900 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e8a90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:01.901 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:01.901 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:01.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8920) [ CSSD]2013-05-23 11:27:01.908 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8920), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:01.908 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:01.908 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:02.111 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cfa40 [ CSSD]2013-05-23 11:27:02.111 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cfa40) con(0x268b950) skgpid ospid 20979 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:02.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:02.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e8002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:02.834 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:27:02.834 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:27:02.834 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:27:02.834 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:02.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e9002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:02.843 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:27:02.843 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:27:03.527 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:03.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ea002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:03.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:03.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:04.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:05.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:05.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:06.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:06.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:06.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:07.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:07.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:08.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:09.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:09.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:10.285 [1199044928] >TRACE: clssgmAllocProc: (0x26cfa40) allocated [ CSSD]2013-05-23 11:27:10.285 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:27:10.286 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfa40 - 1,2,3 [ CSSD]2013-05-23 11:27:10.286 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b950) proc(0x26cfa40) pid(21065) version 11:1:1:4 [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(1/0x26e8920) [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8920) [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8920 with con 0x266f020, requested num -1 [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e8a90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:10.292 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:10.299 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8920) [ CSSD]2013-05-23 11:27:10.299 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8920), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:10.299 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:10.299 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:10.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:10.502 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cfa40 [ CSSD]2013-05-23 11:27:10.502 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cfa40) con(0x268b950) skgpid ospid 21065 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:10.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:10.604 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:27:11.151 [1199044928] >TRACE: clssgmAllocProc: (0x26cf960) allocated [ CSSD]2013-05-23 11:27:11.152 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:11.152 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cf960 - 1,2,3 [ CSSD]2013-05-23 11:27:11.152 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b950) proc(0x26cf960) pid(21127) version 11:1:1:4 [ CSSD]2013-05-23 11:27:11.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:11.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:12.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:13.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:13.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01eb002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:13.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cf960 [ CSSD]2013-05-23 11:27:13.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cf960) con(0x268b950) skgpid ospid 21127 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:13.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:13.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:14.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:15.144 [1199044928] >TRACE: clssgmAllocProc: (0x26cfa40) allocated [ CSSD]2013-05-23 11:27:15.144 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:15.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cfa40 - 1,2,3 [ CSSD]2013-05-23 11:27:15.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f020) proc(0x26cfa40) pid(21449/21449) version 11:1:1:4 [ CSSD]2013-05-23 11:27:15.161 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(1/0x26e8850) [ CSSD]2013-05-23 11:27:15.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e8850) [ CSSD]2013-05-23 11:27:15.161 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:27:15.161 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:27:15.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:15.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:15.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:15.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:16.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:16.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ec002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:16.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:27:16.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:27:16.867 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:27:16.867 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:16.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ed002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:16.874 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:27:16.874 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:27:17.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:17.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:18.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:19.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:19.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:20.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:20.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:20.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:21.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:21.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:22.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:23.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:23.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ee002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:23.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:23.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:24.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:25.528 [1199044928] >TRACE: clssgmAllocProc: (0x26a9000) allocated [ CSSD]2013-05-23 11:27:25.529 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:27:25.529 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9000 - 1,2,3 [ CSSD]2013-05-23 11:27:25.529 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269f440) proc(0x26a9000) pid(21533) version 11:1:1:4 [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9000), client(1/0x26a9790) [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9790) [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9790 with con 0x26a8f30, requested num -1 [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:25.534 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:25.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9790) [ CSSD]2013-05-23 11:27:25.538 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:25.538 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:25.538 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:25.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:25.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:25.741 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9000 [ CSSD]2013-05-23 11:27:25.741 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9000) con(0x269f440) skgpid ospid 21533 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:25.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:25.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:26.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:26.866 [1199044928] >TRACE: clssgmAllocProc: (0x26a9000) allocated [ CSSD]2013-05-23 11:27:26.867 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:26.868 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9000 - 1,2,3 [ CSSD]2013-05-23 11:27:26.868 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269f440) proc(0x26a9000) pid(20513/20513) version 11:1:1:4 [ CSSD]2013-05-23 11:27:26.884 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9000), client(1/0x26a9600) [ CSSD]2013-05-23 11:27:26.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a9600) [ CSSD]2013-05-23 11:27:26.884 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:27:26.884 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:27:27.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:27.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:28.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:29.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:29.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:30.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:30.614 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:30.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:31.404 [1199044928] >TRACE: clssgmAllocProc: (0x26aab10) allocated [ CSSD]2013-05-23 11:27:31.405 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:31.406 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab10 - 1,2,3 [ CSSD]2013-05-23 11:27:31.406 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9c40) proc(0x26aab10) pid(21614) version 11:1:1:4 [ CSSD]2013-05-23 11:27:31.411 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aab10), client(1/0x26ed9c0) [ CSSD]2013-05-23 11:27:31.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed9c0) [ CSSD]2013-05-23 11:27:31.411 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed9c0 with con 0x26aaa40, requested num -1 [ CSSD]2013-05-23 11:27:31.411 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:31.411 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edb30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:31.412 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:31.412 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:31.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed9c0) [ CSSD]2013-05-23 11:27:31.417 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed9c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:31.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ede30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:31.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ede30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:31.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab10 [ CSSD]2013-05-23 11:27:31.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab10) con(0x26a9c40) skgpid ospid 21614 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:31.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:31.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:32.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ef002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:32.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:27:32.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:27:32.128 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:27:32.128 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:32.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f0002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:32.136 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:27:32.136 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:27:32.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:33.591 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:33.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f1002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:33.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:33.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:34.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:35.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:35.617 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:36.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:36.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:36.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:38.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:38.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:38.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:40.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:40.066 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:40.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:40.619 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:40.619 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:40.773 [1199044928] >TRACE: clssgmAllocProc: (0x26aab90) allocated [ CSSD]2013-05-23 11:27:40.774 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:27:40.774 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab90 - 1,2,3 [ CSSD]2013-05-23 11:27:40.774 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9c40) proc(0x26aab90) pid(21691) version 11:1:1:4 [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aab90), client(1/0x26ed9c0) [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed9c0) [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed9c0 with con 0x26aae60, requested num -1 [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edb30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:40.780 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:40.786 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed9c0) [ CSSD]2013-05-23 11:27:40.786 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed9c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:40.787 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ede30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:40.787 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ede30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:40.989 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab90 [ CSSD]2013-05-23 11:27:40.989 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab90) con(0x26a9c40) skgpid ospid 21691 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:42.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:42.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:42.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:43.612 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:43.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f2002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:44.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:44.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:44.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x268bac0) [ CSSD]2013-05-23 11:27:44.119 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x268bac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:27:44.119 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x268bac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:27:44.119 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 11:27:44.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:27:44.124 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268f970), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:27:44.124 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268f970), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:27:44.124 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:27:44.125 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:27:44.125 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid 16083 ospid 16083 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:44.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:45.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:45.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:46.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:46.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:46.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:47.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f3002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:47.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:27:47.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:27:47.389 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:27:47.389 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:47.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f4002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:47.396 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:27:47.396 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:27:48.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:48.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:48.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:50.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:50.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:50.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:50.624 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:50.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:52.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:52.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:52.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:53.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:27:53.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f5002a) incarnation(174631051) [ CSSD]2013-05-23 11:27:54.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:54.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:54.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:55.626 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:27:55.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:27:56.021 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:27:56.022 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:27:56.023 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:27:56.023 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(21838) version 11:1:1:4 [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x267d5a0, requested num -1 [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:56.029 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:56.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:27:56.036 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:56.036 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:56.036 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:56.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:56.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:56.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:27:56.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 21838 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:27:56.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:58.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:27:58.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:27:58.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:27:59.020 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:27:59.020 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:27:59.021 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:27:59.021 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(21897) version 11:1:1:4 [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x267d5a0, requested num -1 [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:27:59.038 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:27:59.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:27:59.045 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:27:59.045 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:27:59.045 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:27:59.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:27:59.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 21897 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:00.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:00.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:00.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:00.629 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:00.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:02.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:02.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:02.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f6002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:02.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:28:02.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:28:02.639 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:28:02.639 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:02.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f7002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:02.646 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:28:02.646 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:28:02.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:03.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f8002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:03.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:28:03.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:28:03.110 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:28:03.110 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:03.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f9002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:03.118 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:28:03.118 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:28:03.655 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:03.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fa002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:04.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:04.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:04.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:05.631 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:05.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:06.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:06.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:06.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:08.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:08.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:08.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:10.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:10.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:10.634 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:10.634 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:10.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:11.280 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:11.281 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:28:11.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:11.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(21989) version 11:1:1:4 [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:11.288 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:11.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:11.294 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:28:11.294 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:11.295 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:11.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:11.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 21989 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:12.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:12.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:12.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:13.677 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fb002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:14.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:14.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:14.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:15.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:15.637 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:16.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:16.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:16.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:17.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fc002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:17.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:28:17.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:28:17.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:28:17.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:17.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fd002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:17.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:28:17.899 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:28:18.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:18.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:18.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:20.409 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:20.410 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:28:20.411 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:20.411 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(22113) version 11:1:1:4 [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x268f970 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:20.418 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:20.425 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:20.425 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:28:20.425 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:28:20.425 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:20.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:20.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:20.536 [1199044928] >TRACE: clssgmAllocProc: (0x26ecb50) allocated [ CSSD]2013-05-23 11:28:20.537 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:28:20.537 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecb50 - 1,2,3 [ CSSD]2013-05-23 11:28:20.537 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ecb50) pid(22118) version 11:1:1:4 [ CSSD]2013-05-23 11:28:20.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:28:20.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:28:20.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:28:20.558 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecb50 [ CSSD]2013-05-23 11:28:20.558 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecb50) con(0x26ee500) skgpid ospid 22118 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:20.627 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:20.627 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 22113 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:20.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:20.639 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:21.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:22.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:22.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:23.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:23.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:23.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fe002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:24.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:24.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:25.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:25.641 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:25.641 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:26.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:26.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:26.530 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:26.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:28:26.531 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:26.531 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(22169) version 11:1:1:4 [ CSSD]2013-05-23 11:28:26.547 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:26.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:26.547 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:28:26.547 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:26.548 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:28:26.548 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:26.548 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:26.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:26.555 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:28:26.555 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:26.555 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:26.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:26.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 22169 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:27.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:28.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:28.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:29.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:30.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:30.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:30.644 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:30.644 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:31.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:32.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:32.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:33.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ff002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:33.142 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:28:33.142 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:28:33.142 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:28:33.142 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:33.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0200002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:33.149 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:28:33.149 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:28:33.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:33.720 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:33.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0201002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:34.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:34.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:34.646 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:34.646 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:28:35.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:36.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:36.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:37.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:38.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:38.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:39.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:39.648 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:39.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:40.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:40.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:41.042 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:41.043 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:28:41.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:41.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(22314) version 11:1:1:4 [ CSSD]2013-05-23 11:28:41.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:41.670 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:41.670 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 22314 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:41.790 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:41.791 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:28:41.791 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:41.791 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(22416) version 11:1:1:4 [ CSSD]2013-05-23 11:28:41.797 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:41.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:41.797 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:28:41.797 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:41.797 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:28:41.798 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:41.798 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:41.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:41.804 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:28:41.804 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:41.804 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:42.007 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:42.007 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 22416 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:42.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:42.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:43.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:43.740 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:43.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0202002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:44.651 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:44.651 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:44.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:44.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:45.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:46.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:46.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:47.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:48.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0203002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:48.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:28:48.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:28:48.393 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:28:48.393 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:48.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0204002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:48.400 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:28:48.400 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:28:48.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:48.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267bdb0) [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267bdb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267bdb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x267be50 [ CSSD]2013-05-23 11:28:48.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267be50) con(0x26e1790) skgpid 16779 ospid 16779 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:49.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:49.654 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:49.654 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:50.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:50.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:51.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:52.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:52.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:53.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:53.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:28:53.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0205002a) incarnation(174631051) [ CSSD]2013-05-23 11:28:54.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:54.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:28:54.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:54.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:55.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:56.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:56.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:57.039 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:57.040 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:28:57.041 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:57.041 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2650970) pid(22661) version 11:1:1:4 [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:57.047 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:57.053 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:57.053 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:28:57.053 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26915c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:57.054 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26915c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:57.256 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:57.256 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x267d5a0) skgpid ospid 22661 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:57.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:58.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:28:58.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:28:59.297 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:28:59.298 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:28:59.299 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:28:59.299 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(22714) version 11:1:1:4 [ CSSD]2013-05-23 11:28:59.305 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:28:59.306 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:28:59.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:28:59.313 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:28:59.313 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26915c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:28:59.313 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26915c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:28:59.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:28:59.516 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:28:59.516 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 22714 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:28:59.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:28:59.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:00.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:00.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:01.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:02.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:02.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:03.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0206002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:03.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:29:03.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:29:03.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:29:03.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:03.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0207002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:03.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:29:03.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:29:03.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:03.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0208002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:03.644 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:29:03.644 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:29:03.644 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:29:03.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:03.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0209002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:03.651 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:29:03.651 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:29:03.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:03.661 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:29:03.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:03.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020a002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:04.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:04.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:05.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:06.604 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:29:06.606 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:29:06.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:29:06.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(22781) version 11:1:1:4 [ CSSD]2013-05-23 11:29:06.724 [1199044928] >TRACE: clssgmAllocProc: (0x267bd70) allocated [ CSSD]2013-05-23 11:29:06.725 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:29:06.726 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bd70 - 1,2,3 [ CSSD]2013-05-23 11:29:06.726 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x267bd70) pid(22797) version 11:1:1:4 [ CSSD]2013-05-23 11:29:06.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:29:06.746 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:29:06.750 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bd70 [ CSSD]2013-05-23 11:29:06.750 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bd70) con(0x26ee500) skgpid ospid 22797 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5286/0x268f970) [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5286 (0x268f970) [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x268f970 with con 0x2659ba0, requested num -1 [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26e1090/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:06.828 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:29:06.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5286 (0x268f970) [ CSSD]2013-05-23 11:29:06.834 [1199044928] >TRACE: clssgmExitGrock: client 5286 (0x268f970), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:29:06.834 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6b00) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:29:06.834 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26b6b00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:06.835 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:29:06.835 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 22781 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:06.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:06.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:07.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:08.663 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:08.664 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:09.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:09.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:09.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:11.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:11.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:11.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:12.302 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:29:12.303 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:29:12.303 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:29:12.303 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(22838) version 11:1:1:4 [ CSSD]2013-05-23 11:29:12.309 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:29:12.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:29:12.309 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:29:12.310 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:12.310 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:29:12.310 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:12.310 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:12.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:29:12.316 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:29:12.316 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26915c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:12.316 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26915c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:12.519 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:29:12.519 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 22838 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:13.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:13.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:13.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:13.666 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:13.666 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:13.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:13.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020b002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:15.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:15.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:15.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:17.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:17.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:17.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:18.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:18.669 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:18.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020c002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:18.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:29:18.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:29:18.895 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:29:18.895 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:18.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020d002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:18.902 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:29:18.902 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:29:19.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:19.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:19.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:21.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:21.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:21.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:23.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:23.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:23.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:23.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:23.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:23.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:23.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020e002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:25.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:25.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:25.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:27.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:27.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:27.561 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:29:27.562 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:29:27.562 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:29:27.562 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(23003) version 11:1:1:4 [ CSSD]2013-05-23 11:29:27.568 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:29:27.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:29:27.568 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268f970 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:29:27.568 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:27.568 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:29:27.569 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:27.569 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:27.575 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:29:27.575 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268f970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:29:27.575 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26915c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:27.575 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26915c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:27.778 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:29:27.778 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 23003 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:27.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:28.673 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:28.674 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:29.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:29.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:29.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:31.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:31.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:31.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:32.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:32.676 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:29:33.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:33.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:33.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:33.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:33.932 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:29:33.932 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:29:33.933 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:29:33.933 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(21791/21791) version 11:1:1:4 [ CSSD]2013-05-23 11:29:33.949 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x268f970) [ CSSD]2013-05-23 11:29:33.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:29:33.949 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:29:33.949 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:29:33.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020f002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:34.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0210002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:34.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:29:34.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:29:34.147 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:29:34.147 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:34.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0211002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:34.154 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:29:34.155 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:29:35.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:35.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:35.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:37.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:37.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:37.678 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:37.678 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:37.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:39.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:39.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:39.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:41.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:41.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:41.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:42.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:42.681 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:42.810 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:29:42.811 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:29:42.811 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:29:42.811 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x267bfc0) pid(23156) version 11:1:1:4 [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x2678fe0) [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fe0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:42.817 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:42.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:29:42.824 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:29:42.824 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:42.824 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:43.026 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:29:43.026 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x26a9490) skgpid ospid 23156 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:43.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:43.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:43.888 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:43.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:43.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0212002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:45.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:45.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:45.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:47.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:47.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:47.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:47.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:47.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:49.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0213002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:49.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:29:49.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:29:49.397 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:29:49.397 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:49.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0214002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:49.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:29:49.404 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:29:49.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:49.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:49.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:51.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:51.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:52.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:52.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:52.686 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:53.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:53.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:53.909 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:29:54.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0215002a) incarnation(174631051) [ CSSD]2013-05-23 11:29:54.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:55.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:55.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:56.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:57.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:57.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:57.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:29:57.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:29:58.059 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:29:58.060 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:29:58.061 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:29:58.061 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x267bfc0) pid(23356) version 11:1:1:4 [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x268bba0) [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bba0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:58.067 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:58.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:29:58.073 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:29:58.073 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26790b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:58.073 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26790b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:58.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:29:58.276 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:29:58.276 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x267d5a0) skgpid ospid 23356 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:29:59.549 [1199044928] >TRACE: clssgmAllocProc: (0x2678e50) allocated [ CSSD]2013-05-23 11:29:59.549 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:29:59.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678e50 - 1,2,3 [ CSSD]2013-05-23 11:29:59.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x2678e50) pid(23404) version 11:1:1:4 [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678e50), client(1/0x268bba0) [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bba0 with con 0x26a9a70, requested num -1 [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bcf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:29:59.556 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:29:59.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:29:59.563 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:29:59.563 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bff0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:29:59.563 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bff0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:29:59.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:29:59.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:29:59.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678e50 [ CSSD]2013-05-23 11:29:59.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678e50) con(0x267d5a0) skgpid ospid 23404 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:00.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:01.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:01.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:01.690 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:01.690 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:30:02.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:03.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0216002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:03.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:03.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:03.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:03.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:03.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0217002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:03.635 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:03.635 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:03.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:03.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:03.931 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:04.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0218002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:04.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:04.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0219002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:04.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:04.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:04.648 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:04.648 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:04.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021a002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:04.655 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:04.655 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:04.954 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:30:04.954 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:30:04.955 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:30:04.955 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x267bfc0) pid(23637/23637) version 11:1:1:4 [ CSSD]2013-05-23 11:30:04.970 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x268bba0) [ CSSD]2013-05-23 11:30:04.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:30:04.971 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:30:04.971 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268bba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268bba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:30:05.452 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x267d5a0) skgpid 23637 ospid 23637 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:05.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:05.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:06.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:06.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:06.693 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:07.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:07.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:08.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:09.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:09.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:10.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:11.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:11.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:11.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:11.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:12.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:13.320 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:30:13.321 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:30:13.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:30:13.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x267bfc0) pid(23694) version 11:1:1:4 [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x2678fe0) [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fe0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:30:13.327 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:13.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:13.333 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:30:13.333 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:13.334 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:30:13.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:30:13.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x26a9490) skgpid ospid 23694 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:13.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:13.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:14.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:14.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021b002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:14.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:15.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:15.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:16.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:16.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:16.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:17.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:17.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:18.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:19.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:19.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:19.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021c002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:19.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:19.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:19.909 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:19.909 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:19.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021d002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:19.915 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:19.915 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:20.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:21.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:21.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:21.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:21.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:22.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:23.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:23.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:24.072 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:24.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021e002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:24.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:25.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:25.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:26.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:26.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:26.703 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:27.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:27.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:28.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:28.569 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:30:28.570 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:30:28.570 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:30:28.570 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x267bfc0) pid(23847) version 11:1:1:4 [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x2678fe0) [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fe0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:30:28.577 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:28.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:28.584 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:30:28.584 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:28.584 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:30:28.787 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:30:28.787 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x26a9490) skgpid ospid 23847 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:29.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:29.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:30.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:31.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:31.705 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:31.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:31.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:32.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:33.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:33.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:34.094 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:34.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021f002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:34.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:35.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0220002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:35.168 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:35.168 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:35.168 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:35.168 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:35.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0221002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:35.175 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:35.175 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:35.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:35.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:36.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:36.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:36.708 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:37.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:37.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:38.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:39.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:39.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:40.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:41.710 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:41.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:42.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:42.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:42.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:43.820 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:30:43.821 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:30:43.821 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:30:43.821 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x267bfc0) pid(23991) version 11:1:1:4 [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x2678fe0) [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fe0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:30:43.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:43.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:43.846 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:30:43.846 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:43.846 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:30:44.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:44.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:44.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:30:44.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x26a9490) skgpid ospid 23991 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:44.115 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:44.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0222002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:44.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:46.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:46.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:46.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:46.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0223002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:46.708 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:46.708 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:46.708 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:46.708 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:46.713 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:46.713 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:46.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0224002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:46.715 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:46.715 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:48.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:48.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:48.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:50.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:50.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:50.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0225002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:50.419 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:50.419 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:50.419 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:30:50.419 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:50.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0226002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:50.426 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:50.426 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:30:50.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:51.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:51.716 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:30:52.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:52.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:52.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:54.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:54.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:54.135 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:30:54.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0227002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:54.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:55.717 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:30:55.718 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:30:56.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:56.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:56.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:58.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:30:58.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:30:58.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:30:59.081 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:30:59.082 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:30:59.082 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:30:59.082 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x267bfc0) pid(24134) version 11:1:1:4 [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x2678fe0) [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678fe0 with con 0x267bef0, requested num -1 [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:30:59.088 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:59.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678fe0) [ CSSD]2013-05-23 11:30:59.095 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678fe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:30:59.095 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:59.095 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:30:59.298 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:30:59.298 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x26a9490) skgpid ospid 24134 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:30:59.813 [1199044928] >TRACE: clssgmAllocProc: (0x2678e50) allocated [ CSSD]2013-05-23 11:30:59.814 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:30:59.814 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678e50 - 1,2,3 [ CSSD]2013-05-23 11:30:59.814 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9490) proc(0x2678e50) pid(24181) version 11:1:1:4 [ CSSD]2013-05-23 11:30:59.820 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678e50), client(1/0x2678940) [ CSSD]2013-05-23 11:30:59.820 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678940) [ CSSD]2013-05-23 11:30:59.820 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678940 with con 0x26a99c0, requested num -1 [ CSSD]2013-05-23 11:30:59.820 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:59.820 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bcf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:30:59.821 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:30:59.821 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:59.827 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678940) [ CSSD]2013-05-23 11:30:59.827 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678940), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:30:59.827 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bff0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:30:59.827 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bff0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:30:59.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0228002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:59.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:30:59.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:30:59.860 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:30:59.860 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:30:59.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0229002a) incarnation(174631051) [ CSSD]2013-05-23 11:30:59.867 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:30:59.867 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:00.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:00.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:00.003 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:00.003 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:00.030 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678e50 [ CSSD]2013-05-23 11:31:00.030 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678e50) con(0x26a9490) skgpid ospid 24181 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:00.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:00.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:00.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:00.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:00.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:02.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:02.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:02.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:03.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022a002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:03.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:03.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:03.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:03.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:03.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022b002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:03.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:03.899 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:04.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:04.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:04.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:04.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022c002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:04.518 [1199044928] >TRACE: clssgmAllocProc: (0x267bfc0) allocated [ CSSD]2013-05-23 11:31:04.518 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:31:04.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bfc0 - 1,2,3 [ CSSD]2013-05-23 11:31:04.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d5a0) proc(0x267bfc0) pid(23749/23749) version 11:1:1:4 [ CSSD]2013-05-23 11:31:04.525 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(1/0x268bba0) [ CSSD]2013-05-23 11:31:04.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:31:04.525 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:31:04.525 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:31:04.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:05.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022d002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:05.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:05.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:05.683 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:05.683 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:05.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022e002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:05.689 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:05.690 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:05.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:05.723 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:06.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:06.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:06.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:08.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:08.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:08.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:10.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:10.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:10.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:10.725 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:10.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:12.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:12.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:12.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:14.027 [1199044928] >TRACE: clssgmAllocProc: (0x26ed050) allocated [ CSSD]2013-05-23 11:31:14.028 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:31:14.028 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed050 - 1,2,3 [ CSSD]2013-05-23 11:31:14.028 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26790e0) proc(0x26ed050) pid(24071/24071) version 11:1:1:4 [ CSSD]2013-05-23 11:31:14.044 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ed050), client(1/0x26a9560) [ CSSD]2013-05-23 11:31:14.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:31:14.044 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:31:14.044 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:31:14.179 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:14.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022f002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:14.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:14.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:14.332 [1199044928] >TRACE: clssgmAllocProc: (0x26de220) allocated [ CSSD]2013-05-23 11:31:14.333 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:31:14.334 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de220 - 1,2,3 [ CSSD]2013-05-23 11:31:14.334 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678f20) proc(0x26de220) pid(24313) version 11:1:1:4 [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26de220), client(1/0x26de9c0) [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de9c0) [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de9c0 with con 0x26de140, requested num -1 [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26deb30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:31:14.339 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:14.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de9c0) [ CSSD]2013-05-23 11:31:14.346 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de9c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:31:14.346 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dee30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:14.346 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dee30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:31:14.548 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de220 [ CSSD]2013-05-23 11:31:14.548 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de220) con(0x2678f20) skgpid ospid 24313 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:14.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:15.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:15.728 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:15.910 [1199044928] >TRACE: clssgmAllocProc: (0x26ee180) allocated [ CSSD]2013-05-23 11:31:15.911 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:31:15.911 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee180 - 1,2,3 [ CSSD]2013-05-23 11:31:15.911 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edb00) proc(0x26ee180) pid(24368/24368) version 11:1:1:4 [ CSSD]2013-05-23 11:31:15.927 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ee180), client(1/0x2681f50) [ CSSD]2013-05-23 11:31:15.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681f50) [ CSSD]2013-05-23 11:31:15.927 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:31:15.927 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 11:31:15.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681f50) [ CSSD]2013-05-23 11:31:15.986 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681f50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:31:15.986 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681f50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:31:15.986 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 11:31:15.987 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee180 [ CSSD]2013-05-23 11:31:15.987 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee180) con(0x26edb00) skgpid 24368 ospid 24368 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:16.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:16.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:16.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:18.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:18.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:18.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:20.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:20.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:20.730 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:20.730 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:20.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0230002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:20.944 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:20.944 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:20.944 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:20.944 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:20.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0231002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:20.952 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:20.952 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:21.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:22.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:22.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:23.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:24.200 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:24.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0232002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:24.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:24.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:24.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:24.732 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:31:25.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:26.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:26.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:27.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:28.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:28.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:29.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:29.593 [1199044928] >TRACE: clssgmAllocProc: (0x26ee190) allocated [ CSSD]2013-05-23 11:31:29.594 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:31:29.594 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee190 - 1,2,3 [ CSSD]2013-05-23 11:31:29.594 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edb10) proc(0x26ee190) pid(24479) version 11:1:1:4 [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ee190), client(1/0x26dea40) [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dea40) [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dea40 with con 0x26ee2c0, requested num -1 [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26debb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:31:29.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:29.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dea40) [ CSSD]2013-05-23 11:31:29.608 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dea40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:31:29.608 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:29.608 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:31:29.734 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:29.734 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:29.810 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee190 [ CSSD]2013-05-23 11:31:29.810 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee190) con(0x26edb10) skgpid ospid 24479 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:30.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:30.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:31.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:32.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:32.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:33.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:34.221 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:34.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0233002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:34.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:34.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:34.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:34.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:35.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:36.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0234002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:36.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:36.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:36.195 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:36.195 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:36.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0235002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:36.203 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:36.203 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:36.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:36.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:37.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:38.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:38.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:39.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:39.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:39.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:40.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:40.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:41.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:42.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:42.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:43.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a9560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a9560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed050 [ CSSD]2013-05-23 11:31:44.126 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed050) con(0x26790e0) skgpid 24071 ospid 24071 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:44.243 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:44.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0236002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:44.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:44.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:44.741 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:44.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:44.857 [1199044928] >TRACE: clssgmAllocProc: (0x26ecf80) allocated [ CSSD]2013-05-23 11:31:44.857 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:31:44.858 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecf80 - 1,2,3 [ CSSD]2013-05-23 11:31:44.858 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679010) proc(0x26ecf80) pid(24629) version 11:1:1:4 [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ecf80), client(1/0x26a9560) [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9560 with con 0x26aae50, requested num -1 [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:31:44.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:44.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:31:44.882 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:31:44.882 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eda10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:31:44.882 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eda10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:31:45.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecf80 [ CSSD]2013-05-23 11:31:45.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecf80) con(0x2679010) skgpid ospid 24629 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:31:45.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:45.740 [1199044928] >TRACE: clssgmAllocProc: (0x26aade0) allocated [ CSSD]2013-05-23 11:31:45.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:31:45.741 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aade0 - 1,2,3 [ CSSD]2013-05-23 11:31:45.741 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679180) proc(0x26aade0) pid(24406/24406) version 11:1:1:4 [ CSSD]2013-05-23 11:31:45.746 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aade0), client(1/0x26a9560) [ CSSD]2013-05-23 11:31:45.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:31:45.746 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:31:45.746 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:31:46.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:46.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:47.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:48.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:48.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:49.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:49.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:49.744 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:50.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:50.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:51.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:51.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0237002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:51.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:51.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:51.446 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:51.446 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:51.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0238002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:51.454 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:51.454 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:52.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:52.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:53.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:54.266 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:31:54.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0239002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:54.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:54.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:54.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:54.747 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:31:55.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:56.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023a002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:56.667 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:56.667 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:56.667 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:31:56.667 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:31:56.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023b002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:56.675 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:56.675 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:56.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:56.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:57.025 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:57.026 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:57.027 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:57.028 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:31:57.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023c002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:57.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:31:57.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:31:57.106 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06dbf0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:31:57.106 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:31:57.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023d002a) incarnation(174631051) [ CSSD]2013-05-23 11:31:57.112 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:31:57.112 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:31:57.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:58.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:31:58.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:31:59.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:31:59.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:31:59.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:00.068 [1199044928] >TRACE: clssgmAllocProc: (0x26de4a0) allocated [ CSSD]2013-05-23 11:32:00.068 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:32:00.069 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de4a0 - 1,2,3 [ CSSD]2013-05-23 11:32:00.069 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed7f0) proc(0x26de4a0) pid(24801) version 11:1:1:4 [ CSSD]2013-05-23 11:32:00.075 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26de4a0), client(1/0x26deb70) [ CSSD]2013-05-23 11:32:00.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26deb70) [ CSSD]2013-05-23 11:32:00.075 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26deb70 with con 0x26de3c0, requested num -1 [ CSSD]2013-05-23 11:32:00.075 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:00.075 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:32:00.076 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:32:00.076 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:00.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26deb70) [ CSSD]2013-05-23 11:32:00.082 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26deb70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:32:00.082 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dece0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:00.082 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dece0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:32:00.118 [1199044928] >TRACE: clssgmAllocProc: (0x2681dd0) allocated [ CSSD]2013-05-23 11:32:00.119 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:32:00.119 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681dd0 - 1,2,3 [ CSSD]2013-05-23 11:32:00.119 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fbf0) proc(0x2681dd0) pid(24807) version 11:1:1:4 [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2681dd0), client(1/0x267fca0) [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fca0) [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fca0 with con 0x2681cf0, requested num -1 [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b3ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:32:00.125 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:00.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fca0) [ CSSD]2013-05-23 11:32:00.132 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:32:00.132 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b41a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:00.132 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b41a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:32:00.285 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de4a0 [ CSSD]2013-05-23 11:32:00.285 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de4a0) con(0x26ed7f0) skgpid ospid 24801 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:00.335 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681dd0 [ CSSD]2013-05-23 11:32:00.335 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681dd0) con(0x267fbf0) skgpid ospid 24807 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:00.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:00.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:01.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:02.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:02.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:03.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:04.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023e002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:04.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:32:04.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:32:04.154 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:32:04.154 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:04.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023f002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:04.161 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:32:04.161 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:32:04.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:04.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0240002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:04.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:04.751 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:04.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:04.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:05.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:06.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0241002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:06.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:32:06.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:32:06.714 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:32:06.714 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:06.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0242002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:06.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:32:06.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:32:06.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:06.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:07.174 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aade0), client(2/0x26ed570) [ CSSD]2013-05-23 11:32:07.174 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ed570) [ CSSD]2013-05-23 11:32:07.174 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:32:07.174 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 11:32:07.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:08.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:08.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:09.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:09.674 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bfc0), client(2/0x26edac0) [ CSSD]2013-05-23 11:32:09.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26edac0) [ CSSD]2013-05-23 11:32:09.674 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:32:09.674 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:32:09.754 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:09.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:10.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:10.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:11.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:11.612 [1199044928] >TRACE: clssgmAllocProc: (0x26ded80) allocated [ CSSD]2013-05-23 11:32:11.613 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:32:11.614 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ded80 - 1,2,3 [ CSSD]2013-05-23 11:32:11.614 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edd20) proc(0x26ded80) pid(24970) version 11:1:1:4 [ CSSD]2013-05-23 11:32:12.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:12.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:13.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:14.071 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ded80 [ CSSD]2013-05-23 11:32:14.071 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ded80) con(0x26edd20) skgpid ospid 24970 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:14.309 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:14.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0243002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:14.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:14.756 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:14.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:14.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:15.378 [1199044928] >TRACE: clssgmAllocProc: (0x26decc0) allocated [ CSSD]2013-05-23 11:32:15.379 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:32:15.380 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26decc0 - 1,2,3 [ CSSD]2013-05-23 11:32:15.380 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed6e0) proc(0x26decc0) pid(25293) version 11:1:1:4 [ CSSD]2013-05-23 11:32:15.396 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26decc0), client(1/0x267fef0) [ CSSD]2013-05-23 11:32:15.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fef0) [ CSSD]2013-05-23 11:32:15.397 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fef0 with con 0x26debe0, requested num -1 [ CSSD]2013-05-23 11:32:15.397 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:15.397 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680060/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:32:15.397 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:32:15.397 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:15.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fef0) [ CSSD]2013-05-23 11:32:15.402 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fef0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:32:15.402 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680360) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:15.402 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:32:15.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:15.604 [1199044928] >TRACE: clssgmDeadProc: proc 0x26decc0 [ CSSD]2013-05-23 11:32:15.604 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26decc0) con(0x26ed6e0) skgpid ospid 25293 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:16.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:16.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:17.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:18.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:18.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:19.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:19.758 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:19.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:20.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:20.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:21.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:21.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0244002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:21.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:32:21.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:32:21.965 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:32:21.965 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:21.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0245002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:21.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:32:21.972 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:32:22.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:22.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:23.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:23.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:23.761 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:32:24.328 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:24.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0246002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:25.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:25.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:25.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:27.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:27.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:27.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:28.763 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:28.763 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:29.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:29.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:29.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:30.637 [1199044928] >TRACE: clssgmAllocProc: (0x26ded80) allocated [ CSSD]2013-05-23 11:32:30.638 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:32:30.639 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ded80 - 1,2,3 [ CSSD]2013-05-23 11:32:30.639 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edd20) proc(0x26ded80) pid(25478) version 11:1:1:4 [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ded80), client(1/0x26edea0) [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26edea0) [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26edea0 with con 0x26deca0, requested num -1 [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267ffc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:32:30.646 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:30.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26edea0) [ CSSD]2013-05-23 11:32:30.652 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26edea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:32:30.652 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26802c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:30.652 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26802c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:32:30.855 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ded80 [ CSSD]2013-05-23 11:32:30.855 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ded80) con(0x26edd20) skgpid ospid 25478 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:31.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:31.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:31.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:32.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac069bd0) [ CSSD]2013-05-23 11:32:32.884 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac069bd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:32:32.884 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac069bd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:32:32.885 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:32:32.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0690d0 [ CSSD]2013-05-23 11:32:32.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0690d0) con(0x7f82ac064970) skgpid 20958 ospid 20958 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:33.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:33.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:33.765 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:33.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:33.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:34.349 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:34.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0247002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:35.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:35.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:35.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:37.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:37.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:37.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0248002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:37.214 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:32:37.214 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:32:37.214 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:32:37.214 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:37.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0249002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:37.220 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:32:37.220 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:32:37.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:38.768 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:38.768 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:39.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:39.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:39.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:41.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:41.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:41.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:43.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:43.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:43.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:43.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:43.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:44.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c300) [ CSSD]2013-05-23 11:32:44.217 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c300), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:32:44.217 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c300), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:32:44.218 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:32:44.218 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7c0 [ CSSD]2013-05-23 11:32:44.218 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7c0) con(0x267c470) skgpid 18050 ospid 18050 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:44.382 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:44.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024a002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:45.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:45.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:45.891 [1199044928] >TRACE: clssgmAllocProc: (0x26ede10) allocated [ CSSD]2013-05-23 11:32:45.892 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:32:45.892 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ede10 - 1,2,3 [ CSSD]2013-05-23 11:32:45.892 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed870) proc(0x26ede10) pid(25637) version 11:1:1:4 [ CSSD]2013-05-23 11:32:45.897 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26ede10), client(1/0x269b130) [ CSSD]2013-05-23 11:32:45.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b130) [ CSSD]2013-05-23 11:32:45.897 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b130 with con 0x269aa60, requested num -1 [ CSSD]2013-05-23 11:32:45.897 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:45.897 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dc850/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:32:45.898 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:32:45.898 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:45.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b130) [ CSSD]2013-05-23 11:32:45.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b130), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:32:45.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:32:45.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:32:45.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:46.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ede10 [ CSSD]2013-05-23 11:32:46.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ede10) con(0x26ed870) skgpid ospid 25637 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:47.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:47.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:47.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:48.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:48.773 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:49.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:49.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:49.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268f970) [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268f970), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268f970), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:32:50.098 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid 21791 ospid 21791 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:32:51.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:51.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:51.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:52.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024b002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:52.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:32:52.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:32:52.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:32:52.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:32:52.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024c002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:52.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:32:52.482 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:32:53.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:53.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:53.775 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:53.776 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:53.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:54.401 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:32:54.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024d002a) incarnation(174631051) [ CSSD]2013-05-23 11:32:55.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:55.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:55.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:57.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:57.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:57.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:32:58.778 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:32:58.778 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:32:59.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:32:59.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:32:59.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:00.327 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:00.328 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:00.328 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:00.328 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(25787) version 11:1:1:4 [ CSSD]2013-05-23 11:33:00.334 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:00.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:00.334 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c590 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:33:00.334 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:00.334 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:33:00.335 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:00.335 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:00.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:00.341 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:33:00.341 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:00.341 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:00.544 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:00.544 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 25787 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:01.135 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:01.136 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:33:01.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:01.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(25799) version 11:1:1:4 [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c590 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:01.152 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:01.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:01.158 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:33:01.158 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268f8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:01.158 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268f8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:01.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:01.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:01.361 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:01.361 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 25799 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:02.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:03.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:03.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:03.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:03.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:04.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:04.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024e002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:04.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:33:04.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:33:04.415 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:33:04.415 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:04.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024f002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:04.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:33:04.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:33:04.424 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:04.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0250002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:05.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:05.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:06.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:07.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:07.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:07.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0251002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:07.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:33:07.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:33:07.725 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:33:07.725 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:07.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0252002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:07.732 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:33:07.732 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:33:08.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:08.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:08.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:09.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:09.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:10.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:11.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:11.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:12.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:13.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:13.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:13.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:13.785 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:14.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:14.447 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:14.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0253002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:15.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:15.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:16.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:16.386 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:16.386 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:33:16.387 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:16.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(25941) version 11:1:1:4 [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c590 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:16.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:16.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:16.397 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:33:16.397 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:16.397 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:16.599 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:16.599 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 25941 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:17.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:17.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:18.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:18.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:18.787 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:19.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:19.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:20.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:20.702 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:20.703 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:20.703 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:20.703 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(26014) version 11:1:1:4 [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x267c590 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:20.710 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:20.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:20.717 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c590), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:33:20.717 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed870) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:33:20.718 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26ed870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:20.826 [1199044928] >TRACE: clssgmAllocProc: (0x26913c0) allocated [ CSSD]2013-05-23 11:33:20.827 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:20.828 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26913c0 - 1,2,3 [ CSSD]2013-05-23 11:33:20.828 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed870) proc(0x26913c0) pid(26019) version 11:1:1:4 [ CSSD]2013-05-23 11:33:20.844 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:33:20.846 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:33:20.848 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:33:20.849 [1199044928] >TRACE: clssgmDeadProc: proc 0x26913c0 [ CSSD]2013-05-23 11:33:20.849 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26913c0) con(0x26ed870) skgpid ospid 26019 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:20.920 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:20.920 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 26014 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:21.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:21.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:22.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:22.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0254002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:22.976 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:33:22.976 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:33:22.976 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:33:22.976 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:22.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0255002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:22.984 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:33:22.984 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:33:23.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:23.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:23.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:23.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:24.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:24.469 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:24.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0256002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:25.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:25.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:26.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:27.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:27.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:28.286 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:28.286 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:28.287 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:28.287 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(26084/26084) version 11:1:1:4 [ CSSD]2013-05-23 11:33:28.304 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:28.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:28.304 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:33:28.304 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:33:28.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:28.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:28.346 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:33:28.346 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:33:28.346 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:33:28.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:28.347 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid 26084 ospid 26084 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:28.537 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:28.537 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:28.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:28.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(26093/26093) version 11:1:1:4 [ CSSD]2013-05-23 11:33:28.554 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:28.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:28.554 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:33:28.554 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:28.602 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid 26093 ospid 26093 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:28.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:28.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:29.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:29.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:30.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:31.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:31.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:31.634 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:31.635 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:33:31.635 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:31.636 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(26119) version 11:1:1:4 [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x26ede70) [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ede70) [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ede70 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:31.640 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:31.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ede70) [ CSSD]2013-05-23 11:33:31.646 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ede70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:33:31.646 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:31.646 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:31.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:31.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 26119 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:32.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:33.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:33.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:33.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:33.795 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:34.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:34.492 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:34.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0257002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:35.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:35.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:36.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:37.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:37.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:38.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0258002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:38.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:33:38.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:33:38.228 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:33:38.228 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:38.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0259002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:38.235 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:33:38.235 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:33:38.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:38.799 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:38.799 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:39.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:39.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:40.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:40.722 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:40.722 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:33:40.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:40.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x2650970) pid(26237) version 11:1:1:4 [ CSSD]2013-05-23 11:33:41.259 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:41.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x26ee500) skgpid ospid 26237 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:41.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:41.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:42.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:43.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:43.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:43.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:43.802 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:44.514 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:44.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:44.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025a002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:45.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:45.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:46.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:46.892 [1199044928] >TRACE: clssgmAllocProc: (0x2650970) allocated [ CSSD]2013-05-23 11:33:46.893 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:33:46.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650970 - 1,2,3 [ CSSD]2013-05-23 11:33:46.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x2650970) pid(26434) version 11:1:1:4 [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2650970), client(1/0x267c590) [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c590 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:33:46.900 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:46.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c590) [ CSSD]2013-05-23 11:33:46.906 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:33:46.906 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:33:46.906 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:33:47.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650970 [ CSSD]2013-05-23 11:33:47.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650970) con(0x2660e70) skgpid ospid 26434 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:47.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:47.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:47.805 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:47.805 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:33:48.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:48.992 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 11:33:48.992 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef0a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:33:48.992 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef0a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:33:48.992 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a9600) [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a9600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a9600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9000 [ CSSD]2013-05-23 11:33:48.996 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9000) con(0x269f440) skgpid 20513 ospid 20513 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef150) [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef150), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef150), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 11:33:48.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x268fa10) skgpid 18882 ospid 18882 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:49.001 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f0d0) [ CSSD]2013-05-23 11:33:49.001 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f0d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:33:49.001 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f0d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:33:49.001 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 11:33:49.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x266eb60 [ CSSD]2013-05-23 11:33:49.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266eb60) con(0x26a6950) skgpid 20515 ospid 20515 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:33:49.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:49.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:50.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:51.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:51.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:52.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:52.808 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:52.808 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:53.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025b002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:53.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:33:53.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:33:53.478 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:33:53.478 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:33:53.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025c002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:53.484 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:33:53.485 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:33:53.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:53.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:54.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:33:54.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:55.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025d002a) incarnation(174631051) [ CSSD]2013-05-23 11:33:55.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:55.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:56.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:57.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:57.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:33:57.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:33:57.811 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:33:58.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:33:59.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:33:59.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:00.592 [1199044928] >TRACE: clssgmAllocProc: (0x267c4d0) allocated [ CSSD]2013-05-23 11:34:00.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:34:00.594 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c4d0 - 1,2,3 [ CSSD]2013-05-23 11:34:00.594 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x267c4d0) pid(26564) version 11:1:1:4 [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267c4d0), client(1/0x26a9600) [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9600) [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9600 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:00.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:00.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9600) [ CSSD]2013-05-23 11:34:00.608 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:34:00.609 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:00.609 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:00.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:00.811 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c4d0 [ CSSD]2013-05-23 11:34:00.811 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c4d0) con(0x2660e70) skgpid ospid 26564 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:01.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:01.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:02.143 [1199044928] >TRACE: clssgmAllocProc: (0x267c4d0) allocated [ CSSD]2013-05-23 11:34:02.144 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:34:02.144 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c4d0 - 1,2,3 [ CSSD]2013-05-23 11:34:02.144 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x267c4d0) pid(26586) version 11:1:1:4 [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267c4d0), client(1/0x266f0d0) [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f0d0) [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f0d0 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:02.150 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:02.155 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f0d0) [ CSSD]2013-05-23 11:34:02.155 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f0d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:34:02.155 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:02.155 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:02.357 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c4d0 [ CSSD]2013-05-23 11:34:02.357 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c4d0) con(0x2660e70) skgpid ospid 26586 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:02.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:02.813 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:02.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:03.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:03.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:04.561 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:04.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025e002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:04.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:34:04.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:34:04.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:34:04.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:04.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025f002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:04.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:34:04.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:34:04.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:05.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0260002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:05.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:05.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:06.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:06.914 [1199044928] >TRACE: clssgmAllocProc: (0x267c4d0) allocated [ CSSD]2013-05-23 11:34:06.915 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:34:06.916 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c4d0 - 1,2,3 [ CSSD]2013-05-23 11:34:06.916 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x267c4d0) pid(26669) version 11:1:1:4 [ CSSD]2013-05-23 11:34:07.034 [1199044928] >TRACE: clssgmAllocProc: (0x26eeb30) allocated [ CSSD]2013-05-23 11:34:07.035 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:34:07.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eeb30 - 1,2,3 [ CSSD]2013-05-23 11:34:07.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f190) proc(0x26eeb30) pid(26679) version 11:1:1:4 [ CSSD]2013-05-23 11:34:07.053 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:34:07.055 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:34:07.058 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eeb30 [ CSSD]2013-05-23 11:34:07.058 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eeb30) con(0x266f190) skgpid ospid 26679 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5287/0x26a96c0) [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5287 (0x26a96c0) [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26a96c0 with con 0x26ed9f0, requested num -1 [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26edc30/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:07.136 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:34:07.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5287 (0x26a96c0) [ CSSD]2013-05-23 11:34:07.143 [1199044928] >TRACE: clssgmExitGrock: client 5287 (0x26a96c0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:34:07.143 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a1950) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:34:07.143 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26a1950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:07.144 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c4d0 [ CSSD]2013-05-23 11:34:07.144 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c4d0) con(0x2660e70) skgpid ospid 26669 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:07.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:07.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:07.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:07.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:08.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0261002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:08.728 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:34:08.728 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:34:08.728 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:34:08.728 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:08.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0262002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:08.735 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:34:08.735 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:34:08.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:09.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:09.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:10.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:11.818 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:11.818 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:34:11.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:11.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:12.706 [1199044928] >TRACE: clssgmAllocProc: (0x267c4d0) allocated [ CSSD]2013-05-23 11:34:12.706 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:34:12.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c4d0 - 1,2,3 [ CSSD]2013-05-23 11:34:12.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x267c4d0) pid(26487/26487) version 11:1:1:4 [ CSSD]2013-05-23 11:34:12.722 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267c4d0), client(1/0x266f190) [ CSSD]2013-05-23 11:34:12.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f190) [ CSSD]2013-05-23 11:34:12.722 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:34:12.722 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 11:34:12.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:13.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:13.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:14.582 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:14.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:15.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0263002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:15.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:15.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:16.820 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:16.820 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:16.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:17.400 [1199044928] >TRACE: clssgmAllocProc: (0x268bc40) allocated [ CSSD]2013-05-23 11:34:17.401 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:34:17.402 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bc40 - 1,2,3 [ CSSD]2013-05-23 11:34:17.402 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eda10) proc(0x268bc40) pid(26753) version 11:1:1:4 [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bc40), client(1/0x26eed10) [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eb60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:17.408 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:17.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:17.414 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:34:17.414 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:17.414 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:17.617 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bc40 [ CSSD]2013-05-23 11:34:17.617 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bc40) con(0x26eda10) skgpid ospid 26753 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:17.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:17.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:18.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:19.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:19.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:20.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:21.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:21.823 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:21.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:21.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:22.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:23.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:23.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:23.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0264002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:23.987 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:34:23.987 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:34:23.988 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:34:23.988 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:23.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0265002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:23.994 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:34:23.994 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:34:24.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:24.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:25.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0266002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:25.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:25.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:26.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:26.825 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:27.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:27.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:27.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:29.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:29.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:29.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:31.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:31.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:31.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:31.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:31.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:32.663 [1199044928] >TRACE: clssgmAllocProc: (0x268bc40) allocated [ CSSD]2013-05-23 11:34:32.664 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:34:32.664 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bc40 - 1,2,3 [ CSSD]2013-05-23 11:34:32.664 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed870) proc(0x268bc40) pid(26911) version 11:1:1:4 [ CSSD]2013-05-23 11:34:32.670 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bc40), client(1/0x26eed10) [ CSSD]2013-05-23 11:34:32.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:32.670 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26eda10, requested num -1 [ CSSD]2013-05-23 11:34:32.670 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:32.670 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:34:32.671 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:32.671 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:32.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:32.677 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:34:32.677 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266eb60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:32.678 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266eb60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:32.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bc40 [ CSSD]2013-05-23 11:34:32.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bc40) con(0x26ed870) skgpid ospid 26911 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:33.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:33.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:33.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:34.625 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:35.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:35.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0267002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:36.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:36.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:36.830 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:36.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:37.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:38.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:38.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:39.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:39.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0268002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:39.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:34:39.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:34:39.237 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:34:39.237 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:39.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0269002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:39.244 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:34:39.244 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:34:40.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:40.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:40.832 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:40.832 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:34:41.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:42.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:42.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:43.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:44.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:44.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:44.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:45.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:45.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026a002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:45.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:45.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:46.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:46.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:47.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:47.913 [1199044928] >TRACE: clssgmAllocProc: (0x268bc40) allocated [ CSSD]2013-05-23 11:34:47.913 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:34:47.914 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bc40 - 1,2,3 [ CSSD]2013-05-23 11:34:47.914 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eda10) proc(0x268bc40) pid(27082) version 11:1:1:4 [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bc40), client(1/0x26eed10) [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x266eb60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:34:47.920 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:47.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:34:47.927 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:34:47.927 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:34:47.927 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:34:48.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:48.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:48.130 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bc40 [ CSSD]2013-05-23 11:34:48.130 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bc40) con(0x26eda10) skgpid ospid 27082 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:34:49.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:50.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:50.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:50.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:50.837 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:51.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:52.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:52.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:53.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:54.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:54.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:54.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026b002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:54.487 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:34:54.487 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:34:54.487 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:34:54.487 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:34:54.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026c002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:54.493 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:34:54.493 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:34:54.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:34:55.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:55.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026d002a) incarnation(174631051) [ CSSD]2013-05-23 11:34:55.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:34:55.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:34:56.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:56.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:57.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:34:58.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:34:58.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:34:59.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:00.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:00.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:00.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:00.842 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:00.853 [1199044928] >TRACE: clssgmAllocProc: (0x26a1a20) allocated [ CSSD]2013-05-23 11:35:00.854 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:35:00.855 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a1a20 - 1,2,3 [ CSSD]2013-05-23 11:35:00.855 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26a1a20) pid(27217) version 11:1:1:4 [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26a1a20), client(1/0x26eed10) [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:35:00.861 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:00.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:35:00.867 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:35:00.867 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266eb60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:00.867 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266eb60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:35:01.070 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a1a20 [ CSSD]2013-05-23 11:35:01.070 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a1a20) con(0x26e87a0) skgpid ospid 27217 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:01.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:02.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:02.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:03.172 [1199044928] >TRACE: clssgmAllocProc: (0x26ed940) allocated [ CSSD]2013-05-23 11:35:03.173 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:35:03.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed940 - 1,2,3 [ CSSD]2013-05-23 11:35:03.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a70) proc(0x26ed940) pid(27250) version 11:1:1:4 [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ed940), client(1/0x26eed10) [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26a6940, requested num -1 [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:35:03.179 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:03.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 11:35:03.186 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:35:03.186 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:03.186 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:35:03.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:03.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed940 [ CSSD]2013-05-23 11:35:03.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed940) con(0x26a6a70) skgpid ospid 27250 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:04.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:04.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:04.499 [1199044928] >TRACE: clssgmAllocProc: (0x268bc40) allocated [ CSSD]2013-05-23 11:35:04.499 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:35:04.499 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bc40 - 1,2,3 [ CSSD]2013-05-23 11:35:04.499 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ed0) proc(0x268bc40) pid(27302/27302) version 11:1:1:4 [ CSSD]2013-05-23 11:35:04.516 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bc40), client(1/0x26a96d0) [ CSSD]2013-05-23 11:35:04.516 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a96d0) [ CSSD]2013-05-23 11:35:04.516 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:35:04.516 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:35:04.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a96d0) [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a96d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a96d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bc40 [ CSSD]2013-05-23 11:35:04.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bc40) con(0x26e4ed0) skgpid 27302 ospid 27302 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:04.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026e002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:04.926 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:35:04.926 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:35:04.926 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:35:04.926 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:04.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026f002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:04.932 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:35:04.932 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:35:05.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:05.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0270002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:05.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:05.845 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:06.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:06.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:07.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:08.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:08.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:09.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:09.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0271002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:09.744 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:35:09.744 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:35:09.744 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:35:09.744 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:09.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0272002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:09.751 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:35:09.751 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:35:09.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:09.847 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:35:10.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:10.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:11.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:12.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:12.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:13.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:14.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:14.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:14.593 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267c4d0), client(2/0x26a96d0) [ CSSD]2013-05-23 11:35:14.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26a96d0) [ CSSD]2013-05-23 11:35:14.593 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:35:14.593 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:35:14.712 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:14.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:14.849 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:15.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:15.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0273002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:16.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:16.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:17.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:18.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:18.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:18.422 [1199044928] >TRACE: clssgmAllocProc: (0x26ce010) allocated [ CSSD]2013-05-23 11:35:18.422 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:35:18.423 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce010 - 1,2,3 [ CSSD]2013-05-23 11:35:18.423 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a1af0) proc(0x26ce010) pid(27401) version 11:1:1:4 [ CSSD]2013-05-23 11:35:18.428 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ce010), client(1/0x7f82ac0076c0) [ CSSD]2013-05-23 11:35:18.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076c0) [ CSSD]2013-05-23 11:35:18.428 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076c0 with con 0x7f82ac06d020, requested num -1 [ CSSD]2013-05-23 11:35:18.428 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:18.428 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:35:18.429 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:35:18.429 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:18.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076c0) [ CSSD]2013-05-23 11:35:18.435 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:35:18.435 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac074560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:18.435 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac074560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:35:18.638 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce010 [ CSSD]2013-05-23 11:35:18.638 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce010) con(0x26a1af0) skgpid ospid 27401 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:19.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:19.851 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:19.852 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:20.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:20.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:21.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:22.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:22.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:23.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:24.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:24.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:24.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:24.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:24.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:24.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0274002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:24.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:35:24.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:35:24.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:35:24.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:25.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0275002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:25.000 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:35:25.000 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:35:25.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0276002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:25.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:26.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:26.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:27.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:28.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:28.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:29.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:29.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:29.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:30.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:30.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:31.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:32.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:32.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:33.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:33.670 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:35:33.671 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:35:33.671 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:35:33.671 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac074620) proc(0x7f82ac00b2f0) pid(27556) version 11:1:1:4 [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac069820 with con 0x7f82ac06d340, requested num -1 [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06cb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:35:33.688 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:33.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:35:33.695 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:35:33.695 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06dcc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:33.695 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06dcc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:35:33.897 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:35:33.897 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac074620) skgpid ospid 27556 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:34.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:34.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:34.757 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:34.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:34.859 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:35.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0277002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:35.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:36.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:36.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:37.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:38.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:38.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:38.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:38.861 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:35:39.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:40.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0278002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:40.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:35:40.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:35:40.244 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:35:40.244 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:40.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0279002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:40.251 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:35:40.251 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:35:40.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:40.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:41.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:42.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:42.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:43.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:43.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:43.864 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:44.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:44.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:44.776 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:45.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027a002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:45.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:46.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:46.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:47.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:48.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:48.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:48.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:48.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:48.940 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:35:48.941 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:35:48.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:35:48.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac00b2f0) pid(27717) version 11:1:1:4 [ CSSD]2013-05-23 11:35:48.947 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:35:48.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:35:48.947 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac069820 with con 0x7f82ac072790, requested num -1 [ CSSD]2013-05-23 11:35:48.947 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:48.947 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:35:48.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:35:48.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:48.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:35:48.953 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:35:48.953 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06dd70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:35:48.953 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06dd70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:35:49.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:35:49.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac0076c0) skgpid ospid 27717 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:35:49.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:50.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:50.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:51.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:52.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:52.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:53.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:53.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:53.868 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:54.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:54.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:54.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:35:55.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027b002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:55.493 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:35:55.493 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:35:55.493 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06bd50/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:35:55.493 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:35:55.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027c002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:55.500 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:35:55.500 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:35:55.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027d002a) incarnation(174631051) [ CSSD]2013-05-23 11:35:55.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:56.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:56.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:57.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:35:58.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:35:58.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:35:58.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:35:58.871 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:35:59.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:00.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027e002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:00.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:00.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:00.163 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06bd50/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:36:00.163 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:00.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027f002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:00.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:00.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:00.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:00.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:00.304 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:00.304 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:00.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:00.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:01.109 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:36:01.110 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:36:01.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:36:01.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac00b2f0) pid(27846) version 11:1:1:4 [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac069820 with con 0x7f82ac072790, requested num -1 [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06cb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:36:01.117 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:01.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:01.124 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:36:01.124 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06bed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:01.124 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06bed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:36:01.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:36:01.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac0076c0) skgpid ospid 27846 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:01.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:02.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:02.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:03.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:03.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:03.873 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:04.188 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:36:04.189 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:36:04.190 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:36:04.190 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac074620) proc(0x7f82ac00b2f0) pid(27877) version 11:1:1:4 [ CSSD]2013-05-23 11:36:04.195 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:36:04.195 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:04.195 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac069820 with con 0x7f82ac06d340, requested num -1 [ CSSD]2013-05-23 11:36:04.195 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:04.195 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:36:04.196 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:36:04.196 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:04.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:04.202 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:36:04.202 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06dcc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:04.203 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06dcc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:36:04.405 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:36:04.405 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac074620) skgpid ospid 27877 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:04.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:04.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:04.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:05.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0280002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:05.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:05.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:05.182 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:36:05.182 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:05.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0281002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:05.189 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:05.189 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:05.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0282002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:05.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:06.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:06.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:07.875 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:07.875 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:36:07.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:08.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:08.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:09.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:10.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:10.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:10.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0283002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:10.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:10.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:10.743 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06dbf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:36:10.743 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:10.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0284002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:10.751 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:10.751 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06d430) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:11.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:12.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:12.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:12.878 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:12.878 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:13.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:14.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:14.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:14.845 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:15.598 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:36:15.599 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:36:15.600 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:36:15.600 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac00b2f0) pid(27996/27996) version 11:1:1:4 [ CSSD]2013-05-23 11:36:15.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0285002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:15.606 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:36:15.606 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:15.606 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:36:15.606 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac069820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac069820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:36:15.626 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac0076c0) skgpid 27996 ospid 27996 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:15.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:16.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:16.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:17.880 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:17.881 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:17.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:18.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:18.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:19.443 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:36:19.444 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:36:19.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:36:19.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac00b2f0) pid(28030) version 11:1:1:4 [ CSSD]2013-05-23 11:36:19.451 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:36:19.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:19.451 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac069820 with con 0x7f82ac072790, requested num -1 [ CSSD]2013-05-23 11:36:19.451 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:19.451 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06cb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:36:19.452 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:36:19.452 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:19.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:19.459 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac069820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:36:19.459 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06bed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:19.460 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06bed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:36:19.663 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:36:19.663 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac0076c0) skgpid ospid 28030 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:19.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:20.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:20.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:22.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:22.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:22.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:22.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:22.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:23.265 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00b2f0) allocated [ CSSD]2013-05-23 11:36:23.266 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:36:23.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00b2f0 - 1,2,3 [ CSSD]2013-05-23 11:36:23.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac00b2f0) pid(28033/28033) version 11:1:1:4 [ CSSD]2013-05-23 11:36:23.284 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac00b2f0), client(1/0x7f82ac069820) [ CSSD]2013-05-23 11:36:23.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:36:23.284 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:36:23.284 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:36:24.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:24.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:24.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:24.865 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:25.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0286002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:25.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0287002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:25.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:25.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:25.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:36:25.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:26.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0288002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:26.000 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:26.000 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06bef0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:26.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:26.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:26.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:27.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:27.886 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:28.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:28.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:28.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:30.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:30.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:30.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:32.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:32.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:32.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:32.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:32.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:34.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:34.695 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac068c20) allocated [ CSSD]2013-05-23 11:36:34.696 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:36:34.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac068c20 - 1,2,3 [ CSSD]2013-05-23 11:36:34.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de50) proc(0x7f82ac068c20) pid(28175) version 11:1:1:4 [ CSSD]2013-05-23 11:36:34.702 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac068c20), client(1/0x7f82ac0192d0) [ CSSD]2013-05-23 11:36:34.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 11:36:34.702 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0192d0 with con 0x7f82ac068b60, requested num -1 [ CSSD]2013-05-23 11:36:34.702 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:34.702 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0197d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:36:34.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:36:34.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:34.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 11:36:34.710 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0192d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:36:34.710 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:34.710 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:36:34.886 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:34.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:34.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:34.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac068c20 [ CSSD]2013-05-23 11:36:34.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac068c20) con(0x7f82ac06de50) skgpid ospid 28175 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:35.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0289002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:36.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:36.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:36.890 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:36:36.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:36.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:38.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:38.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:38.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:40.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:40.669 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac068c20) allocated [ CSSD]2013-05-23 11:36:40.670 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:36:40.670 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac068c20 - 1,2,3 [ CSSD]2013-05-23 11:36:40.670 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de50) proc(0x7f82ac068c20) pid(28258/28258) version 11:1:1:4 [ CSSD]2013-05-23 11:36:40.687 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac068c20), client(1/0x7f82ac0192d0) [ CSSD]2013-05-23 11:36:40.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 11:36:40.688 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:36:40.688 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:36:40.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:40.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:41.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028a002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:41.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:41.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:41.248 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:36:41.248 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:41.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028b002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:41.254 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:41.255 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:41.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:41.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:42.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:42.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:42.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:44.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:44.907 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:44.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:44.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:45.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028c002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:46.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:46.894 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:46.895 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:46.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:46.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:48.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:48.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:48.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:49.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:36:49.946 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:36:49.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:36:49.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(28329) version 11:1:1:4 [ CSSD]2013-05-23 11:36:49.952 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:36:49.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:36:49.952 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:36:49.952 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:49.952 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:36:49.953 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:36:49.953 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:49.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:36:49.960 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:36:49.960 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:36:49.960 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:36:50.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:36:50.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 28329 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:36:50.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:50.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:50.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:51.897 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:51.897 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:52.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:52.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:52.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:54.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:54.934 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:36:55.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:55.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:55.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028d002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:56.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:56.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028e002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:56.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:56.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:56.497 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:36:56.497 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:36:56.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028f002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:56.504 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:56.505 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:56.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:36:56.899 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:36:57.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:57.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:36:57.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:57.339 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:57.340 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:57.341 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:36:57.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0290002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:57.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:36:57.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:36:57.417 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac019660/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:36:57.417 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:36:57.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0291002a) incarnation(174631051) [ CSSD]2013-05-23 11:36:57.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:36:57.423 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:36:58.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:36:59.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:36:59.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:00.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:01.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:01.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:01.365 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:01.366 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:37:01.366 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:01.366 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(28447) version 11:1:1:4 [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:01.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:01.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:01.380 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:01.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:01.380 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:01.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:01.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 28447 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:01.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:01.902 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:02.235 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b70) allocated [ CSSD]2013-05-23 11:37:02.236 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:37:02.236 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b70 - 1,2,3 [ CSSD]2013-05-23 11:37:02.236 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006b70) pid(28463) version 11:1:1:4 [ CSSD]2013-05-23 11:37:02.243 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006b70), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:02.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:02.243 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac006ab0, requested num -1 [ CSSD]2013-05-23 11:37:02.243 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:02.243 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:02.244 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:02.244 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:02.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:02.250 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:02.250 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:02.250 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:02.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:02.453 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b70 [ CSSD]2013-05-23 11:37:02.453 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b70) con(0x7f82ac06dcb0) skgpid ospid 28463 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:03.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:03.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:04.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:04.966 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:05.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:05.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:05.195 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:05.196 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:37:05.196 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:05.196 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(28507) version 11:1:1:4 [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:05.203 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:05.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:05.210 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:05.210 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:05.210 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:05.412 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:05.412 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 28507 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:05.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0292002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:05.434 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:37:05.434 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:37:05.434 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:37:05.434 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:05.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0293002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:05.441 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:37:05.441 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c290) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:37:05.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0294002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:05.904 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:05.904 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:37:06.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:07.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:07.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:08.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:09.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:09.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:10.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:10.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:10.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:11.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:11.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:11.456 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:11.457 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:37:11.458 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:11.458 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(28630) version 11:1:1:4 [ CSSD]2013-05-23 11:37:11.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0295002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:11.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:37:11.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:37:11.754 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:37:11.754 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:11.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0296002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:11.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:37:11.760 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012a50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:37:12.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:13.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:13.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:14.094 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:14.094 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 28630 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:14.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:14.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:15.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:15.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:15.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0297002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:15.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:15.909 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:16.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:17.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:17.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:18.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:19.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:19.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:20.446 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:20.447 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:37:20.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:20.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29007) version 11:1:1:4 [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:20.454 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:20.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:20.461 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:20.461 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:20.461 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:20.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:20.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:20.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29007 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:20.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:20.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:21.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:21.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:22.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:23.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:23.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:24.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:25.010 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:25.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:25.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:25.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0298002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:25.913 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:25.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:26.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:27.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0299002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:27.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:37:27.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:37:27.003 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:37:27.003 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:27.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029a002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:27.011 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:37:27.011 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:37:27.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:27.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:28.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:29.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:29.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:30.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:30.916 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:30.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:31.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:31.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:31.738 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:31.739 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:37:31.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:31.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29130) version 11:1:1:4 [ CSSD]2013-05-23 11:37:31.746 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:31.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:31.746 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:31.746 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:31.746 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:31.747 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:31.747 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:31.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:31.753 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:31.753 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:31.754 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:31.956 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:31.956 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29130 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:32.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:33.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:33.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:34.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:34.918 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:34.918 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:37:35.030 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:35.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:35.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:35.700 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:35.701 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:37:35.701 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:35.701 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29163) version 11:1:1:4 [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:35.707 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:35.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:35.714 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:35.714 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:35.714 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:35.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029b002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:35.916 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:35.916 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29163 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:36.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:37.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:37.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:38.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:39.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:39.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:39.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:39.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:40.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:41.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:41.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:42.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029c002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:42.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:37:42.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:37:42.254 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:37:42.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:42.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029d002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:42.261 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:37:42.261 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:37:42.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:43.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:43.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:44.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:44.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:44.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:45.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:45.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:45.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:45.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029e002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:46.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:47.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:47.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:48.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:49.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:49.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:49.925 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:49.925 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:50.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:50.959 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:37:50.960 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:37:50.960 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:37:50.960 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c370) proc(0x7f82ac006e00) pid(29350) version 11:1:1:4 [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0087a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:37:50.967 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:50.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:37:50.974 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:37:50.974 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:37:50.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:37:51.177 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:37:51.177 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06c370) skgpid ospid 29350 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:37:51.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:51.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:52.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:53.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:53.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:54.928 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:54.928 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:37:54.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:55.074 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:37:55.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:55.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:55.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029f002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:57.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:57.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:57.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:57.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a0002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:57.515 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:37:57.515 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:37:57.515 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:37:57.515 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:37:57.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a1002a) incarnation(174631051) [ CSSD]2013-05-23 11:37:57.522 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:37:57.522 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:37:59.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:37:59.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:37:59.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:37:59.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:37:59.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:01.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:01.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:01.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:01.630 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:01.631 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:01.631 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:01.631 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29469) version 11:1:1:4 [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:01.638 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:01.645 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:01.645 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:38:01.645 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:01.645 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:01.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:01.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29469 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:03.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:03.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:03.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:04.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:04.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:05.094 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:05.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:05.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:05.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:05.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a2002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:05.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:38:05.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:38:05.685 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:38:05.685 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:05.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a3002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:05.692 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:38:05.692 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:38:05.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a4002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:06.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:06.212 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:38:06.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:06.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29508) version 11:1:1:4 [ CSSD]2013-05-23 11:38:06.218 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:06.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:06.218 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:38:06.218 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:06.218 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:38:06.219 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:06.219 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:06.225 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:06.225 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:38:06.225 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:06.225 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:06.427 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:06.427 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29508 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:07.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:07.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:07.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:09.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:09.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:09.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:09.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:09.935 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:11.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:11.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:11.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:12.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a5002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:12.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:38:12.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:38:12.765 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:38:12.765 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:12.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a6002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:12.773 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:38:12.773 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:38:13.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:13.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:13.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:14.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:14.938 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:15.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:15.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:15.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:15.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:15.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a7002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:17.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:17.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:17.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:19.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:19.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:19.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:19.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:19.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:21.000 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:21.001 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:21.001 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:21.001 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29645) version 11:1:1:4 [ CSSD]2013-05-23 11:38:21.008 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.008 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:38:21.008 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:38:21.008 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:38:21.009 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:21.009 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:21.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.015 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:38:21.015 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:38:21.015 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:21.122 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac074150) allocated [ CSSD]2013-05-23 11:38:21.123 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:21.123 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac074150 - 1,2,3 [ CSSD]2013-05-23 11:38:21.123 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac012db0) proc(0x7f82ac074150) pid(29650) version 11:1:1:4 [ CSSD]2013-05-23 11:38:21.139 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:38:21.141 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:38:21.144 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:38:21.146 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac074150 [ CSSD]2013-05-23 11:38:21.146 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac074150) con(0x7f82ac012db0) skgpid ospid 29650 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:21.218 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:21.218 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29645 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:21.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:21.460 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b70) allocated [ CSSD]2013-05-23 11:38:21.461 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:38:21.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b70 - 1,2,3 [ CSSD]2013-05-23 11:38:21.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019b20) proc(0x7f82ac006b70) pid(29656) version 11:1:1:4 [ CSSD]2013-05-23 11:38:21.467 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006b70), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.467 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac006ab0, requested num -1 [ CSSD]2013-05-23 11:38:21.467 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:21.468 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:38:21.468 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:21.468 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:21.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:21.474 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:38:21.474 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac008920) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:21.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac008920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:21.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b70 [ CSSD]2013-05-23 11:38:21.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b70) con(0x7f82ac019b20) skgpid ospid 29656 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:21.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:21.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:23.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:23.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:23.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:24.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:24.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:25.143 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:25.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:25.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:25.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:25.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a8002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:27.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:27.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:27.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:28.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a9002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:28.026 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:38:28.026 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:38:28.026 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:38:28.026 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:28.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02aa002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:28.034 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:38:28.034 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c380) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:38:29.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:29.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:29.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:29.944 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:29.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:31.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:31.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:31.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:33.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:33.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:33.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:33.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:33.947 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:38:35.168 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:35.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:35.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:35.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:35.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ab002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:36.710 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:36.711 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:38:36.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:36.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29826) version 11:1:1:4 [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0727a0 with con 0x7f82ac012ae0, requested num -1 [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0086e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:36.718 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:36.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:36.725 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0727a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:38:36.725 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:36.725 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:36.928 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:36.928 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29826 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:37.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:37.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:37.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:38.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:38.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:39.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:39.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:39.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:41.019 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:41.020 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:41.020 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:41.020 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29937/29937) version 11:1:1:4 [ CSSD]2013-05-23 11:38:41.036 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006e00), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:41.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:41.036 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:38:41.036 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0727a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0727a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:41.046 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid 29937 ospid 29937 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:41.226 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006e00) allocated [ CSSD]2013-05-23 11:38:41.227 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:41.227 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006e00 - 1,2,3 [ CSSD]2013-05-23 11:38:41.227 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac006e00) pid(29909) version 11:1:1:4 [ CSSD]2013-05-23 11:38:41.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:41.685 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac073f30) allocated [ CSSD]2013-05-23 11:38:41.686 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:41.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac073f30 - 1,2,3 [ CSSD]2013-05-23 11:38:41.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0087b0) proc(0x7f82ac073f30) pid(29948/29948) version 11:1:1:4 [ CSSD]2013-05-23 11:38:41.692 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac073f30), client(1/0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:41.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:38:41.692 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:38:41.692 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:38:41.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006e00 [ CSSD]2013-05-23 11:38:41.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006e00) con(0x7f82ac06dcb0) skgpid ospid 29909 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:41.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:41.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:43.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ac002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:43.288 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:38:43.288 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:38:43.288 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:38:43.288 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:43.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ad002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:43.295 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:38:43.296 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012b10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:38:43.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:43.951 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:43.952 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:43.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:43.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:45.189 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:45.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:46.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:46.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:46.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ae002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:47.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:48.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:48.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:48.954 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:48.954 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:49.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ed570) [ CSSD]2013-05-23 11:38:49.086 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ed570), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:38:49.086 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ed570), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:38:49.086 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a9560) [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a9560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a9560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aade0 [ CSSD]2013-05-23 11:38:49.093 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aade0) con(0x2679180) skgpid 24406 ospid 24406 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:49.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:50.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:50.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:50.770 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00d4f0) allocated [ CSSD]2013-05-23 11:38:50.770 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:38:50.771 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00d4f0 - 1,2,3 [ CSSD]2013-05-23 11:38:50.771 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06dcb0) proc(0x7f82ac00d4f0) pid(30126/30126) version 11:1:1:4 [ CSSD]2013-05-23 11:38:50.776 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00d4f0), client(1/0x7f82ac006eb0) [ CSSD]2013-05-23 11:38:50.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac006eb0) [ CSSD]2013-05-23 11:38:50.776 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:38:50.776 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:38:51.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:51.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06af90) allocated [ CSSD]2013-05-23 11:38:51.961 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:38:51.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06af90 - 1,2,3 [ CSSD]2013-05-23 11:38:51.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e0c0) proc(0x7f82ac06af90) pid(30150) version 11:1:1:4 [ CSSD]2013-05-23 11:38:51.967 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac06af90), client(1/0x7f82ac00f5b0) [ CSSD]2013-05-23 11:38:51.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00f5b0) [ CSSD]2013-05-23 11:38:51.967 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00f5b0 with con 0x7f82ac00e3c0, requested num -1 [ CSSD]2013-05-23 11:38:51.967 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:51.967 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00f720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:38:51.968 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:38:51.968 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:51.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00f5b0) [ CSSD]2013-05-23 11:38:51.974 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00f5b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:38:51.974 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:38:51.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:38:52.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:52.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:52.177 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06af90 [ CSSD]2013-05-23 11:38:52.177 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06af90) con(0x7f82ac00e0c0) skgpid ospid 30150 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:38:53.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:53.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:53.957 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:54.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:54.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:55.209 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:38:55.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:56.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02af002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:56.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:56.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:57.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:38:58.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:38:58.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:38:58.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b0002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:58.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:38:58.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:38:58.559 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00da20/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:38:58.559 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:38:58.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b1002a) incarnation(174631051) [ CSSD]2013-05-23 11:38:58.567 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:38:58.567 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00d800) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:38:58.959 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:38:58.959 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:38:59.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:00.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:00.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:01.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:01.892 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06af90) allocated [ CSSD]2013-05-23 11:39:01.893 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:39:01.894 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06af90 - 1,2,3 [ CSSD]2013-05-23 11:39:01.894 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e0c0) proc(0x7f82ac06af90) pid(30274) version 11:1:1:4 [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac06af90), client(1/0x7f82ac00f5b0) [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00f5b0) [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00f5b0 with con 0x7f82ac00e3c0, requested num -1 [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00f720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:39:01.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:01.912 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:01.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00f5b0) [ CSSD]2013-05-23 11:39:01.919 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00f5b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:39:01.919 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:01.919 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:02.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06af90 [ CSSD]2013-05-23 11:39:02.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06af90) con(0x7f82ac00e0c0) skgpid ospid 30274 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:02.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:02.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:03.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:03.961 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:03.962 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:04.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:04.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:05.230 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:05.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:05.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b2002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:05.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:39:05.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:39:05.950 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00db30/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:39:05.951 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:05.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b3002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:05.959 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:39:05.959 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00d800) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:39:06.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b4002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:06.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:06.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:07.029 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00d4f0), client(2/0x7f82ac00dd20) [ CSSD]2013-05-23 11:39:07.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac00dd20) [ CSSD]2013-05-23 11:39:07.029 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:39:07.029 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:39:07.222 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f2a0) allocated [ CSSD]2013-05-23 11:39:07.223 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:39:07.223 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f2a0 - 1,2,3 [ CSSD]2013-05-23 11:39:07.223 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e420) proc(0x7f82ac00f2a0) pid(30325) version 11:1:1:4 [ CSSD]2013-05-23 11:39:07.224 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00a5f0) allocated [ CSSD]2013-05-23 11:39:07.225 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:39:07.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00a5f0 - 1,2,3 [ CSSD]2013-05-23 11:39:07.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00f9c0) proc(0x7f82ac00a5f0) pid(30328) version 11:1:1:4 [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00f2a0), client(1/0x7f82ac000f90) [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac000f90) [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac000f90 with con 0x7f82ac000a40, requested num -1 [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:07.230 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:07.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac000f90) [ CSSD]2013-05-23 11:39:07.237 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac000f90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:39:07.237 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:07.237 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:07.344 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002430) allocated [ CSSD]2013-05-23 11:39:07.345 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:39:07.345 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002430 - 1,2,3 [ CSSD]2013-05-23 11:39:07.345 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001020) proc(0x7f82ac002430) pid(30357) version 11:1:1:4 [ CSSD]2013-05-23 11:39:07.363 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:39:07.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:39:07.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002430 [ CSSD]2013-05-23 11:39:07.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002430) con(0x7f82ac001020) skgpid ospid 30357 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:07.439 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f2a0 [ CSSD]2013-05-23 11:39:07.440 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f2a0) con(0x7f82ac00e420) skgpid ospid 30325 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5288/0x7f82ac00e720) [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5288 (0x7f82ac00e720) [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac00e720 with con 0x7f82ac00e420, requested num -1 [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac00e0e0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:07.447 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:39:07.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5288 (0x7f82ac00e720) [ CSSD]2013-05-23 11:39:07.452 [1199044928] >TRACE: clssgmExitGrock: client 5288 (0x7f82ac00e720), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:39:07.452 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00dbb0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:39:07.453 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac00dbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:07.454 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00a5f0 [ CSSD]2013-05-23 11:39:07.454 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00a5f0) con(0x7f82ac00f9c0) skgpid ospid 30328 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:07.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:08.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:08.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:08.964 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:08.964 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:09.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:10.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:10.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:11.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:12.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:12.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:13.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b5002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:13.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:39:13.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:39:13.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00de90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:39:13.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:13.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b6002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:13.819 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:39:13.819 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dbd0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:39:13.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:13.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:13.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:14.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:14.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:14.791 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f2a0) allocated [ CSSD]2013-05-23 11:39:14.791 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:39:14.792 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f2a0 - 1,2,3 [ CSSD]2013-05-23 11:39:14.792 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e420) proc(0x7f82ac00f2a0) pid(30437/30437) version 11:1:1:4 [ CSSD]2013-05-23 11:39:14.809 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00f2a0), client(1/0x7f82ac00f7c0) [ CSSD]2013-05-23 11:39:14.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00f7c0) [ CSSD]2013-05-23 11:39:14.809 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:39:14.809 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00f7c0) [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00f7c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00f7c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f2a0 [ CSSD]2013-05-23 11:39:14.956 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f2a0) con(0x7f82ac00e420) skgpid 30437 ospid 30437 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:15.250 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:15.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:16.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b7002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:16.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:16.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:17.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:18.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:18.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:18.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:18.968 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:19.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:20.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:20.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:21.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:22.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:22.410 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:22.477 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f2a0) allocated [ CSSD]2013-05-23 11:39:22.478 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:39:22.478 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f2a0 - 1,2,3 [ CSSD]2013-05-23 11:39:22.478 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e420) proc(0x7f82ac00f2a0) pid(30493) version 11:1:1:4 [ CSSD]2013-05-23 11:39:22.484 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00f2a0), client(1/0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:22.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:22.484 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00f8d0 with con 0x7f82ac06af70, requested num -1 [ CSSD]2013-05-23 11:39:22.484 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:22.484 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:39:22.485 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:22.485 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:22.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:22.492 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00f8d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:39:22.492 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fd40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:22.492 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fd40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:22.695 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f2a0 [ CSSD]2013-05-23 11:39:22.695 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f2a0) con(0x7f82ac00e420) skgpid ospid 30493 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:23.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:23.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:23.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:24.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:24.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:25.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:25.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:26.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b8002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:26.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:26.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:27.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:28.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:28.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:28.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:28.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:29.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b9002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:29.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:39:29.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:39:29.073 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00de90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:39:29.073 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:29.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ba002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:29.080 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:39:29.080 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dbd0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:39:29.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:30.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:30.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:31.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:32.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:32.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:33.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:33.976 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:34.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:34.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:34.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:35.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:36.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:36.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bb002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:36.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:36.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:37.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f2a0) allocated [ CSSD]2013-05-23 11:39:37.728 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:39:37.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f2a0 - 1,2,3 [ CSSD]2013-05-23 11:39:37.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e420) proc(0x7f82ac00f2a0) pid(30643) version 11:1:1:4 [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00f2a0), client(1/0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00f8d0 with con 0x7f82ac06af70, requested num -1 [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:37.735 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:37.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00f8d0) [ CSSD]2013-05-23 11:39:37.742 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00f8d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:39:37.742 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00fd40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:37.742 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00fd40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:37.944 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f2a0 [ CSSD]2013-05-23 11:39:37.944 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f2a0) con(0x7f82ac00e420) skgpid ospid 30643 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:37.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:37.978 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:39:38.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:38.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:38.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:40.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:40.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:40.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:42.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:42.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:42.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:42.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:42.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:44.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:44.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02bc002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:44.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:39:44.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:39:44.323 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00dfa0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:39:44.323 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:44.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bd002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:44.330 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:39:44.330 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dbd0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:39:44.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:44.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:45.318 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:46.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:46.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02be002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:46.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:46.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:47.983 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:47.983 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:48.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:48.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:48.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:50.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:50.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:50.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:52.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:52.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:52.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:52.986 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:52.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:52.987 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f2a0) allocated [ CSSD]2013-05-23 11:39:52.987 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:39:52.988 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f2a0 - 1,2,3 [ CSSD]2013-05-23 11:39:52.988 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00e420) proc(0x7f82ac00f2a0) pid(30785) version 11:1:1:4 [ CSSD]2013-05-23 11:39:53.005 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00f2a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:39:53.005 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:39:53.005 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:39:53.005 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:53.005 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:39:53.006 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:39:53.006 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:53.014 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:39:53.014 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:39:53.014 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:39:53.014 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:39:53.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f2a0 [ CSSD]2013-05-23 11:39:53.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f2a0) con(0x7f82ac00e420) skgpid ospid 30785 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:39:54.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:54.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:54.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:55.339 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:39:56.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:56.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bf002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:56.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:56.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:57.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:39:57.989 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:39:58.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:39:58.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:39:58.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:39:59.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c0002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:59.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:39:59.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:39:59.573 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00de90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:39:59.573 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:39:59.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c1002a) incarnation(174631051) [ CSSD]2013-05-23 11:39:59.579 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:39:59.579 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dbb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:00.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:00.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:00.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:02.170 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:40:02.171 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:40:02.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:40:02.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(31061) version 11:1:1:4 [ CSSD]2013-05-23 11:40:02.177 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:40:02.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:40:02.177 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:40:02.177 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:02.177 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:40:02.178 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:40:02.178 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:02.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:40:02.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:40:02.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:02.184 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:40:02.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:02.386 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:40:02.386 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 31061 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:02.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:02.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:02.991 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:02.991 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:04.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:04.513 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:40:04.514 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:40:04.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:40:04.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(31119/31119) version 11:1:1:4 [ CSSD]2013-05-23 11:40:04.531 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:40:04.531 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:40:04.531 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:40:04.531 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:40:04.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:04.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:40:04.807 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid 31119 ospid 31119 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:05.360 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:06.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c2002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:06.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c3002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:06.277 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:40:06.277 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:40:06.277 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac00de90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:40:06.277 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:06.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c4002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:06.285 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:40:06.285 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dbb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:06.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:06.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:06.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:07.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:07.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:08.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:40:08.258 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:40:08.259 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:40:08.259 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(31144) version 11:1:1:4 [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:40:08.264 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:08.270 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:40:08.270 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:40:08.270 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:08.270 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:40:08.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:08.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:40:08.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 31144 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:08.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:08.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0727a0) [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0727a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0727a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac073f30 [ CSSD]2013-05-23 11:40:09.767 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac073f30) con(0x7f82ac0087b0) skgpid 29948 ospid 29948 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:10.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:10.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:10.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:12.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:12.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:12.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:12.995 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:12.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:14.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26edac0) [ CSSD]2013-05-23 11:40:14.322 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26edac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:40:14.322 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26edac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:40:14.322 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268bba0) [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268bba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268bba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bfc0 [ CSSD]2013-05-23 11:40:14.328 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bfc0) con(0x267d5a0) skgpid 23749 ospid 23749 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:14.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:14.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:14.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:14.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c5002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:14.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:40:14.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:40:14.839 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:40:14.839 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:14.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c6002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:14.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:40:14.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:15.379 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:16.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c7002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:16.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:16.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:16.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:17.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:17.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:18.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:18.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:18.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:20.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:20.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:20.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:22.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:22.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:22.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:23.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:23.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:23.511 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:40:23.512 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:40:23.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:40:23.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(31298) version 11:1:1:4 [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:40:23.518 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:23.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:40:23.527 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:40:23.527 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:23.527 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:40:23.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:40:23.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 31298 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:24.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:24.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:24.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:25.399 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:26.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c8002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:26.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:26.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:26.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:28.002 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:28.002 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:28.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:28.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:28.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:30.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c9002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:30.089 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:40:30.089 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:40:30.089 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:40:30.089 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:30.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ca002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:30.096 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:40:30.096 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:30.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:30.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:30.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:32.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:32.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:32.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:33.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:33.005 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:34.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:34.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:34.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:36.277 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:36.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02cb002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:36.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:36.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:36.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:38.007 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:38.007 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:38.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:38.764 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:40:38.765 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:40:38.765 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:40:38.765 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(31439) version 11:1:1:4 [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:40:38.771 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:38.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:40:38.778 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:40:38.778 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:38.778 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:40:38.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:38.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:38.981 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:40:38.981 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 31439 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:40.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:40.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:40.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:42.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:43.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:43.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:43.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:43.010 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:44.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:45.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:45.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:45.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cc002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:45.339 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:40:45.339 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:40:45.339 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:40:45.339 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:45.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cd002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:45.346 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:40:45.346 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:46.308 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:46.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ce002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:46.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:47.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:47.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:47.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cf002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:47.049 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:40:47.049 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:40:47.049 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:40:47.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:47.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d0002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:47.056 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:40:47.056 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:40:48.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:48.012 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:48.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:49.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:49.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:50.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:51.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:51.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:52.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:53.014 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:53.014 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:53.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:53.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:54.014 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:40:54.014 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:40:54.015 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:40:54.015 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(31608) version 11:1:1:4 [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:40:54.032 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:40:54.040 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:40:54.040 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:40:54.040 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:40:54.040 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:40:54.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:40:54.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 31608 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:40:54.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:55.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:55.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:56.339 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:40:56.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d1002a) incarnation(174631051) [ CSSD]2013-05-23 11:40:56.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:57.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:57.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:40:58.017 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:40:58.017 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:40:58.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:40:59.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:40:59.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:00.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d2002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:00.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:00.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:00.450 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:41:00.450 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:00.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d3002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:00.457 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:00.457 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:00.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d4002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:00.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:00.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:00.588 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:00.588 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:00.592 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:00.592 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:00.594 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:00.594 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:00.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d5002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:00.595 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:00.595 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:00.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:01.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:01.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:02.423 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:41:02.424 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:41:02.424 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:41:02.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(31709) version 11:1:1:4 [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:41:02.431 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:02.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:02.438 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:41:02.438 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:02.438 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:41:02.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:41:02.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 31709 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:02.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:03.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:03.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:03.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:03.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:04.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:05.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:05.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:06.369 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:06.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d6002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:06.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d7002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:06.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:06.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:06.537 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:06.537 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:06.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d8002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:06.545 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:06.545 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:06.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:07.021 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:07.021 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:41:07.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:07.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:08.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:09.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:09.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:09.275 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:41:09.276 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:41:09.277 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:41:09.277 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(31766) version 11:1:1:4 [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:41:09.283 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:09.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:41:09.289 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:41:09.289 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:09.290 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:41:09.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:41:09.492 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 31766 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:10.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:11.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:11.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:12.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:12.024 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:12.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:13.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:13.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:14.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:15.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:15.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:15.608 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:41:15.609 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:41:15.610 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:41:15.610 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(31848/31848) version 11:1:1:4 [ CSSD]2013-05-23 11:41:15.626 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:41:15.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:41:15.627 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:41:15.627 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:41:15.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 31848 ospid 31848 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:15.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d9002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:15.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:15.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:15.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:15.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:15.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02da002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:15.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:15.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:16.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02db002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:16.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:16.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:17.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:17.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:17.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:17.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:19.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:19.107 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26a96d0) [ CSSD]2013-05-23 11:41:19.107 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26a96d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:41:19.107 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26a96d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:41:19.107 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f190) [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f190), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f190), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c4d0 [ CSSD]2013-05-23 11:41:19.112 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c4d0) con(0x2660e70) skgpid 26487 ospid 26487 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:19.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:19.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:21.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:21.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:21.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:22.028 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:22.029 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:23.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:23.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:23.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:24.525 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:41:24.526 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:41:24.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:41:24.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(31907) version 11:1:1:4 [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:41:24.533 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:24.540 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:41:24.540 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:41:24.540 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:24.540 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:41:24.742 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:41:24.742 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 31907 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:25.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:25.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:25.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:26.430 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:26.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02dc002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:27.031 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:27.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:27.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:27.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:27.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:29.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:29.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:29.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:31.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02dd002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:31.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:31.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:31.088 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:31.088 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:31.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02de002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:31.095 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:31.095 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:31.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:31.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:31.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:32.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:32.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:33.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:33.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:33.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:35.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:35.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:35.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:36.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:36.035 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:41:36.450 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:36.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02df002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:37.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:37.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:37.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:39.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:39.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:39.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:39.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:41:39.776 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:41:39.776 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:41:39.776 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(32074) version 11:1:1:4 [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:41:39.782 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:39.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:41:39.789 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:41:39.789 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:39.789 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:41:39.992 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:41:39.992 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 32074 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:41.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:41.038 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:41.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:41.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:41.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:43.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:43.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:43.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:45.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:45.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:45.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:46.040 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:46.040 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:46.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e0002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:46.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:46.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:46.339 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:46.339 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:46.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e1002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:46.345 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:46.345 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:46.479 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:46.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e2002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:47.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:47.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:47.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:49.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:49.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:49.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:51.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:51.043 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:51.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:51.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:51.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:53.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:53.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:53.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:55.035 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:41:55.036 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:41:55.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:41:55.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(32215) version 11:1:1:4 [ CSSD]2013-05-23 11:41:55.042 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:55.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:55.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:41:55.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:55.043 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:41:55.043 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:41:55.043 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:55.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:41:55.049 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:41:55.049 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:41:55.050 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:41:55.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:41:55.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 32215 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:41:55.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:55.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:55.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:56.045 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:41:56.045 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:41:56.503 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:41:56.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e3002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e4002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.009 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:57.009 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:57.009 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:41:57.009 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:41:57.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e5002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.018 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:57.018 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:57.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:57.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:41:57.659 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:57.660 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:57.662 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:57.662 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:41:57.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e6002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:41:57.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:41:57.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac0083d0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:41:57.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:41:57.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e7002a) incarnation(174631051) [ CSSD]2013-05-23 11:41:57.748 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:41:57.748 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:41:59.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:41:59.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:41:59.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:01.047 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:01.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:01.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e8002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:01.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:42:01.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:42:01.589 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:42:01.589 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:01.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:01.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e9002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:01.597 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:42:01.597 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:42:01.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:01.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:02.685 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:42:02.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:42:02.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:42:02.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(32331) version 11:1:1:4 [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:42:02.693 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:02.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:42:02.701 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:42:02.701 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:02.701 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:42:02.903 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:42:02.903 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 32331 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:03.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:03.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:03.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:05.049 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:05.050 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:42:05.623 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:05.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:05.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:06.526 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:06.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ea002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:06.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02eb002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:06.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:42:06.799 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:42:06.799 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:42:06.799 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:06.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ec002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:06.805 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:42:06.805 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:42:07.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:07.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:07.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:09.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:09.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:09.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:10.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:10.052 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:10.286 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:42:10.286 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:42:10.287 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:42:10.287 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(32412) version 11:1:1:4 [ CSSD]2013-05-23 11:42:10.293 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:42:10.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:42:10.293 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:42:10.293 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:10.293 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:42:10.294 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:42:10.294 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:10.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:42:10.300 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:42:10.300 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:10.301 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:42:10.503 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:42:10.503 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 32412 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:11.418 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:42:11.419 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:42:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:42:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(32477) version 11:1:1:4 [ CSSD]2013-05-23 11:42:11.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:11.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:11.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:13.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:13.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:13.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:14.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:42:14.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 32477 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:15.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:15.055 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:15.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:15.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:15.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:16.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:16.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ed002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:16.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ee002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:16.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:42:16.848 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:42:16.848 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:42:16.848 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:16.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ef002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:16.854 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:42:16.854 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:42:17.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:17.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:17.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:19.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:19.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:19.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:20.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:20.057 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:21.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:21.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:21.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:23.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:23.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:23.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:25.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:25.060 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:25.537 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:42:25.538 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:42:25.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:42:25.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(429) version 11:1:1:4 [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:42:25.545 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:25.551 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:42:25.551 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:42:25.551 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:25.551 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:42:25.754 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:42:25.754 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 429 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:25.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:25.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:25.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:26.572 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:26.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f0002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:27.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:27.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:27.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:29.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:29.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:29.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:30.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:30.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:31.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:31.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:31.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:32.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f1002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:32.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:42:32.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:42:32.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:42:32.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:32.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f2002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:32.111 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:42:32.111 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:42:33.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:33.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:33.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:34.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:34.064 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:42:35.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:35.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:35.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:36.595 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:36.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f3002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:37.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:37.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:37.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:39.066 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:39.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:39.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:39.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:39.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:40.786 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:42:40.787 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:42:40.788 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:42:40.788 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(605) version 11:1:1:4 [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:42:40.794 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:40.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:42:40.801 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:42:40.801 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:40.801 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:42:41.003 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:42:41.003 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 605 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:41.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:41.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:41.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:43.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:43.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:43.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:44.068 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:44.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:45.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:45.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:45.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:46.617 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:46.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f4002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:47.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f5002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:47.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:42:47.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:42:47.355 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:42:47.355 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:47.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f6002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:47.362 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:42:47.362 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:42:47.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:47.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:48.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:49.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:49.072 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:50.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:50.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:50.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:50.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:42:50.579 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:42:50.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:42:50.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(720/720) version 11:1:1:4 [ CSSD]2013-05-23 11:42:50.585 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:42:50.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:42:50.585 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:42:50.585 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:42:52.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:52.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:52.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:54.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:54.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:54.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:54.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:54.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:42:56.039 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 11:42:56.040 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:42:56.040 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 11:42:56.040 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207a80) proc(0x7f82b4207e50) pid(754) version 11:1:1:4 [ CSSD]2013-05-23 11:42:56.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:56.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207e50), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:42:56.047 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:42:56.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:42:56.054 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:42:56.054 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:42:56.054 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:42:56.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:56.256 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 11:42:56.256 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b4207a80) skgpid ospid 754 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:42:56.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:42:56.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f7002a) incarnation(174631051) [ CSSD]2013-05-23 11:42:58.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:42:58.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:42:58.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:42:59.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:42:59.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:00.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:00.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:00.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:02.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:02.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:02.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:02.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f8002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:02.614 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:43:02.614 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:43:02.614 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:43:02.614 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:02.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f9002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:02.622 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:43:02.622 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:43:02.939 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 11:43:02.940 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:43:02.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 11:43:02.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a2930) pid(845) version 11:1:1:4 [ CSSD]2013-05-23 11:43:02.947 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b4204870) [ CSSD]2013-05-23 11:43:02.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:43:02.947 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 11:43:02.947 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:02.947 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:43:02.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:02.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:02.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:43:02.955 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:43:02.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:02.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:03.078 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:03.079 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:43:03.158 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 11:43:03.158 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42ccc30) skgpid ospid 845 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:04.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:04.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:04.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:06.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:06.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:06.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:06.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:06.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fa002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:07.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fb002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:07.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:43:07.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:43:07.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:43:07.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:07.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fc002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:07.062 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:43:07.062 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:43:08.081 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:08.081 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:08.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:08.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:08.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:10.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:10.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:10.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:11.291 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 11:43:11.292 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:43:11.293 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 11:43:11.293 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207a80) proc(0x7f82b42aed80) pid(910) version 11:1:1:4 [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42aed80), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:11.299 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:11.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:43:11.307 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:43:11.307 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:11.307 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:11.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 11:43:11.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4207a80) skgpid ospid 910 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:12.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:12.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:12.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:13.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:13.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:14.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:14.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:14.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:16.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:16.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:16.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:16.686 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:16.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fd002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:17.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fe002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:17.866 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:43:17.866 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:43:17.866 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:43:17.866 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:17.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ff002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:17.873 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:43:17.873 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:43:18.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:18.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:18.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:18.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:18.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:20.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:20.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:20.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:20.654 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:43:20.655 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:43:20.655 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:43:20.655 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:43:20.655 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:43:20.655 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid 720 ospid 720 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:21.292 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:43:21.293 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:43:21.293 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:43:21.293 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(1036) version 11:1:1:4 [ CSSD]2013-05-23 11:43:21.300 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:43:21.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:43:21.300 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41bf650 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:43:21.300 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:43:21.300 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:43:21.301 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:21.301 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:21.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:43:21.307 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:43:21.307 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:43:21.308 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:21.417 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:43:21.417 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:43:21.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:43:21.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(1041) version 11:1:1:4 [ CSSD]2013-05-23 11:43:21.434 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:43:21.437 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:43:21.440 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:43:21.441 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:43:21.441 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 1041 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:21.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:43:21.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 1036 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:22.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:22.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:22.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:23.088 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:23.089 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:24.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:24.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:24.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:26.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:26.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:26.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:26.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:43:26.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:43:26.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:43:26.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(1080) version 11:1:1:4 [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:43:26.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:26.553 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:26.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:43:26.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:43:26.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:26.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:26.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:26.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0300002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:26.761 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:43:26.761 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 1080 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:28.091 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:28.091 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:28.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:28.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:28.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:30.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:30.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:30.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:32.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:32.093 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:43:32.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:32.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:32.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:33.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0301002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:33.117 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:43:33.117 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:43:33.117 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:43:33.117 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:33.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0302002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:33.124 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:43:33.124 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:43:34.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:34.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:34.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:36.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:36.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:36.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:36.732 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:36.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0303002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:37.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:37.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:38.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:38.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:38.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:40.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:40.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:40.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:41.170 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:43:41.171 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:43:41.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:43:41.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(1253) version 11:1:1:4 [ CSSD]2013-05-23 11:43:41.774 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:43:41.774 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 1253 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:41.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:43:41.796 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:43:41.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:43:41.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(1358) version 11:1:1:4 [ CSSD]2013-05-23 11:43:41.812 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:43:41.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:43:41.812 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:43:41.812 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:41.812 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:43:41.813 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:41.813 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:41.820 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:43:41.820 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:43:41.820 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:41.821 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:42.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:43:42.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 1358 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:42.098 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:42.098 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:42.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:42.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:42.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:44.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:44.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:44.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:46.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:46.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:46.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:46.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:46.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0304002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:47.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:47.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:48.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0305002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:48.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:43:48.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:43:48.368 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0083d0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:43:48.368 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:48.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0306002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:48.375 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:43:48.375 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00dae0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:43:48.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:48.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:48.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:49.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac069820) [ CSSD]2013-05-23 11:43:49.156 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac069820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:43:49.156 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac069820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:43:49.156 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 11:43:49.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00b2f0 [ CSSD]2013-05-23 11:43:49.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00b2f0) con(0x7f82ac0076c0) skgpid 28033 ospid 28033 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:50.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:50.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:50.635 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:43:50.636 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:43:50.637 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:43:50.637 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(1222/1222) version 11:1:1:4 [ CSSD]2013-05-23 11:43:50.642 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:43:50.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:43:50.642 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:43:50.642 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 11:43:50.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:52.103 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:52.103 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:52.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:52.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:52.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:54.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:54.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:54.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:56.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:56.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:56.790 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:43:56.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0307002a) incarnation(174631051) [ CSSD]2013-05-23 11:43:56.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:43:57.056 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 11:43:57.057 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:43:57.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 11:43:57.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4286740) pid(1606) version 11:1:1:4 [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4286740), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:43:57.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:43:57.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:43:57.070 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:43:57.070 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:43:57.071 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:43:57.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:43:57.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:43:57.273 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 11:43:57.273 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a5440) skgpid ospid 1606 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:43:58.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:43:58.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:43:58.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:00.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:00.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:00.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:01.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:01.107 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:44:02.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:02.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:02.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:03.205 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 11:44:03.206 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:44:03.207 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 11:44:03.207 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4207e50) pid(1693) version 11:1:1:4 [ CSSD]2013-05-23 11:44:03.213 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207e50), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:03.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:03.213 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 11:44:03.214 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:03.214 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:44:03.214 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:03.214 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:03.221 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:03.221 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:44:03.221 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:03.221 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:03.424 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 11:44:03.424 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b42a5440) skgpid ospid 1693 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:03.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0308002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:03.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:44:03.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:44:03.618 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:44:03.618 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:03.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0309002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:03.625 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:44:03.625 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:44:04.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:04.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:04.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:06.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:06.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:06.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:06.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:06.814 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:06.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030a002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:06.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:07.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030b002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:07.308 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:44:07.308 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:44:07.308 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:44:07.308 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:07.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030c002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:07.315 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:44:07.315 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:44:07.537 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 11:44:07.538 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:44:07.539 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 11:44:07.539 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d9690) pid(1736) version 11:1:1:4 [ CSSD]2013-05-23 11:44:07.657 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:44:07.658 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:44:07.658 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:44:07.658 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(1746) version 11:1:1:4 [ CSSD]2013-05-23 11:44:07.676 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:44:07.678 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:44:07.681 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:44:07.681 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid ospid 1746 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:07.761 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5289/0x7f82b4204870) [ CSSD]2013-05-23 11:44:07.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5289 (0x7f82b4204870) [ CSSD]2013-05-23 11:44:07.761 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4204870 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 11:44:07.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:44:07.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:44:07.762 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:07.762 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:44:07.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5289 (0x7f82b4204870) [ CSSD]2013-05-23 11:44:07.767 [1199044928] >TRACE: clssgmExitGrock: client 5289 (0x7f82b4204870), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:44:07.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207e50) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:44:07.767 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b4207e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:07.768 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 11:44:07.768 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b4257120) skgpid ospid 1736 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:08.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:08.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:08.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:10.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:10.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:10.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:11.112 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:11.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:12.303 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 11:44:12.304 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:44:12.305 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 11:44:12.305 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(1787) version 11:1:1:4 [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a2930), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:12.312 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:12.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:44:12.320 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:44:12.320 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:12.320 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:12.523 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 11:44:12.523 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 1787 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:12.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:12.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:13.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:14.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:14.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:15.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:16.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:16.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:16.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:16.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:16.836 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:16.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030d002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:17.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:18.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:18.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:18.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030e002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:18.868 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:44:18.868 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:44:18.868 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:44:18.868 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:18.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030f002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:18.874 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:44:18.874 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:44:19.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:44:20.689 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 1222 ospid 1222 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:20.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:20.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:21.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:21.117 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:21.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:22.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:22.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:23.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:24.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:24.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:25.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:26.120 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:26.120 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:26.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:26.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:26.865 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:26.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0310002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:27.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:27.556 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:44:27.557 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:44:27.558 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:44:27.558 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(1934) version 11:1:1:4 [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:27.564 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:27.572 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:44:27.572 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:44:27.572 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:27.572 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:27.775 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:44:27.775 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 1934 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:28.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:28.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:29.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:30.122 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:30.122 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:44:30.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:30.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:31.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:32.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:32.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:33.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:34.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0311002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:34.117 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:44:34.117 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:44:34.117 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:44:34.117 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:34.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0312002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:34.124 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:44:34.124 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:44:34.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:34.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:35.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:35.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:35.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:36.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:36.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:36.889 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:36.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0313002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:37.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:38.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:38.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:39.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:40.127 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:40.127 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:40.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:40.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:41.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:42.808 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 11:44:42.809 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:44:42.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 11:44:42.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(2091) version 11:1:1:4 [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:42.827 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:42.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:44:42.834 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:44:42.834 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:42.834 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:42.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:42.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:43.037 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 11:44:43.037 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 2091 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:43.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:44.560 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:44:44.561 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:44:44.562 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:44:44.562 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(679/679) version 11:1:1:4 [ CSSD]2013-05-23 11:44:44.568 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:44:44.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:44:44.568 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:44:44.568 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 11:44:44.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:44.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:45.130 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:45.130 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:45.185 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:44:45.186 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:44:45.186 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:44:45.186 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(1516/1516) version 11:1:1:4 [ CSSD]2013-05-23 11:44:45.202 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:44:45.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:44:45.202 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:44:45.202 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:44:45.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:46.915 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:46.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0314002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:46.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:46.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:46.961 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 11:44:46.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:44:46.961 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:44:46.961 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 11:44:47.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:48.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:48.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:49.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0315002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:49.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:44:49.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:44:49.368 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:44:49.368 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:49.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0316002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:49.376 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:44:49.376 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:44:49.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:50.133 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:50.134 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:50.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:50.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:51.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:52.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:52.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:53.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:54.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:54.136 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:44:55.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:55.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:55.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:56.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:44:56.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0317002a) incarnation(174631051) [ CSSD]2013-05-23 11:44:57.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:57.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:57.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:44:58.071 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:44:58.071 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:44:58.072 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:44:58.072 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(2255) version 11:1:1:4 [ CSSD]2013-05-23 11:44:58.078 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:44:58.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:44:58.078 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b3dc0, requested num -1 [ CSSD]2013-05-23 11:44:58.078 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:58.078 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:44:58.079 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:44:58.079 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:44:58.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:44:58.086 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:44:58.086 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:44:58.087 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:44:58.289 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:44:58.289 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid ospid 2255 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:44:59.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:44:59.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:44:59.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:44:59.139 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:44:59.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:01.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:01.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:01.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:03.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:03.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:03.463 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:45:03.463 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:45:03.464 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:45:03.464 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(2340) version 11:1:1:4 [ CSSD]2013-05-23 11:45:03.470 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:03.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:03.470 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 11:45:03.470 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:03.470 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:45:03.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:45:03.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:03.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:03.477 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:45:03.477 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:03.477 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:45:03.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:03.680 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:45:03.680 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid ospid 2340 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:04.142 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:04.142 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:04.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0318002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:04.620 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:45:04.620 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:45:04.620 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:45:04.620 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:04.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0319002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:04.628 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:45:04.628 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:45:05.041 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:45:05.042 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:45:05.042 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:45:05.042 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(2363/2363) version 11:1:1:4 [ CSSD]2013-05-23 11:45:05.058 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:45:05.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:45:05.058 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:45:05.058 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:45:05.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:05.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:45:05.346 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid 2363 ospid 2363 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:05.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:06.960 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:06.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031a002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:07.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:07.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:07.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:07.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031b002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:07.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:45:07.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:45:07.572 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:45:07.572 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:07.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031c002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:07.579 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:45:07.579 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:45:09.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:09.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:09.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:09.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:09.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:11.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:11.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:11.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:13.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:13.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:13.324 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:45:13.325 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:45:13.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:45:13.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(2420) version 11:1:1:4 [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42c5f40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:45:13.342 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:13.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:45:13.350 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:45:13.350 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:13.350 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:45:13.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:45:13.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid ospid 2420 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:13.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:14.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:14.148 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:15.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:15.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:15.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:16.984 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:16.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031d002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:17.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:17.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:17.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:19.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:19.150 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:19.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:19.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:19.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:19.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031e002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:19.872 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:45:19.872 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:45:19.872 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:45:19.872 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:19.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031f002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:19.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:45:19.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:45:21.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:21.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:21.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:23.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:23.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:23.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:24.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:24.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:25.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:25.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:25.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:27.007 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:27.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0320002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:27.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:27.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:27.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:28.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:45:28.586 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:45:28.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:45:28.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42833d0) pid(2579) version 11:1:1:4 [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42b3dc0, requested num -1 [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:45:28.603 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:28.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:45:28.610 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:45:28.610 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:28.610 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:45:28.813 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:45:28.813 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b427c5d0) skgpid ospid 2579 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:29.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:29.155 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:29.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:29.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:29.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:31.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:31.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:31.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:33.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:33.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:33.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:34.157 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:34.158 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:35.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0321002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:35.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:45:35.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:45:35.132 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:45:35.132 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:35.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0322002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:35.139 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:45:35.139 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:45:35.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:35.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:35.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:37.029 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:37.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0323002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:37.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:37.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:37.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:39.160 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:39.160 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:39.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:39.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:39.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:41.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:41.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:42.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:43.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:43.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:43.845 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 11:45:43.846 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:45:43.847 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 11:45:43.847 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(2733) version 11:1:1:4 [ CSSD]2013-05-23 11:45:43.853 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42c5f40), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:45:43.853 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:45:43.853 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 11:45:43.853 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:43.853 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:45:43.854 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:45:43.854 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:43.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:45:43.860 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:45:43.860 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:43.860 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:45:44.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:44.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 11:45:44.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid ospid 2733 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:44.162 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:44.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:45.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:45.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:46.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:47.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:47.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0324002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:47.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:47.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:48.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:48.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:48.164 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:45:49.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:49.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:50.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:50.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0325002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:50.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:45:50.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:45:50.381 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:45:50.381 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:50.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0326002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:50.388 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:45:50.388 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:45:50.732 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:45:50.733 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:45:50.734 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:45:50.734 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(2813/2813) version 11:1:1:4 [ CSSD]2013-05-23 11:45:50.739 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a3ea0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:45:50.739 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:45:50.739 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:45:50.739 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:45:51.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:51.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:52.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:53.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:53.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:53.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:53.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:54.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:55.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:55.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:56.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:57.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:45:57.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0327002a) incarnation(174631051) [ CSSD]2013-05-23 11:45:57.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:57.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:45:58.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:45:58.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:45:58.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:45:59.096 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 11:45:59.096 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:45:59.097 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 11:45:59.097 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3ad0) proc(0x7f82b42c7c00) pid(2873) version 11:1:1:4 [ CSSD]2013-05-23 11:45:59.103 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7c00), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d4c0, requested num -1 [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:45:59.104 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:45:59.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:45:59.111 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:45:59.111 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:45:59.111 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:45:59.313 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 11:45:59.313 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a3ad0) skgpid ospid 2873 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:45:59.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:45:59.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:00.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:00.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0328002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:00.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:00.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:00.751 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:46:00.751 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:00.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0329002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:00.758 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:00.759 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:00.887 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:00.887 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:00.889 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:00.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:01.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:01.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:02.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:03.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:03.172 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:03.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:03.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:03.719 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d410) allocated [ CSSD]2013-05-23 11:46:03.720 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:46:03.721 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d410 - 1,2,3 [ CSSD]2013-05-23 11:46:03.721 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d91c0) proc(0x7f82b427d410) pid(2944) version 11:1:1:4 [ CSSD]2013-05-23 11:46:03.727 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b427d410), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:03.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:03.727 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 11:46:03.727 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:03.727 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:46:03.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:46:03.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:03.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:03.734 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:46:03.734 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:03.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:46:03.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d410 [ CSSD]2013-05-23 11:46:03.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d410) con(0x7f82b42d91c0) skgpid ospid 2944 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:04.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:05.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032a002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:05.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:05.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:05.643 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:46:05.643 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:05.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032b002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:05.651 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:05.651 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:05.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:05.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:06.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:07.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:07.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032c002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:07.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:07.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:07.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032d002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:07.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:07.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:07.835 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:46:07.835 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:07.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032e002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:07.843 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:07.843 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:08.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:08.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:08.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:09.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:09.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:10.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:11.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:11.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:12.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:13.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:13.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:13.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:13.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:14.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:14.350 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 11:46:14.351 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:46:14.352 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 11:46:14.352 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42573d0) proc(0x7f82b42c7c00) pid(3025) version 11:1:1:4 [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7c00), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427d4c0, requested num -1 [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:46:14.358 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:14.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:46:14.364 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:46:14.364 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:14.364 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:46:14.567 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 11:46:14.567 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42573d0) skgpid ospid 3025 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:15.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:15.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:16.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 11:46:16.092 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:46:16.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 11:46:16.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b429dfe0) pid(3082/3082) version 11:1:1:4 [ CSSD]2013-05-23 11:46:16.109 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429dfe0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:46:16.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:46:16.109 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:46:16.109 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 11:46:16.126 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b42a90a0) skgpid 3082 ospid 3082 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:16.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:17.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:17.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032f002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:17.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:17.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:18.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:18.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:18.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:19.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac00dd20) [ CSSD]2013-05-23 11:46:19.180 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac00dd20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:46:19.180 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac00dd20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:46:19.180 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006eb0) [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006eb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006eb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00d4f0 [ CSSD]2013-05-23 11:46:19.186 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00d4f0) con(0x7f82ac06dcb0) skgpid 30126 ospid 30126 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:19.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:19.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:20.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:46:20.785 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid 2813 ospid 2813 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:20.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0330002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:20.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:20.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:20.897 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:46:20.897 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:20.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0331002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:20.903 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:20.903 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:21.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:21.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:22.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:23.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:23.182 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:23.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:23.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:24.130 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:46:24.131 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:46:24.132 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:46:24.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(3111/3111) version 11:1:1:4 [ CSSD]2013-05-23 11:46:24.137 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ea0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:46:24.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:46:24.138 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:46:24.138 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 11:46:24.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:25.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:25.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:26.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:27.171 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:27.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0332002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:27.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:27.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:28.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:28.185 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:28.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:29.599 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 11:46:29.600 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:46:29.601 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 11:46:29.601 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429dac0) pid(3198) version 11:1:1:4 [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429dac0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c7cb0, requested num -1 [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:46:29.607 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:29.614 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:46:29.614 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:46:29.614 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:29.614 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:46:29.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 11:46:29.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42d9340) skgpid ospid 3198 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:29.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:29.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:30.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:31.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:31.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:32.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:33.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:33.187 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:33.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:33.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:34.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:35.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:35.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:36.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0333002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:36.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:36.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:36.158 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:46:36.158 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:36.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0334002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:36.165 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:36.165 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:36.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:37.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:37.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0335002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:37.818 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ea0), client(2/0x7f82b427d5c0) [ CSSD]2013-05-23 11:46:37.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:46:37.818 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:46:37.818 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 11:46:37.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:37.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:38.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:38.190 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:38.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:39.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:39.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:40.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:41.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:41.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:42.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:42.192 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:46:42.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:43.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:43.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:44.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:44.859 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 11:46:44.860 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:46:44.860 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 11:46:44.860 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e0b0) pid(3336) version 11:1:1:4 [ CSSD]2013-05-23 11:46:44.867 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e0b0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:46:44.868 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:44.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:46:44.875 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:46:44.875 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:46:44.875 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:46:45.077 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 11:46:45.077 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42d9340) skgpid ospid 3336 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:46:46.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:46.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:46.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:47.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:47.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:47.211 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:47.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0336002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:48.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:48.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:48.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:50.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:50.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:50.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:50.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:46:50.771 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:46:50.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:46:50.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42cfa20) pid(3417/3417) version 11:1:1:4 [ CSSD]2013-05-23 11:46:50.778 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:46:50.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:46:50.778 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:46:50.778 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:46:51.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0337002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:51.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:51.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:51.408 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:46:51.408 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:46:51.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0338002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:51.415 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:51.415 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:52.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:52.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:52.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:52.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:52.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:54.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:54.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:54.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:56.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:56.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:56.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:46:57.199 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:46:57.199 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:46:57.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:46:57.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0339002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:57.978 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:57.978 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:57.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:57.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:46:58.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033a002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:58.060 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:46:58.060 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:46:58.060 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:46:58.060 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:46:58.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033b002a) incarnation(174631051) [ CSSD]2013-05-23 11:46:58.068 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:46:58.068 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:46:58.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:46:58.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:46:58.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:00.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:00.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:00.110 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e4c0) allocated [ CSSD]2013-05-23 11:47:00.111 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:47:00.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e4c0 - 1,2,3 [ CSSD]2013-05-23 11:47:00.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c10) proc(0x7f82b429e4c0) pid(3517) version 11:1:1:4 [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e4c0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:00.118 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:00.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:47:00.125 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:00.125 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b34d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:00.125 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b34d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:00.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e4c0 [ CSSD]2013-05-23 11:47:00.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e4c0) con(0x7f82b42b5c10) skgpid ospid 3517 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:00.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:02.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:02.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:02.201 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:02.202 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:02.581 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b46b0) allocated [ CSSD]2013-05-23 11:47:02.582 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:47:02.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b46b0 - 1,2,3 [ CSSD]2013-05-23 11:47:02.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42b46b0) pid(3580) version 11:1:1:4 [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b46b0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:02.589 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:02.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:47:02.597 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:02.597 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:02.597 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:02.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:02.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b46b0 [ CSSD]2013-05-23 11:47:02.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b46b0) con(0x7f82b42a9150) skgpid ospid 3580 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:03.982 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 11:47:03.983 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:47:03.983 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 11:47:03.983 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42b45f0) pid(3602) version 11:1:1:4 [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b45f0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b4720, requested num -1 [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:03.990 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:03.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:47:03.997 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:03.997 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba890) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:03.997 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba890) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:04.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:04.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:04.199 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 11:47:04.199 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b42a9150) skgpid ospid 3602 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:04.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:06.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:06.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:06.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033c002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:06.659 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:47:06.659 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:47:06.659 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:47:06.659 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:06.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033d002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:06.666 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:47:06.666 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:47:06.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:07.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:07.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:07.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:07.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033e002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:08.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033f002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:08.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:47:08.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:47:08.090 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:47:08.090 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:08.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0340002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:08.096 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:47:08.096 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:47:08.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:08.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:08.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:10.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:10.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:10.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:11.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:11.206 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:47:11.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e460) allocated [ CSSD]2013-05-23 11:47:11.808 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:47:11.808 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e460 - 1,2,3 [ CSSD]2013-05-23 11:47:11.808 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b429e460) pid(3701) version 11:1:1:4 [ CSSD]2013-05-23 11:47:12.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:12.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:12.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:14.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:14.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:14.496 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e460 [ CSSD]2013-05-23 11:47:14.496 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e460) con(0x7f82b42b59f0) skgpid ospid 3701 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:14.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:15.363 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e4c0) allocated [ CSSD]2013-05-23 11:47:15.364 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:47:15.364 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e4c0 - 1,2,3 [ CSSD]2013-05-23 11:47:15.364 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c10) proc(0x7f82b429e4c0) pid(4058) version 11:1:1:4 [ CSSD]2013-05-23 11:47:15.370 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e4c0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:47:15.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:47:15.370 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 11:47:15.371 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:15.371 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:15.371 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:15.371 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:15.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:47:15.378 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:15.378 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:15.378 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:15.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e4c0 [ CSSD]2013-05-23 11:47:15.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e4c0) con(0x7f82b42b5c10) skgpid ospid 4058 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:16.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:16.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:16.208 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:16.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:16.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:17.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:17.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0341002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:18.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:18.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:18.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:20.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:20.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:20.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:21.211 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:21.211 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:21.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0342002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:21.919 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:47:21.919 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:47:21.919 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:47:21.919 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:21.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0343002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:21.927 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:47:21.927 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:47:22.213 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42d9340) skgpid 3417 ospid 3417 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:22.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:22.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:22.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:24.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:24.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:24.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:26.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:26.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:26.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:26.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:26.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:27.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:27.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0344002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:28.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:28.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:28.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:30.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:30.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:30.614 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 11:47:30.615 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:47:30.616 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 11:47:30.616 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429db90) pid(4236) version 11:1:1:4 [ CSSD]2013-05-23 11:47:30.622 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429db90), client(1/0x7f82b4286810) [ CSSD]2013-05-23 11:47:30.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:47:30.622 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 11:47:30.622 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:30.622 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:30.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:30.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:30.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:47:30.629 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:30.629 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:30.629 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:30.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 11:47:30.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42a9150) skgpid ospid 4236 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:31.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:31.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:31.216 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:32.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 11:47:32.085 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:47:32.086 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 11:47:32.086 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429dac0) pid(4298) version 11:1:1:4 [ CSSD]2013-05-23 11:47:32.103 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429dac0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:47:32.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:47:32.103 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e160, requested num -1 [ CSSD]2013-05-23 11:47:32.103 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:32.103 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:32.104 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:32.104 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:32.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:47:32.111 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:32.111 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:32.112 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:32.314 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 11:47:32.314 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42a9150) skgpid ospid 4298 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:32.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:32.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:33.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:34.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:34.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:35.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:36.218 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:36.218 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:36.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:36.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:37.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:37.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0345002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:37.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:47:37.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:47:37.182 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:47:37.182 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:37.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0346002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:37.188 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:47:37.189 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:47:37.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:37.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0347002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:38.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:38.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:39.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:40.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:40.220 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:47:40.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:40.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:41.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:42.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:42.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:43.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:44.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:44.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:45.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:45.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:45.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:45.867 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:47:45.868 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:47:45.868 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:47:45.868 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42cfa20) pid(4404) version 11:1:1:4 [ CSSD]2013-05-23 11:47:45.874 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:47:45.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:47:45.874 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 11:47:45.874 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:45.874 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:47:45.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:47:45.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:45.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:47:45.881 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:47:45.881 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:47:45.882 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:47:46.084 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:47:46.084 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42d9340) skgpid ospid 4404 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:47:46.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:46.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:47.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:47.343 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:47.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0348002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:48.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:48.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:49.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:50.225 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:50.225 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:50.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:50.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:51.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:52.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0349002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:52.430 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:47:52.430 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:47:52.430 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:47:52.430 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:47:52.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034a002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:52.437 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:47:52.437 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:47:52.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:52.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:53.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:54.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:54.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:55.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:55.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:47:55.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:47:56.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:56.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:57.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:47:57.364 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:47:57.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034b002a) incarnation(174631051) [ CSSD]2013-05-23 11:47:58.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:47:58.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:47:59.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:00.229 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:00.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:00.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:00.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:01.116 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 11:48:01.117 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:48:01.118 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 11:48:01.118 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e0b0) pid(4567) version 11:1:1:4 [ CSSD]2013-05-23 11:48:01.123 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e0b0), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:01.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:01.123 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 11:48:01.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:01.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:48:01.124 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:01.124 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:01.130 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:01.130 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:48:01.130 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:01.130 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:01.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:01.332 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 11:48:01.333 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42a9150) skgpid ospid 4567 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:02.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:02.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:03.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:04.235 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 11:48:04.236 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:04.236 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 11:48:04.236 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b42cf950) pid(4629) version 11:1:1:4 [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cf950), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b429e160, requested num -1 [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:04.242 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:04.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:04.249 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:48:04.249 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b45f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:04.250 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b45f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:04.452 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 11:48:04.452 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b42c7b30) skgpid ospid 4629 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:04.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:04.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:05.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:05.232 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:05.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:06.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:06.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:07.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:07.385 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:07.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034c002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:07.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034d002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:07.680 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:48:07.680 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:48:07.680 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:48:07.680 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:07.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034e002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:07.687 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:48:07.688 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:48:08.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034f002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:08.351 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:48:08.351 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:48:08.351 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:48:08.351 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:08.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0350002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:08.358 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:48:08.358 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:48:08.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:08.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:09.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:10.234 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:10.235 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:10.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:10.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:11.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:12.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:12.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:13.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:14.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:14.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:15.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:15.237 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:15.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:16.367 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:48:16.368 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:48:16.369 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:48:16.369 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42cfa20) pid(4720) version 11:1:1:4 [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:16.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:16.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:48:16.382 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:48:16.382 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:16.382 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:16.584 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:48:16.584 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42d9340) skgpid ospid 4720 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:16.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:16.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:17.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:17.404 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:17.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0351002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:18.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:18.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:19.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:20.239 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:20.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:20.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:20.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:21.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:21.589 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 11:48:21.590 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:21.590 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 11:48:21.590 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e0b0) pid(4793) version 11:1:1:4 [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e0b0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42aee50 with con 0x7f82b42cfad0, requested num -1 [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:21.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:21.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:48:21.615 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:48:21.615 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:48:21.615 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:21.722 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 11:48:21.723 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:21.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 11:48:21.724 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cfa10) proc(0x7f82b42b45f0) pid(4798) version 11:1:1:4 [ CSSD]2013-05-23 11:48:21.740 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:48:21.742 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:48:21.744 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:48:21.745 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 11:48:21.745 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b42cfa10) skgpid ospid 4798 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:21.818 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 11:48:21.818 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42a9150) skgpid ospid 4793 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:22.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:22.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:22.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0352002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:22.939 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:48:22.939 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:48:22.939 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:48:22.940 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:22.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0353002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:22.946 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:48:22.947 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:48:23.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:24.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:24.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:25.242 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:25.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:25.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:26.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:26.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:27.426 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:27.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:27.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0354002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:28.474 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 11:48:28.475 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:28.476 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 11:48:28.476 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429db90) pid(4853/4853) version 11:1:1:4 [ CSSD]2013-05-23 11:48:28.492 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429db90), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:48:28.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:48:28.492 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:48:28.492 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 11:48:28.537 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42d9340) skgpid 4853 ospid 4853 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:28.721 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:48:28.722 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:28.722 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:48:28.722 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42cfa20) pid(4856/4856) version 11:1:1:4 [ CSSD]2013-05-23 11:48:28.739 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:28.739 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:28.739 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:48:28.739 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:48:28.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:28.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:48:28.869 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42a9150) skgpid 4856 ospid 4856 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:29.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:30.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:30.245 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:30.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:30.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:31.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:31.620 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 11:48:31.620 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:48:31.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 11:48:31.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e0b0) pid(4883) version 11:1:1:4 [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e0b0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42cfad0, requested num -1 [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:31.627 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:31.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:48:31.634 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:48:31.634 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:31.635 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:31.837 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 11:48:31.837 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42d9340) skgpid ospid 4883 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:32.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:32.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:33.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:34.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:34.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:35.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:35.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:35.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:36.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:36.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:37.450 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:37.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:37.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0355002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:38.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0356002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:38.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:48:38.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:48:38.190 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:48:38.190 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:38.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0357002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:38.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:48:38.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:48:38.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:38.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:39.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:39.249 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:48:39.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:40.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 11:48:40.728 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:48:40.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 11:48:40.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429db90) pid(5011) version 11:1:1:4 [ CSSD]2013-05-23 11:48:40.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:40.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:41.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 11:48:41.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42a9150) skgpid ospid 5011 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:41.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:42.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:42.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:43.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:44.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:44.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:44.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:44.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:45.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:46.879 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:48:46.880 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:48:46.880 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:48:46.880 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42cfa20) pid(5459) version 11:1:1:4 [ CSSD]2013-05-23 11:48:46.886 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b4286810) [ CSSD]2013-05-23 11:48:46.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:48:46.886 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 11:48:46.886 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:46.886 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:48:46.887 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:48:46.887 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:46.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:48:46.893 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:48:46.893 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:48:46.893 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:48:46.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:46.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:47.095 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:48:47.095 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42d9340) skgpid ospid 5459 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:48:47.473 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:47.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0358002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:47.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:48.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:48.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:49.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:49.254 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:49.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:51.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:51.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:51.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:53.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:53.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:53.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0359002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:53.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:48:53.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:48:53.449 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:48:53.449 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:48:53.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035a002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:53.457 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:48:53.457 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:48:53.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:54.256 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:54.257 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:55.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:55.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:55.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:57.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:57.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:57.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:48:57.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035b002a) incarnation(174631051) [ CSSD]2013-05-23 11:48:57.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:48:59.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:48:59.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:48:59.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:48:59.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:48:59.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:01.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:01.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:01.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:02.128 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 11:49:02.129 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:49:02.129 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 11:49:02.129 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e0b0) pid(5612) version 11:1:1:4 [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e0b0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cfad0, requested num -1 [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:02.136 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:02.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:49:02.142 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:49:02.142 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:02.142 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:02.345 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 11:49:02.345 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42a9150) skgpid ospid 5612 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:03.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:03.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:03.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:04.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:04.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:04.498 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 11:49:04.499 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:49:04.499 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 11:49:04.499 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429db90) pid(5676) version 11:1:1:4 [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429db90), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b429e160, requested num -1 [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:04.516 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:04.524 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:49:04.524 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:49:04.524 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:04.524 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:04.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 11:49:04.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42a9150) skgpid ospid 5676 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:05.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:05.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:05.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:07.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:07.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:07.516 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:07.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035c002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:07.850 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:49:07.850 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:49:07.851 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:49:07.851 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42cfa20) pid(5708) version 11:1:1:4 [ CSSD]2013-05-23 11:49:07.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:07.969 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 11:49:07.970 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:49:07.971 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 11:49:07.971 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b42cbb70) pid(5718) version 11:1:1:4 [ CSSD]2013-05-23 11:49:07.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:49:07.990 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:49:07.993 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 11:49:07.993 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b42b5b40) skgpid ospid 5718 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5290/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5290 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41c8ba0 with con 0x7f82b42cbd90, requested num -1 [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:08.072 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:49:08.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5290 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:49:08.078 [1199044928] >TRACE: clssgmExitGrock: client 5290 (0x7f82b41c8ba0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:49:08.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc60) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:49:08.078 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42cbc60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:08.079 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:49:08.079 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42d9340) skgpid ospid 5708 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:08.263 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:08.264 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:49:08.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035d002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:08.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:49:08.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:49:08.609 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:49:08.610 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:08.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035e002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:08.616 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:49:08.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:49:08.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035f002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:08.700 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:49:08.700 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:49:08.700 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:49:08.700 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:08.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0360002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:08.707 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:49:08.707 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:49:09.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:09.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:09.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:11.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:11.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:11.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:13.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:13.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:13.266 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:13.266 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:13.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:15.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:15.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:15.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:17.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:17.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:17.382 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:49:17.383 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:49:17.383 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:49:17.383 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42cfa20) pid(5799) version 11:1:1:4 [ CSSD]2013-05-23 11:49:17.389 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cfa20), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:49:17.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:49:17.389 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 11:49:17.389 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:17.389 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:49:17.390 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:17.390 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:17.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:49:17.396 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:49:17.396 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dfe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:17.396 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dfe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:17.537 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:17.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0361002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:17.599 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:49:17.599 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42a9150) skgpid ospid 5799 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:17.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:18.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:18.269 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:19.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:19.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:19.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:21.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:21.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:22.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:23.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:23.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:23.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:23.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:23.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0362002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:23.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:49:23.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:49:23.950 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:49:23.950 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:23.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0363002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:23.958 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:49:23.958 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:49:24.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:25.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:25.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:26.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:27.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:27.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:27.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:27.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0364002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:28.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:28.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:28.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:29.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:29.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:30.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:31.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:31.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:31.857 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 11:49:31.858 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:49:31.859 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 11:49:31.859 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429db90) pid(5521/5521) version 11:1:1:4 [ CSSD]2013-05-23 11:49:31.864 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429db90), client(1/0x7f82b4286810) [ CSSD]2013-05-23 11:49:31.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:49:31.864 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:49:31.864 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 11:49:32.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:32.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b58f0) allocated [ CSSD]2013-05-23 11:49:32.643 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:49:32.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b58f0 - 1,2,3 [ CSSD]2013-05-23 11:49:32.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5a20) proc(0x7f82b42b58f0) pid(5980) version 11:1:1:4 [ CSSD]2013-05-23 11:49:32.649 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b58f0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:49:32.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:49:32.650 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 11:49:32.650 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:32.650 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:49:32.650 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:32.650 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:32.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:49:32.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:49:32.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:32.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:32.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b58f0 [ CSSD]2013-05-23 11:49:32.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b58f0) con(0x7f82b42b5a20) skgpid ospid 5980 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:33.276 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:33.276 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:33.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:33.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:34.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:35.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:35.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:36.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:37.278 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:37.278 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:49:37.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:37.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:37.578 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:37.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0365002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:38.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:39.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0366002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:39.212 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:49:39.212 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:49:39.213 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:49:39.213 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:39.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0367002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:39.220 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:49:39.220 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:49:39.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:39.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:40.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:41.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:41.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:42.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:42.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:42.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:43.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:43.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:44.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:45.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:45.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:46.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:47.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:47.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:47.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:47.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:47.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:47.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0368002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:47.893 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 11:49:47.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:49:47.895 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 11:49:47.895 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c20) proc(0x7f82b429e330) pid(6135) version 11:1:1:4 [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:49:47.901 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:47.907 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:49:47.907 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:49:47.907 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b34d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:49:47.907 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b34d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:49:48.110 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 11:49:48.110 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42b5c20) skgpid ospid 6135 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:49:48.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:49.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:49.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:50.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:51.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:51.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:52.285 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:52.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:52.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:53.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:53.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:54.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:54.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0369002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:54.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:49:54.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:49:54.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:49:54.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:49:54.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036a002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:54.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:49:54.481 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:49:55.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:55.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:56.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:57.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:49:57.288 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:49:57.618 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:49:57.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:57.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:49:57.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036b002a) incarnation(174631051) [ CSSD]2013-05-23 11:49:58.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:49:59.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:49:59.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:00.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:01.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:01.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:02.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:02.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:02.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:03.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e800) allocated [ CSSD]2013-05-23 11:50:03.143 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:50:03.144 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e800 - 1,2,3 [ CSSD]2013-05-23 11:50:03.144 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5cf0) proc(0x7f82b429e800) pid(6485) version 11:1:1:4 [ CSSD]2013-05-23 11:50:03.160 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e800), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:50:03.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:50:03.160 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b42b3a70, requested num -1 [ CSSD]2013-05-23 11:50:03.160 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:03.160 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:50:03.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:50:03.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:03.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:50:03.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:50:03.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:03.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:50:03.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e800 [ CSSD]2013-05-23 11:50:03.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e800) con(0x7f82b42b5cf0) skgpid ospid 6485 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:03.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:03.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:04.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:04.507 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e460) allocated [ CSSD]2013-05-23 11:50:04.508 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:50:04.508 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e460 - 1,2,3 [ CSSD]2013-05-23 11:50:04.508 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5cf0) proc(0x7f82b429e460) pid(6564/6564) version 11:1:1:4 [ CSSD]2013-05-23 11:50:04.525 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e460), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:04.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:04.525 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:50:04.525 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:50:04.765 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 11:50:04.766 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:50:04.767 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 11:50:04.767 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42a1690) pid(6571) version 11:1:1:4 [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42bacc0, requested num -1 [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:50:04.773 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:04.780 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:50:04.780 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:50:04.780 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:04.780 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e460 [ CSSD]2013-05-23 11:50:04.808 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e460) con(0x7f82b42b5cf0) skgpid 6564 ospid 6564 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:04.983 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 11:50:04.983 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42b34e0) skgpid ospid 6571 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:05.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:05.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:06.292 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:06.293 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:50:06.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:07.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:07.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036c002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:07.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:07.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:08.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:08.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036d002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:08.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:08.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:08.885 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:08.885 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:08.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036e002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:08.891 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:08.891 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:09.439 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 11:50:09.440 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:50:09.440 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 11:50:09.440 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5840) proc(0x7f82b429e6d0) pid(4396/4396) version 11:1:1:4 [ CSSD]2013-05-23 11:50:09.446 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e6d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:50:09.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:50:09.446 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:50:09.446 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:50:09.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036f002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:09.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:09.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:09.725 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:09.725 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:09.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0370002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:09.732 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:09.732 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:09.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:09.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:10.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:11.295 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:11.295 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:11.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:11.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:12.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:13.769 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429db90), client(2/0x7f82b4204870) [ CSSD]2013-05-23 11:50:13.769 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 11:50:13.769 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:50:13.769 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:50:13.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:13.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:13.865 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e6d0), client(2/0x7f82b4207960) [ CSSD]2013-05-23 11:50:13.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 11:50:13.865 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:50:13.865 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 11:50:14.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:50:14.502 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:50:14.502 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:50:14.502 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:50:14.506 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid 679 ospid 679 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:14.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:15.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:15.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:16.298 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:16.298 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:16.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:17.662 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:17.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0371002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:17.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:17.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:17.846 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:50:17.847 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:50:17.847 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:50:17.847 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(6657/6657) version 11:1:1:4 [ CSSD]2013-05-23 11:50:17.864 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:50:17.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:50:17.864 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:50:17.864 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:50:18.405 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:50:18.406 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:50:18.407 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:50:18.407 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1ac0) pid(6680) version 11:1:1:4 [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42bad30, requested num -1 [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:50:18.413 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:18.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:50:18.420 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:50:18.420 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ed70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:18.420 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ed70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:50:18.622 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:50:18.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4257120) skgpid ospid 6680 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:18.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:19.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:19.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:20.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:21.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:21.300 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:21.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:21.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:22.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:23.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:23.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:24.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:24.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0372002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:24.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:24.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:24.977 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:24.977 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:24.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0373002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:24.984 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:24.984 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:25.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:25.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:26.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:26.303 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:26.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:27.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:27.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0374002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:27.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:27.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:28.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:29.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:29.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:30.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:31.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:31.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:31.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:31.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:32.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:33.665 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:50:33.666 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:50:33.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:50:33.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5720) proc(0x7f82b42a1ac0) pid(6838) version 11:1:1:4 [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a19f0, requested num -1 [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:50:33.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:33.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:50:33.691 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:50:33.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:33.691 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:50:33.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:50:33.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b42b5720) skgpid ospid 6838 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:33.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:33.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:34.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:36.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:36.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:36.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:36.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:36.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:37.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:37.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0375002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:38.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:38.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:38.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:40.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:40.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:40.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0376002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:40.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:40.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:40.238 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:40.238 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:40.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0377002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:40.244 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:40.244 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:40.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:41.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:41.311 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:42.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:42.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:42.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:44.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:44.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:44.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:46.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:46.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:46.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:46.313 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:47.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:47.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0378002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:47.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:47.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:47.408 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:47.408 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:47.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0379002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:47.415 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:47.415 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:47.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:47.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037a002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:48.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:48.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:48.937 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:50:48.937 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:50:48.938 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:50:48.938 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1ac0) pid(6984) version 11:1:1:4 [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42bad30, requested num -1 [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:50:48.955 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:48.962 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:50:48.962 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:50:48.962 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ed70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:50:48.962 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ed70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:50:49.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:49.165 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:50:49.165 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4257120) skgpid ospid 6984 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:50:50.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:50.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:51.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:51.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:51.316 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:52.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:52.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:53.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:54.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:54.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:55.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:55.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037b002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:55.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:50:55.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:50:55.499 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:50:55.499 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:50:55.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037c002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:55.506 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:50:55.506 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:50:56.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:56.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:56.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:50:56.318 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:50:57.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:50:57.787 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:50:57.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037d002a) incarnation(174631051) [ CSSD]2013-05-23 11:50:58.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:50:58.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:50:59.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:00.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:00.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:01.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037e002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:01.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:01.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:01.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:51:01.064 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:01.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037f002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:01.072 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:01.072 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:01.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:01.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:01.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:01.199 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:01.199 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:01.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:01.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:02.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:02.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:03.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:04.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:04.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:04.197 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:51:04.198 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:51:04.198 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:51:04.198 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429cc20) proc(0x7f82b42a1ac0) pid(7142) version 11:1:1:4 [ CSSD]2013-05-23 11:51:04.215 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:51:04.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:51:04.215 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:51:04.215 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:04.215 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:51:04.216 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:51:04.216 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:04.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:51:04.223 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:51:04.223 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ed70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:04.223 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ed70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:51:04.426 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:51:04.426 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b429cc20) skgpid ospid 7142 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:05.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 11:51:05.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:51:05.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 11:51:05.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1690) pid(7192) version 11:1:1:4 [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a4fc0, requested num -1 [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:51:05.036 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:05.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:05.042 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:51:05.042 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:05.043 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:51:05.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:05.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 11:51:05.245 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b4257120) skgpid ospid 7192 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:06.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:06.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:06.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:06.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:07.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:07.808 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:07.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0380002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:08.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:08.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:09.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0381002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:09.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:09.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:09.145 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:09.145 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:09.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0382002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:09.151 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:09.151 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:09.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:10.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:10.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:10.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0383002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:10.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:10.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:10.763 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:10.764 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:10.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0384002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:10.773 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:10.773 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:11.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:11.325 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:11.325 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:12.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:12.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:13.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:14.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:14.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:15.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:15.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:51:15.587 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:51:15.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:51:15.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5720) proc(0x7f82b42a1ac0) pid(7272/7272) version 11:1:1:4 [ CSSD]2013-05-23 11:51:15.593 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 11:51:15.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:51:15.593 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:51:15.593 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207f20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207f20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:51:15.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b42b5720) skgpid 7272 ospid 7272 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:16.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:16.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:16.328 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:16.328 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:17.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:17.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:17.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0385002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:18.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:18.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:51:19.248 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid 1516 ospid 1516 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:19.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:19.458 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:51:19.459 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:51:19.459 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:51:19.459 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(7305) version 11:1:1:4 [ CSSD]2013-05-23 11:51:19.476 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:51:19.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:51:19.476 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:51:19.476 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:19.476 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:51:19.477 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:51:19.477 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:19.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:51:19.484 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:51:19.484 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:19.484 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:51:19.687 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:51:19.687 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 7305 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:20.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:20.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:21.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:21.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:21.330 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:22.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:22.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:23.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:24.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:24.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:25.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:26.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0386002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:26.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:26.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:26.019 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:26.019 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:26.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0387002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:26.026 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:26.026 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:26.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:26.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:26.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:26.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:27.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:27.868 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:27.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0388002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:28.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:28.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:29.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:30.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:30.336 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:51:30.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:30.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:31.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:32.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:32.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:33.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:34.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:34.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:34.720 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:51:34.721 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:51:34.721 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:51:34.721 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(7449) version 11:1:1:4 [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:51:34.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:34.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:51:34.735 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:51:34.735 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:34.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:51:34.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:51:34.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 7449 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:35.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:35.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:35.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:36.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:36.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:37.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:37.896 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:37.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0389002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:38.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:38.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:39.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:40.342 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:40.343 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:40.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:40.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:41.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038a002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:41.271 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:41.271 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:41.271 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:41.271 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:41.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038b002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:41.278 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:41.278 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:41.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:42.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:42.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:43.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:44.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:44.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:45.345 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:45.345 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:45.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:46.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:46.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:47.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:47.918 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:48.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038c002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:48.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:48.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:49.348 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:49.348 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:51:49.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:49.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:51:49.972 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:51:49.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:51:49.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(7600) version 11:1:1:4 [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:51:49.978 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:49.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:51:49.986 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:51:49.986 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:51:49.986 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:51:50.189 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:51:50.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 7600 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:51:50.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:50.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:51.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:52.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:52.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:53.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:54.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:54.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:54.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:54.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:55.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:56.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038d002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:56.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:56.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:56.523 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:56.523 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:56.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038e002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:56.530 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:56.530 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:56.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:56.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:57.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038f002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:57.366 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:57.366 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:57.366 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:51:57.366 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:51:57.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0390002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:57.373 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:57.373 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:57.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:57.938 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:51:58.296 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:58.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:58.298 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:58.299 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:51:58.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0391002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:58.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:51:58.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:51:58.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:51:58.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:51:58.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0392002a) incarnation(174631051) [ CSSD]2013-05-23 11:51:58.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:51:58.382 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:51:58.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:51:58.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:51:59.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:51:59.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:51:59.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:51:59.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0393002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:00.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:00.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:01.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:02.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:02.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:03.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:04.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:04.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:04.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:04.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:05.222 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:52:05.223 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:52:05.224 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:52:05.224 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(7753) version 11:1:1:4 [ CSSD]2013-05-23 11:52:05.240 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:05.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:05.240 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:52:05.240 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:05.240 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:52:05.241 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:52:05.241 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:05.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:05.248 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:52:05.248 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:05.248 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:52:05.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 11:52:05.282 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:52:05.283 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 11:52:05.283 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42aed80) pid(7759) version 11:1:1:4 [ CSSD]2013-05-23 11:52:05.288 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42aed80), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:52:05.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:52:05.288 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 11:52:05.288 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:05.288 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:52:05.289 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:52:05.289 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:05.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:52:05.295 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:52:05.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:05.295 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:52:05.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:52:05.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 7753 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:05.498 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 11:52:05.498 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4257120) skgpid ospid 7759 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:05.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:06.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:06.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:07.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:07.957 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:08.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:08.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:09.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:09.359 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:09.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0394002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:09.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:52:09.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:52:09.406 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:52:09.406 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:09.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0395002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:09.413 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:52:09.413 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:52:09.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:09.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0396002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:10.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:10.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:11.311 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:52:11.312 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:52:11.312 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:52:11.312 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(7886) version 11:1:1:4 [ CSSD]2013-05-23 11:52:11.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:11.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0397002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:11.788 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:52:11.788 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:52:11.788 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:52:11.788 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:11.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0398002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:11.796 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:52:11.796 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:52:12.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:12.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:13.771 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:52:13.771 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 7886 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:13.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:14.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:14.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:14.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:14.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:15.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:16.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:16.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:17.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:17.977 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:18.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:18.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:19.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:19.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:19.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:19.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0399002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:20.491 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:52:20.492 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:52:20.493 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:52:20.493 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(8257) version 11:1:1:4 [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:52:20.499 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:20.506 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:52:20.506 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:52:20.506 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:20.506 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:52:20.709 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:52:20.709 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 8257 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:20.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:20.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:21.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:22.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:22.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:23.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:24.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:24.368 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:24.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:24.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:25.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:26.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:26.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:27.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039a002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:27.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:52:27.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:52:27.041 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:52:27.041 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:27.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039b002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:27.049 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:52:27.049 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:52:27.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:28.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:28.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:28.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:29.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:29.371 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:29.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:29.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039c002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:30.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:30.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:31.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:32.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:32.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:33.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:34.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:34.374 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:34.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:34.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:35.753 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:52:35.754 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:52:35.755 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:52:35.755 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(8408) version 11:1:1:4 [ CSSD]2013-05-23 11:52:35.771 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:35.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:35.771 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:52:35.771 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:35.771 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:52:35.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:52:35.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:35.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:52:35.779 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:52:35.779 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:35.779 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:52:35.982 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 11:52:35.982 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 8408 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:35.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:36.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:36.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:38.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:38.027 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:38.377 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:38.377 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:52:38.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:38.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:39.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039d002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:40.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:40.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:40.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:42.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:42.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039e002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:42.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:52:42.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:52:42.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:52:42.303 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:42.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039f002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:42.311 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:52:42.311 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:52:42.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:42.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:43.379 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:43.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:44.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:45.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:45.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:46.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:47.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:47.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:48.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:48.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:48.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:48.382 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:49.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:49.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:49.116 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 11:52:49.116 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:52:49.117 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 11:52:49.117 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(8529/8529) version 11:1:1:4 [ CSSD]2013-05-23 11:52:49.133 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 11:52:49.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 11:52:49.133 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:52:49.133 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:52:50.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a0002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:50.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:51.027 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:52:51.028 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:52:51.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:52:51.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207e50) proc(0x7f82b42a1ac0) pid(8575) version 11:1:1:4 [ CSSD]2013-05-23 11:52:51.034 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:52:51.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:52:51.034 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42bad30, requested num -1 [ CSSD]2013-05-23 11:52:51.034 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:51.034 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:52:51.035 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:52:51.035 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:51.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:52:51.041 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:52:51.041 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ed70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:52:51.041 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ed70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:52:51.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:51.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:51.244 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:52:51.244 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4207e50) skgpid ospid 8575 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:52:52.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:53.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:53.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:53.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:53.385 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:54.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:55.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:55.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:56.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:57.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:57.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:52:57.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a1002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:57.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:52:57.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:52:57.565 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:52:57.565 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:52:57.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a2002a) incarnation(174631051) [ CSSD]2013-05-23 11:52:57.572 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:52:57.572 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:52:58.070 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:52:58.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:52:58.388 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:52:58.388 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:52:59.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:52:59.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:00.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a3002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:00.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:01.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:01.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:02.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:02.390 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:02.390 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:53:03.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:03.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:04.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:05.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:05.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:05.547 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:53:05.548 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:05.548 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:53:05.548 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1ac0) pid(8749) version 11:1:1:4 [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:05.555 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:05.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 11:53:05.563 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:53:05.563 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:05.563 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:05.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:53:05.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4257120) skgpid ospid 8749 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:06.269 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 11:53:06.270 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:53:06.271 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 11:53:06.271 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1690) pid(8767) version 11:1:1:4 [ CSSD]2013-05-23 11:53:06.277 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:06.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:06.277 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:53:06.277 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:06.277 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:53:06.278 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:06.278 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:06.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:06.285 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:53:06.285 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:06.285 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:06.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:06.488 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 11:53:06.488 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b4257120) skgpid ospid 8767 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:07.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:07.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:07.393 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:07.393 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:08.090 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:08.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:09.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:09.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:09.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a4002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:09.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:53:09.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:53:09.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:53:09.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:09.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a5002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:09.673 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:53:09.673 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:53:10.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a6002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:10.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:11.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:11.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:12.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:12.396 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:12.396 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:12.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a7002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:12.827 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:53:12.827 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:53:12.827 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:53:12.827 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:12.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a8002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:12.833 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:53:12.833 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:53:13.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:13.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:14.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:15.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:15.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:16.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:17.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:17.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:17.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:17.400 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:18.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:18.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:19.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:19.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:20.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a9002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:20.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:21.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:21.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:21.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:21.402 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:53:21.530 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:53:21.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:53:21.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:53:21.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1ac0) pid(8977) version 11:1:1:4 [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:21.538 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:21.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:53:21.545 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:53:21.545 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:21.546 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:21.748 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:53:21.748 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4257120) skgpid ospid 8977 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:21.901 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 11:53:21.902 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:21.902 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 11:53:21.902 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a1690) pid(9034) version 11:1:1:4 [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41c8ba0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:21.910 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:21.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:21.917 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:53:21.917 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab40) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:53:21.917 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42bab40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:22.025 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ae0) allocated [ CSSD]2013-05-23 11:53:22.026 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:22.026 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ae0 - 1,2,3 [ CSSD]2013-05-23 11:53:22.026 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a4fc0) proc(0x7f82b42a1ae0) pid(9039) version 11:1:1:4 [ CSSD]2013-05-23 11:53:22.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:53:22.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:53:22.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:53:22.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ae0 [ CSSD]2013-05-23 11:53:22.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ae0) con(0x7f82b42a4fc0) skgpid ospid 9039 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:22.120 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 11:53:22.120 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b4257120) skgpid ospid 9034 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:22.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:23.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:23.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:24.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:25.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:25.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:26.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:26.406 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:26.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:27.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:27.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:28.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03aa002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:28.075 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:53:28.075 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:53:28.075 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:53:28.076 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:28.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ab002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:28.082 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:53:28.082 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:53:28.131 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:28.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:29.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:29.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:30.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ac002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:30.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:31.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:31.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:31.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:31.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:32.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:33.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:33.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:34.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:35.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:35.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:36.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:36.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:36.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:36.784 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:53:36.785 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:53:36.786 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:53:36.786 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aed80) proc(0x7f82b42a1ac0) pid(9162) version 11:1:1:4 [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42bad30, requested num -1 [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:36.792 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:36.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:36.800 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:53:36.800 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ed70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:36.800 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ed70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:37.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:53:37.003 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b42aed80) skgpid ospid 9162 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:37.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:37.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:38.151 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:38.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:39.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:39.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:40.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ad002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:40.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:41.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:53:41.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:41.187 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:53:41.187 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207e50) proc(0x7f82b42a1ac0) pid(9246) version 11:1:1:4 [ CSSD]2013-05-23 11:53:41.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:41.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:41.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:41.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:41.752 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:53:41.752 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b4207e50) skgpid ospid 9246 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:42.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:43.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ae002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:43.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:53:43.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:53:43.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:53:43.327 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:43.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03af002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:43.333 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:53:43.333 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:53:43.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:43.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:44.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:44.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1ac0) allocated [ CSSD]2013-05-23 11:53:44.781 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:44.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1ac0 - 1,2,3 [ CSSD]2013-05-23 11:53:44.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aed80) proc(0x7f82b42a1ac0) pid(9432/9432) version 11:1:1:4 [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterShared: grp DG_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_DATA member 0 share type 1, refcount 8 [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterShared: grp DG_REDOA, mbr 0, type 1 [ CSSD]2013-05-23 11:53:44.787 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_REDOA member 0 share type 1, refcount 8 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(3/0x7f82b42adc50) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 3 (0x7f82b42adc50) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: grp DG_REDOB, mbr 0, type 1 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_REDOB member 0 share type 1, refcount 8 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(4/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 4 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: grp DG_SBYREDOA, mbr 0, type 1 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_SBYREDOA member 0 share type 1, refcount 7 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1ac0), client(5/0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 5 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: grp DG_SBYREDOB, mbr 0, type 1 [ CSSD]2013-05-23 11:53:44.788 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_SBYREDOB member 0 share type 1, refcount 7 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 5 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 5 (0x7f82b42ccac0), grp DG_SBYREDOB, member 0 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: client 5 (0x7f82b42ccac0), grp DG_SBYREDOB, member 0, share type 1 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_SBYREDOB member 0 refcount is 6 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 4 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 4 (0x7f82b41ff1f0), grp DG_SBYREDOA, member 0 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: client 4 (0x7f82b41ff1f0), grp DG_SBYREDOA, member 0, share type 1 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_SBYREDOA member 0 refcount is 6 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 3 (0x7f82b42adc50) [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 3 (0x7f82b42adc50), grp DG_REDOB, member 0 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: client 3 (0x7f82b42adc50), grp DG_REDOB, member 0, share type 1 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_REDOB member 0 refcount is 7 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DG_REDOA, member 0 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DG_REDOA, member 0, share type 1 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_REDOA member 0 refcount is 7 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_DATA, member 0 [ CSSD]2013-05-23 11:53:44.855 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:53:44.856 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_DATA member 0 refcount is 7 [ CSSD]2013-05-23 11:53:44.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1ac0 [ CSSD]2013-05-23 11:53:44.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1ac0) con(0x7f82b42aed80) skgpid 9432 ospid 9432 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:45.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:45.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:46.419 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:46.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:46.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:47.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:47.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:48.172 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:48.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:49.282 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:53:49.282 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:53:49.282 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:53:49.282 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:53:49.284 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid 3111 ospid 3111 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:49.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:49.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:50.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b0002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:50.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:51.058 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 11:53:51.059 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:53:51.059 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 11:53:51.059 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b3cd0) pid(9274/9274) version 11:1:1:4 [ CSSD]2013-05-23 11:53:51.065 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3cd0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:53:51.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:53:51.065 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:53:51.065 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:53:51.422 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:51.422 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:51.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:51.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:52.046 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:53:52.047 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:53:52.048 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:53:52.048 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42a3ea0) pid(9483) version 11:1:1:4 [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ea0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:53:52.054 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:52.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:53:52.062 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:53:52.062 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:53:52.062 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:53:52.264 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:53:52.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9290) skgpid ospid 9483 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:53:52.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:53.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:53.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:54.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:55.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:55.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:56.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:53:56.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:53:56.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:57.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:57.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:53:58.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:53:58.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b1002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:58.576 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:53:58.576 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:53:58.576 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:53:58.576 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:53:58.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b2002a) incarnation(174631051) [ CSSD]2013-05-23 11:53:58.583 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:53:58.583 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:53:58.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:53:59.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:53:59.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:00.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b3002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:00.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:00.428 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:54:00.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:01.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:01.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:02.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:03.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:03.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:04.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:05.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:05.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:05.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:05.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:05.817 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 11:54:05.818 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:54:05.818 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 11:54:05.818 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42583a0) pid(9653) version 11:1:1:4 [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42583a0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:05.825 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:05.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:54:05.833 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:54:05.833 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:05.834 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:06.036 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 11:54:06.036 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4207f10) skgpid ospid 9653 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:06.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:07.300 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 11:54:07.301 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:54:07.301 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 11:54:07.301 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42a3ea0) pid(9675) version 11:1:1:4 [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ea0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:54:07.307 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:07.308 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:07.315 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:54:07.315 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:54:07.315 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1a60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:07.315 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1a60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:07.517 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 11:54:07.517 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4207f10) skgpid ospid 9675 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:07.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:07.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:08.151 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a18e0) allocated [ CSSD]2013-05-23 11:54:08.152 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:54:08.152 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a18e0 - 1,2,3 [ CSSD]2013-05-23 11:54:08.152 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42a18e0) pid(9717) version 11:1:1:4 [ CSSD]2013-05-23 11:54:08.217 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:08.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecc0) allocated [ CSSD]2013-05-23 11:54:08.271 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:54:08.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecc0 - 1,2,3 [ CSSD]2013-05-23 11:54:08.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429ecc0) pid(9733) version 11:1:1:4 [ CSSD]2013-05-23 11:54:08.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:54:08.290 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:54:08.293 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecc0 [ CSSD]2013-05-23 11:54:08.293 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecc0) con(0x7f82b4207f10) skgpid ospid 9733 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:08.372 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5291/0x7f82b42b3600) [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5291 (0x7f82b42b3600) [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42b3600 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42c7f60/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:08.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:54:08.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5291 (0x7f82b42b3600) [ CSSD]2013-05-23 11:54:08.378 [1199044928] >TRACE: clssgmExitGrock: client 5291 (0x7f82b42b3600), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:54:08.378 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ecc0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:54:08.378 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429ecc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:08.379 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a18e0 [ CSSD]2013-05-23 11:54:08.379 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a18e0) con(0x7f82b42d9290) skgpid ospid 9717 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:08.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:09.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:09.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:09.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b4002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:09.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:54:09.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:54:09.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:54:09.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:09.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b5002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:09.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:54:09.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:54:10.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b6002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:10.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:10.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:10.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:11.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:11.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:12.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:13.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:13.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:13.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b7002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:13.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:54:13.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:54:13.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:54:13.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:13.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b8002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:13.845 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:54:13.845 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:54:14.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:15.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:15.439 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:15.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:15.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:16.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:17.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:17.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:18.239 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:19.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:19.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:19.441 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:54:19.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:19.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:20.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b9002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:21.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:21.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:54:21.132 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:54:21.133 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:54:21.133 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:54:21.133 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 11:54:21.133 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b427c5d0) skgpid 9274 ospid 9274 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:21.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:21.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:22.553 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 11:54:22.554 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:54:22.555 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 11:54:22.555 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d91c0) pid(9873) version 11:1:1:4 [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d91c0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:22.561 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:22.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:54:22.567 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:54:22.567 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:22.568 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:22.770 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 11:54:22.770 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b427c5d0) skgpid ospid 9873 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:23.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:23.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:23.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:24.444 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:24.444 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:25.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:25.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:25.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:27.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:27.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:27.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:28.261 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:29.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:29.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ba002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:29.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:54:29.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:54:29.110 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:54:29.110 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:29.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bb002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:29.116 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:54:29.116 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:54:29.447 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:29.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:29.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:29.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:30.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03bc002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:31.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:31.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:31.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:33.057 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207c10), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 11:54:33.057 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 11:54:33.057 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:54:33.057 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:54:33.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:33.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:33.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:34.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:34.451 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:35.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:35.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:35.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:35.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 11:54:35.946 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:54:35.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 11:54:35.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b427d340) pid(8527/8527) version 11:1:1:4 [ CSSD]2013-05-23 11:54:35.952 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b427d340), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 11:54:35.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 11:54:35.952 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:54:35.952 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:54:37.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:37.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:37.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:37.803 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8390) allocated [ CSSD]2013-05-23 11:54:37.804 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:54:37.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8390 - 1,2,3 [ CSSD]2013-05-23 11:54:37.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c8390) pid(10018) version 11:1:1:4 [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c8390), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:37.811 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:37.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:54:37.818 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:54:37.818 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:37.818 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:38.020 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8390 [ CSSD]2013-05-23 11:54:38.020 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8390) con(0x7f82b4207f10) skgpid ospid 10018 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:38.282 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:39.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:39.454 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:39.454 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:39.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:39.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:40.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03bd002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:41.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:41.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:41.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:43.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:43.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:43.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:44.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03be002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:44.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:54:44.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:54:44.360 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:54:44.360 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:44.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bf002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:44.368 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:54:44.368 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:54:44.457 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:44.457 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:45.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:45.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:45.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:47.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:47.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:47.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:48.308 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:49.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:49.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:49.460 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:49.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:49.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:50.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c0002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:51.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:51.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:51.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:53.064 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8390) allocated [ CSSD]2013-05-23 11:54:53.065 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:54:53.065 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8390 - 1,2,3 [ CSSD]2013-05-23 11:54:53.065 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c8390) pid(10192) version 11:1:1:4 [ CSSD]2013-05-23 11:54:53.072 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c8390), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:54:53.073 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:53.081 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:54:53.081 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:54:53.081 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:54:53.081 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:54:53.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:53.284 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8390 [ CSSD]2013-05-23 11:54:53.284 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8390) con(0x7f82b4207f10) skgpid ospid 10192 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:54:53.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:53.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:54.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:54.463 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:55.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:55.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:55.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:57.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:57.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:57.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:54:58.330 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:54:59.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:54:59.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:54:59.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:54:59.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c1002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:59.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:54:59.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:54:59.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:54:59.611 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:54:59.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c2002a) incarnation(174631051) [ CSSD]2013-05-23 11:54:59.617 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:54:59.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:54:59.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:54:59.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:00.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c3002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:01.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:01.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:01.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:03.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:03.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:03.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:04.470 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:04.470 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:05.284 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8390) allocated [ CSSD]2013-05-23 11:55:05.285 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:55:05.286 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8390 - 1,2,3 [ CSSD]2013-05-23 11:55:05.286 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3da0) proc(0x7f82b42c8390) pid(10355/10355) version 11:1:1:4 [ CSSD]2013-05-23 11:55:05.291 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c8390), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:55:05.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:55:05.291 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:55:05.291 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:55:05.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8390 [ CSSD]2013-05-23 11:55:05.556 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8390) con(0x7f82b42b3da0) skgpid 10355 ospid 10355 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:05.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:05.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:06.088 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8390) allocated [ CSSD]2013-05-23 11:55:06.088 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:55:06.089 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8390 - 1,2,3 [ CSSD]2013-05-23 11:55:06.089 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c8390) pid(10363) version 11:1:1:4 [ CSSD]2013-05-23 11:55:06.095 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c8390), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:55:06.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:55:06.095 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 11:55:06.095 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:06.095 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:55:06.096 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:55:06.096 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:06.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:55:06.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:55:06.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:06.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:55:06.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8390 [ CSSD]2013-05-23 11:55:06.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8390) con(0x7f82b4207f10) skgpid ospid 10363 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:07.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:07.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:07.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:08.320 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8390) allocated [ CSSD]2013-05-23 11:55:08.321 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:55:08.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8390 - 1,2,3 [ CSSD]2013-05-23 11:55:08.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3da0) proc(0x7f82b42c8390) pid(10384) version 11:1:1:4 [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c8390), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:55:08.328 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:08.335 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:08.335 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:55:08.335 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:08.335 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:55:08.351 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:08.538 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8390 [ CSSD]2013-05-23 11:55:08.538 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8390) con(0x7f82b42b3da0) skgpid ospid 10384 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:09.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:09.473 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:09.473 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:09.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:09.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:10.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c4002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:10.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:55:10.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:55:10.191 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:55:10.191 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:10.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c5002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:10.199 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:55:10.199 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:55:10.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c6002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:11.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:12.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:12.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:13.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:14.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:14.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:14.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:14.477 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:14.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 11:55:14.620 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:55:14.620 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:55:14.620 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 11:55:14.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42b5840) skgpid 4396 ospid 4396 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:14.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c7002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:14.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:55:14.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:55:14.863 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:55:14.863 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:14.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c8002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:14.870 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:55:14.870 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:55:15.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:16.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:16.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:17.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:18.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:18.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:18.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:19.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:19.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:19.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:20.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:20.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:20.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c9002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:21.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:22.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:22.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:23.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:23.571 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:55:23.572 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:55:23.572 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:55:23.572 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3da0) proc(0x7f82b42833d0) pid(10541) version 11:1:1:4 [ CSSD]2013-05-23 11:55:23.578 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42833d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:23.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:23.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 11:55:23.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:23.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:55:23.579 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:55:23.579 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:23.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:23.585 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:55:23.585 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:23.586 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:55:23.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 11:55:23.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42b3da0) skgpid ospid 10541 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:24.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:24.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:24.113 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 11:55:24.113 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:55:24.114 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 11:55:24.114 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3da0) proc(0x7f82b42833d0) pid(10475/10475) version 11:1:1:4 [ CSSD]2013-05-23 11:55:24.119 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42833d0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 11:55:24.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 11:55:24.119 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:55:24.119 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 11:55:24.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:24.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:25.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:26.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:26.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:27.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:27.642 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42833d0), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 11:55:27.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 11:55:27.643 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:55:27.643 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:55:28.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:28.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:28.397 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:29.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:29.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:29.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:30.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:30.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:30.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ca002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:30.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:55:30.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:55:30.113 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:55:30.113 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:30.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cb002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:30.120 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:55:30.120 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:55:30.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03cc002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:31.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:32.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:32.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:33.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:34.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:34.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:34.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:34.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:35.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:36.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:36.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:37.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:38.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:38.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:38.418 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:38.832 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c81b0) allocated [ CSSD]2013-05-23 11:55:38.833 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:55:38.833 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c81b0 - 1,2,3 [ CSSD]2013-05-23 11:55:38.833 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42c81b0) pid(10685) version 11:1:1:4 [ CSSD]2013-05-23 11:55:38.839 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c81b0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:38.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:38.839 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42c80e0, requested num -1 [ CSSD]2013-05-23 11:55:38.839 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:38.839 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:55:38.840 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:55:38.840 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:38.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:55:38.847 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:55:38.847 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:38.847 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:55:39.050 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c81b0 [ CSSD]2013-05-23 11:55:39.050 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c81b0) con(0x7f82b42b59d0) skgpid ospid 10685 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:39.493 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:39.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:39.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:40.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:40.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:40.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03cd002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:41.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:42.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:42.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:43.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:44.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:44.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:44.496 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:44.496 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:45.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ce002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:45.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:55:45.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:55:45.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:55:45.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:45.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cf002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:45.381 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:55:45.381 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:55:45.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:46.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:46.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:47.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:48.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:48.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:48.439 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:49.499 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:49.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:49.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:50.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:50.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:50.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d0002a) incarnation(174631051) [ CSSD]2013-05-23 11:55:51.160 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c81b0) allocated [ CSSD]2013-05-23 11:55:51.161 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:55:51.161 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c81b0 - 1,2,3 [ CSSD]2013-05-23 11:55:51.161 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42c81b0) pid(10819/10819) version 11:1:1:4 [ CSSD]2013-05-23 11:55:51.167 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c81b0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:55:51.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:55:51.167 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:55:51.167 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 11:55:51.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:52.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:52.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:53.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:54.094 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 11:55:54.094 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:55:54.095 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 11:55:54.095 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b41fe180) pid(10871) version 11:1:1:4 [ CSSD]2013-05-23 11:55:54.100 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fe180), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:54.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:54.100 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b41fe2b0, requested num -1 [ CSSD]2013-05-23 11:55:54.100 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:54.100 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5ca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:55:54.101 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:55:54.101 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:55:54.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:55:54.108 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:55:54.108 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ef40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:55:54.108 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ef40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:55:54.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:54.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:54.311 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 11:55:54.311 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42a1690) skgpid ospid 10871 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:55:54.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:54.502 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:55.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:55.811 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 11:55:55.812 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:55:55.812 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 11:55:55.812 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b41fe180) pid(10473/10473) version 11:1:1:4 [ CSSD]2013-05-23 11:55:55.829 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fe180), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 11:55:55.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 11:55:55.829 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:55:55.829 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:55:56.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:56.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:57.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:55:58.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:55:58.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:55:58.460 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:55:59.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:55:59.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:55:59.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:00.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:00.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:00.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d1002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:00.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d2002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:00.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:00.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:00.625 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:56:00.625 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:00.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d3002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:00.632 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:00.632 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:01.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d4002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:01.356 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:01.356 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:01.356 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 11:56:01.356 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:01.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d5002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:01.363 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:01.363 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:01.491 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:01.492 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:01.493 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:01.494 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:01.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:02.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:02.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:03.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:03.507 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:56:03.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:04.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:04.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:05.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:06.356 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6ec0) allocated [ CSSD]2013-05-23 11:56:06.357 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:56:06.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6ec0 - 1,2,3 [ CSSD]2013-05-23 11:56:06.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fe0) proc(0x7f82b42d6ec0) pid(10993) version 11:1:1:4 [ CSSD]2013-05-23 11:56:06.363 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d6ec0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:56:06.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:56:06.363 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d6de0, requested num -1 [ CSSD]2013-05-23 11:56:06.363 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:06.363 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:56:06.364 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:56:06.364 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:06.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:56:06.371 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:56:06.371 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:06.371 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:56:06.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:06.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:06.573 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6ec0 [ CSSD]2013-05-23 11:56:06.573 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6ec0) con(0x7f82b42d5fe0) skgpid ospid 10993 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:07.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:08.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:08.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:08.481 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:08.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:08.511 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:09.347 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204600) allocated [ CSSD]2013-05-23 11:56:09.348 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:56:09.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204600 - 1,2,3 [ CSSD]2013-05-23 11:56:09.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b4204600) pid(11022) version 11:1:1:4 [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4204600), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4204520, requested num -1 [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:56:09.354 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:09.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:56:09.361 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:56:09.361 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42043a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:09.361 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42043a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:56:09.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204600 [ CSSD]2013-05-23 11:56:09.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204600) con(0x7f82b42a19b0) skgpid ospid 11022 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:09.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:10.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d6002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:10.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:10.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:10.446 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:56:10.446 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:10.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d7002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:10.453 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:10.453 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:10.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:10.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:10.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d8002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:11.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:12.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:12.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:13.513 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:13.513 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:13.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:14.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:14.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:15.209 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204600) allocated [ CSSD]2013-05-23 11:56:15.210 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:56:15.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204600 - 1,2,3 [ CSSD]2013-05-23 11:56:15.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b4204600) pid(11102/11102) version 11:1:1:4 [ CSSD]2013-05-23 11:56:15.217 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4204600), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:56:15.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:56:15.217 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:56:15.217 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 11:56:15.233 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:56:15.233 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:56:15.233 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:56:15.233 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 11:56:15.233 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204600 [ CSSD]2013-05-23 11:56:15.234 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204600) con(0x7f82b42a19b0) skgpid 11102 ospid 11102 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:15.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:15.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d9002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:15.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:15.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:15.875 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:56:15.875 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:15.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03da002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:15.882 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:15.882 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:16.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:16.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:17.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:18.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:18.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:18.502 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:18.515 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:18.516 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:19.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 11:56:19.304 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:56:19.304 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:56:19.304 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 11:56:19.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42d9340) skgpid 5521 ospid 5521 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:19.701 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 11:56:19.702 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:56:19.702 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 11:56:19.702 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a3ad0) pid(11136/11136) version 11:1:1:4 [ CSSD]2013-05-23 11:56:19.708 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a3ad0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 11:56:19.708 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 11:56:19.708 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:56:19.708 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:56:19.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:20.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03db002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:20.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:20.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c81b0 [ CSSD]2013-05-23 11:56:21.239 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c81b0) con(0x7f82b42b59d0) skgpid 10819 ospid 10819 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:21.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:22.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:22.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:23.518 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:23.519 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:23.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:24.597 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:56:24.598 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:56:24.598 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:56:24.598 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42cfa20) pid(11171) version 11:1:1:4 [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42cfa20), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d4920, requested num -1 [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:56:24.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:24.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:24.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:24.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:56:24.613 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:56:24.613 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:24.613 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:56:24.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:56:24.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42a19b0) skgpid ospid 11171 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:25.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:26.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:26.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:27.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:27.522 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:56:27.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:28.523 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:28.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:28.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:29.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:30.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03dc002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:30.560 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a3ad0), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 11:56:30.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 11:56:30.560 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 11:56:30.560 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 11:56:30.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:30.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:31.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03dd002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:31.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:31.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:31.136 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:56:31.136 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:31.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03de002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:31.144 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:31.144 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:31.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:32.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:32.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:32.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:32.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:33.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:34.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:34.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:35.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:36.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:36.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:37.527 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:37.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:38.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:38.547 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:38.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:38.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:39.850 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7f60) allocated [ CSSD]2013-05-23 11:56:39.851 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:56:39.852 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7f60 - 1,2,3 [ CSSD]2013-05-23 11:56:39.852 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbd00) proc(0x7f82b42c7f60) pid(11313) version 11:1:1:4 [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c7f60), client(1/0x7f82b4204870) [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d4830, requested num -1 [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d38e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:56:39.858 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:39.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:56:39.866 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:56:39.866 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d46b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:39.866 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d46b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:56:40.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:40.068 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7f60 [ CSSD]2013-05-23 11:56:40.068 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7f60) con(0x7f82b42cbd00) skgpid ospid 11313 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:40.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03df002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:40.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:40.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:42.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:42.530 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:42.530 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:42.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:42.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:44.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:44.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:44.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:46.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:46.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e0002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:46.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:46.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:46.392 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:56:46.392 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:46.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e1002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:46.399 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:46.399 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:46.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:46.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:47.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:47.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:48.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:48.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:48.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:48.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:50.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:50.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e2002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:50.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:50.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:51.201 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7f60) allocated [ CSSD]2013-05-23 11:56:51.202 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:56:51.202 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7f60 - 1,2,3 [ CSSD]2013-05-23 11:56:51.202 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbd00) proc(0x7f82b42c7f60) pid(11428/11428) version 11:1:1:4 [ CSSD]2013-05-23 11:56:51.208 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c7f60), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:56:51.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:56:51.208 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:56:51.208 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 11:56:51.535 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:51.535 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:56:52.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:52.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:52.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:54.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:54.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:54.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:55.101 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 11:56:55.102 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:56:55.103 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 11:56:55.103 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3690) proc(0x7f82b42042d0) pid(11456) version 11:1:1:4 [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42042d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42046d0, requested num -1 [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:56:55.109 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:56:55.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:56:55.116 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:56:55.116 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:56:55.116 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:56:55.319 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 11:56:55.319 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d3690) skgpid ospid 11456 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:56:56.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:56.538 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:56:56.538 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:56:56.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:56.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:56:58.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:56:58.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:58.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:58.590 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:56:58.591 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:58.591 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:56:58.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e3002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:58.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:56:58.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:56:58.686 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 11:56:58.686 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 11:56:58.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e4002a) incarnation(174631051) [ CSSD]2013-05-23 11:56:58.693 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:56:58.693 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:56:58.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:56:58.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:00.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:00.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e5002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:00.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:00.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:01.540 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:01.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:01.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e6002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:01.641 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:57:01.641 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:57:01.641 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:57:01.641 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:01.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e7002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:01.648 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:57:01.648 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:57:02.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:02.923 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 11:57:02.924 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:57:02.924 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 11:57:02.924 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3c30) proc(0x7f82b42042d0) pid(11581) version 11:1:1:4 [ CSSD]2013-05-23 11:57:02.941 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42042d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:57:02.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:57:02.941 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 11:57:02.941 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:02.941 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:02.942 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:02.942 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:02.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:57:02.949 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:02.949 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:02.949 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:02.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:02.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:03.151 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 11:57:03.151 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d3c30) skgpid ospid 11581 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:04.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:05.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:05.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:05.638 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 11:57:05.639 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:57:05.639 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 11:57:05.639 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3690) proc(0x7f82b42042d0) pid(11134/11134) version 11:1:1:4 [ CSSD]2013-05-23 11:57:05.656 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42042d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 11:57:05.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 11:57:05.656 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 11:57:05.656 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 11:57:06.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:06.543 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:06.543 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:06.615 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf730) allocated [ CSSD]2013-05-23 11:57:06.616 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:57:06.616 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf730 - 1,2,3 [ CSSD]2013-05-23 11:57:06.616 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cddb0) proc(0x7f82b42cf730) pid(11630) version 11:1:1:4 [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf730), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cf650, requested num -1 [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c95d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:06.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:06.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:57:06.631 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:06.631 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c98d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:06.631 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c98d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:06.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf730 [ CSSD]2013-05-23 11:57:06.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf730) con(0x7f82b42cddb0) skgpid ospid 11630 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:07.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:07.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:08.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:08.611 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:09.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:09.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:10.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:10.345 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf730) allocated [ CSSD]2013-05-23 11:57:10.346 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:57:10.346 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf730 - 1,2,3 [ CSSD]2013-05-23 11:57:10.346 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cddb0) proc(0x7f82b42cf730) pid(11682) version 11:1:1:4 [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf730), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42cf650, requested num -1 [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c95d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:10.351 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:10.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:57:10.357 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:10.357 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c98d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:10.357 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c98d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:10.559 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf730 [ CSSD]2013-05-23 11:57:10.559 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf730) con(0x7f82b42cddb0) skgpid ospid 11682 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:10.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e8002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:10.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e9002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:10.710 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:57:10.710 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:57:10.710 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:57:10.710 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:10.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ea002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:10.717 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:57:10.717 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:57:10.892 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf680) allocated [ CSSD]2013-05-23 11:57:10.892 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:57:10.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf680 - 1,2,3 [ CSSD]2013-05-23 11:57:10.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdd00) proc(0x7f82b42cf680) pid(11748) version 11:1:1:4 [ CSSD]2013-05-23 11:57:11.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:11.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:11.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:11.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:12.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:13.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:13.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:13.518 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf680 [ CSSD]2013-05-23 11:57:13.518 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf680) con(0x7f82b42cdd00) skgpid ospid 11748 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:14.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:15.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:15.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:15.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:15.549 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:57:16.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:16.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03eb002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:16.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:57:16.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:57:16.888 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:57:16.888 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:16.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ec002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:16.894 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:57:16.894 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:57:17.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:17.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:18.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:18.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:19.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:19.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:20.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:20.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:20.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:20.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ed002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:21.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:21.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:21.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:57:21.248 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:57:21.248 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:57:21.248 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 11:57:21.249 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7f60 [ CSSD]2013-05-23 11:57:21.249 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7f60) con(0x7f82b42cbd00) skgpid 11428 ospid 11428 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:22.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:23.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:23.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:24.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:25.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:25.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:25.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:25.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:25.682 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 11:57:25.683 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:57:25.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 11:57:25.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad30) proc(0x7f82b429e400) pid(12162) version 11:1:1:4 [ CSSD]2013-05-23 11:57:25.690 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e400), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:57:25.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:57:25.690 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d6fb0, requested num -1 [ CSSD]2013-05-23 11:57:25.690 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:25.690 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:25.691 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:25.691 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:25.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:57:25.698 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:25.698 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:25.699 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:25.901 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 11:57:25.901 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42bad30) skgpid ospid 12162 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:26.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:27.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:27.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:28.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:28.653 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:29.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:29.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:30.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:30.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:30.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:30.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ee002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:31.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:31.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:32.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ef002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:32.146 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:57:32.146 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:57:32.146 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:57:32.146 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:32.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f0002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:32.153 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:57:32.153 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:57:32.434 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 11:57:32.435 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:57:32.436 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 11:57:32.436 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad30) proc(0x7f82b429e400) pid(12242) version 11:1:1:4 [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e400), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d6fb0, requested num -1 [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:32.442 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:32.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:57:32.449 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:32.449 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:32.449 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:32.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:32.652 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 11:57:32.652 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42bad30) skgpid ospid 12242 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:33.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:33.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:34.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:34.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:34.562 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:57:35.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:35.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:36.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:37.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:37.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:38.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:38.674 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:39.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:39.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:39.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:39.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:40.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:40.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f1002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:40.935 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 11:57:40.936 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:57:40.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 11:57:40.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad30) proc(0x7f82b429e400) pid(12317) version 11:1:1:4 [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e400), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b42d6fb0, requested num -1 [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:40.942 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:40.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 11:57:40.949 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:40.949 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:40.949 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:41.151 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 11:57:41.151 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42bad30) skgpid ospid 12317 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:41.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:41.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:42.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:43.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:43.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:44.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:44.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:44.568 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:44.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:57:44.649 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:57:44.649 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:57:44.649 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 11:57:44.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:57:44.650 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid 6657 ospid 6657 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:45.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:45.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:46.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:47.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f2002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:47.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:57:47.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:57:47.394 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:57:47.394 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:47.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:47.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:47.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f3002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:47.400 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:57:47.400 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:57:48.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:48.697 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:49.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:49.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:49.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:49.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:50.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:50.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f4002a) incarnation(174631051) [ CSSD]2013-05-23 11:57:51.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:51.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:52.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:53.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:53.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:54.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:54.574 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:57:54.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:55.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:55.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:56.184 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:57:56.185 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:57:56.186 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:57:56.186 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(12475) version 11:1:1:4 [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:57:56.192 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:57:56.199 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:57:56.199 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:57:56.199 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:57:56.199 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:57:56.401 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:57:56.401 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 12475 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:57:56.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:57.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:57.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:58.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:57:58.719 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:57:59.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:57:59.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:57:59.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:57:59.577 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:00.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:00.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f5002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:01.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:01.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:02.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f6002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:02.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:58:02.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:58:02.640 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:58:02.640 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:02.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f7002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:02.647 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:58:02.647 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:58:02.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:03.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:03.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:04.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:04.580 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:04.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:05.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:05.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:06.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:06.884 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:06.885 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:58:06.886 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:06.886 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(12595) version 11:1:1:4 [ CSSD]2013-05-23 11:58:06.891 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 11:58:06.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:58:06.891 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4282920, requested num -1 [ CSSD]2013-05-23 11:58:06.891 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:06.891 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:58:06.892 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:06.892 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:06.898 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 11:58:06.898 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:58:06.898 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:06.898 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:07.100 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:07.100 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 12595 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:07.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:07.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:08.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:08.741 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:09.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:09.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:09.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:09.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:10.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:10.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f8002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:10.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f9002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:10.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:58:10.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:58:10.968 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:58:10.968 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:10.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fa002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:10.975 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:58:10.975 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:58:11.450 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:11.451 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:58:11.451 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:11.451 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(12630) version 11:1:1:4 [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:11.458 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:11.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:58:11.465 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:58:11.465 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:11.465 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:11.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:11.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:11.667 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:11.667 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 12630 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:12.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:13.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:13.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:14.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:14.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:14.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:15.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:15.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:16.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:17.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:17.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:17.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03fb002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:17.882 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:58:17.882 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:58:17.882 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:58:17.882 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:17.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fc002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:17.889 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:58:17.889 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:58:18.588 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:18.589 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:58:18.764 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:18.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:19.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:19.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:20.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:20.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fd002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:21.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:21.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:22.200 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:22.201 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:58:22.202 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:22.202 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(12741) version 11:1:1:4 [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427d4d0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:22.209 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:22.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:22.216 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 11:58:22.216 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 11:58:22.216 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:22.322 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a4e30) allocated [ CSSD]2013-05-23 11:58:22.323 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:58:22.324 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a4e30 - 1,2,3 [ CSSD]2013-05-23 11:58:22.324 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a4e30) pid(12746) version 11:1:1:4 [ CSSD]2013-05-23 11:58:22.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:58:22.340 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:58:22.342 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:58:22.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a4e30 [ CSSD]2013-05-23 11:58:22.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a4e30) con(0x7f82b427d8a0) skgpid ospid 12746 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:22.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:22.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 12741 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:22.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:23.592 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:23.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:23.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:23.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:24.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:25.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:25.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:26.701 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:26.702 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:58:26.703 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:26.703 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(12792) version 11:1:1:4 [ CSSD]2013-05-23 11:58:26.708 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:58:26.708 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:58:26.708 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:58:26.708 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:26.708 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:58:26.709 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:26.709 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:26.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:58:26.716 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:58:26.716 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:26.716 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:26.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:26.918 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:26.918 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 12792 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:27.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:27.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:28.594 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:28.595 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:28.791 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:28.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:29.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:29.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:30.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fe002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:30.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:31.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:31.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:32.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:33.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ff002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:33.131 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:58:33.131 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:58:33.131 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:58:33.132 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:33.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0400002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:33.139 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:58:33.139 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:58:33.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:33.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:33.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:33.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:34.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:35.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:35.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:36.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:37.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:37.600 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:58:37.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:37.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:38.814 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:38.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:39.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:39.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:40.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:40.808 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:58:40.809 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:40.809 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(12949) version 11:1:1:4 [ CSSD]2013-05-23 11:58:40.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0401002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:40.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:41.448 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:41.448 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 12949 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:41.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:41.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:41.952 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:41.953 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:58:41.954 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:41.954 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(13050) version 11:1:1:4 [ CSSD]2013-05-23 11:58:41.960 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 11:58:41.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:58:41.960 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:58:41.960 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:41.960 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:58:41.961 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:41.961 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:41.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 11:58:41.967 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:58:41.967 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:41.967 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:42.170 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:42.170 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 13050 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:42.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:42.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:43.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:43.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:43.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:45.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:46.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:46.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:47.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:47.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:47.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:48.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:48.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:48.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0402002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:48.380 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:58:48.380 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:58:48.380 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:58:48.380 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:48.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0403002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:48.386 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:58:48.386 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:58:48.839 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:49.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:49.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26a1bd0) [ CSSD]2013-05-23 11:58:49.339 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26a1bd0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 11:58:49.339 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26a1bd0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 11:58:49.339 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2677ec0) [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2677ec0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2677ec0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699d70 [ CSSD]2013-05-23 11:58:49.350 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699d70) con(0x268c280) skgpid 30021 ospid 30021 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:50.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:50.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:50.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0404002a) incarnation(174631051) [ CSSD]2013-05-23 11:58:51.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:52.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:52.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:52.610 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:52.610 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:53.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:54.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:54.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:55.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:56.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:56.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:57.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:58:57.204 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:58:57.205 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:58:57.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:58:57.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13283) version 11:1:1:4 [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b4282920, requested num -1 [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:58:57.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:58:57.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 11:58:57.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:58:57.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:58:57.219 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:58:57.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:58:57.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 13283 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:58:57.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:58:57.613 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:58:58.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:58:58.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:58:58.860 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:58:59.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:00.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:00.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:00.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0405002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:01.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:02.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:02.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:02.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:02.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:03.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:03.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0406002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:03.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:59:03.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:59:03.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:59:03.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:03.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0407002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:03.634 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:59:03.634 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:59:04.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:04.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:05.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:06.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:06.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:07.136 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:07.137 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:59:07.138 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:07.138 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13401) version 11:1:1:4 [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:07.144 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:07.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 11:59:07.150 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:59:07.150 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:07.150 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:07.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:07.353 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:07.353 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 13401 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:07.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:07.618 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:08.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:08.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:08.457 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:08.458 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:59:08.459 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:08.459 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13422) version 11:1:1:4 [ CSSD]2013-05-23 11:59:08.590 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 11:59:08.591 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 11:59:08.592 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 11:59:08.592 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42cfa20) pid(13432) version 11:1:1:4 [ CSSD]2013-05-23 11:59:08.608 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:59:08.610 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 11:59:08.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 11:59:08.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42a29f0) skgpid ospid 13432 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5292/0x7f82b41edd50) [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5292 (0x7f82b41edd50) [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41edd50 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42a4e30/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:08.692 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 11:59:08.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5292 (0x7f82b41edd50) [ CSSD]2013-05-23 11:59:08.698 [1199044928] >TRACE: clssgmExitGrock: client 5292 (0x7f82b41edd50), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 11:59:08.698 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 11:59:08.698 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:08.700 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:08.700 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 13422 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:08.882 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:09.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:10.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:10.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:10.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0408002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:11.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0409002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:11.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:59:11.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:59:11.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:59:11.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:11.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040a002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:11.232 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:59:11.232 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:59:11.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:12.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:12.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:12.474 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:12.475 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:59:12.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:12.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13468) version 11:1:1:4 [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:12.481 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:12.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 11:59:12.488 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:59:12.488 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:12.488 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:12.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:12.621 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:12.690 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:12.690 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 13468 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:13.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:14.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:14.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:15.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:16.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:16.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:17.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:17.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:17.624 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:18.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:18.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:18.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040b002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:18.873 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:59:18.873 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:59:18.874 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:59:18.874 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:18.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040c002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:18.880 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:59:18.880 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:59:18.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:19.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:20.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:20.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:21.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040d002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:21.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:22.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:22.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:22.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:22.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:23.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:24.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:24.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:25.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:26.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:26.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:27.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:27.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:27.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:27.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:27.728 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:59:27.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:27.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13612) version 11:1:1:4 [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4282920, requested num -1 [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:27.735 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:27.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 11:59:27.743 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:59:27.743 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:27.743 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:27.946 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:27.946 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 13612 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:28.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:28.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:28.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:29.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:30.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:30.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:31.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040e002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:31.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:32.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:32.410 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:32.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:32.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:33.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:34.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040f002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:34.122 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:59:34.122 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:59:34.122 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:59:34.122 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:34.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0410002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:34.129 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:59:34.129 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:59:34.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:34.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:35.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:36.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:36.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:37.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:37.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:37.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:38.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:38.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:38.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:39.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:40.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:40.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:41.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0411002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:41.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:42.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:42.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:42.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:42.639 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:42.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:42.991 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:59:42.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:42.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(13753) version 11:1:1:4 [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:42.997 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:43.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 11:59:43.003 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:59:43.003 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:43.003 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:43.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:43.206 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 13753 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:43.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:44.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:44.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:45.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:46.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:46.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:46.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:46.642 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 11:59:47.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:48.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:48.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:48.971 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:49.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0412002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:49.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 11:59:49.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 11:59:49.369 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 11:59:49.369 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:49.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0413002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:49.375 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 11:59:49.375 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 11:59:49.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:50.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:50.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:51.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0414002a) incarnation(174631051) [ CSSD]2013-05-23 11:59:51.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:51.645 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:51.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:52.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:52.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:53.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:54.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:54.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:55.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:56.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:56.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:56.647 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 11:59:56.647 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 11:59:57.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 11:59:58.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 11:59:58.241 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 11:59:58.241 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 11:59:58.241 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a5440) pid(13916) version 11:1:1:4 [ CSSD]2013-05-23 11:59:58.247 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 11:59:58.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:59:58.247 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4282920, requested num -1 [ CSSD]2013-05-23 11:59:58.247 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:58.247 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 11:59:58.248 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 11:59:58.248 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 11:59:58.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 11:59:58.254 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 11:59:58.254 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 11:59:58.254 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 11:59:58.456 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 11:59:58.456 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a29f0) skgpid ospid 13916 with 0 clients, refcount 0 [ CSSD]2013-05-23 11:59:58.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 11:59:58.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 11:59:58.991 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 11:59:59.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:00.292 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:00:00.293 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:00.293 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:00:00.293 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(13206/13206) version 11:1:1:4 [ CSSD]2013-05-23 12:00:00.309 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 12:00:00.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 12:00:00.309 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:00:00.309 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:00:00.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:00.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:01.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0415002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:01.280 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 12:00:01.281 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:01.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 12:00:01.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b429e400) pid(12431/12431) version 11:1:1:4 [ CSSD]2013-05-23 12:00:01.295 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b429e400), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:00:01.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:00:01.295 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:00:01.295 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:00:01.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:01.650 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:01.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:02.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:02.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:03.172 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(2/0x7f82b4204870) [ CSSD]2013-05-23 12:00:03.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 12:00:03.172 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:00:03.172 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:00:03.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:04.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0416002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:04.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:04.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:04.615 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:04.615 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:04.618 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9050) allocated [ CSSD]2013-05-23 12:00:04.618 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:04.619 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9050 - 1,2,3 [ CSSD]2013-05-23 12:00:04.619 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd9e0) proc(0x7f82b42c9050) pid(14209/14209) version 11:1:1:4 [ CSSD]2013-05-23 12:00:04.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0417002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:04.621 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:04.621 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:04.625 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42c9050), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:00:04.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:00:04.625 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:00:04.625 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:00:04.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:04.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:04.932 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:00:04.932 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:00:04.932 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:00:04.932 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:00:04.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9050 [ CSSD]2013-05-23 12:00:04.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9050) con(0x7f82b42cd9e0) skgpid 14209 ospid 14209 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:05.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:06.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:06.654 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:06.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:06.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:07.400 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9050) allocated [ CSSD]2013-05-23 12:00:07.401 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:07.402 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9050 - 1,2,3 [ CSSD]2013-05-23 12:00:07.402 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd9e0) proc(0x7f82b42c9050) pid(14229) version 11:1:1:4 [ CSSD]2013-05-23 12:00:07.407 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42c9050), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42cf810, requested num -1 [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9880/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:00:07.408 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:07.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:00:07.414 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:00:07.414 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9b80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:07.415 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9b80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:00:07.617 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9050 [ CSSD]2013-05-23 12:00:07.617 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9050) con(0x7f82b42cd9e0) skgpid ospid 14229 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:07.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:08.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:08.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:09.013 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:09.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:10.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:10.656 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:00:10.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:10.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:11.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0418002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:11.482 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf760) allocated [ CSSD]2013-05-23 12:00:11.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0419002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:11.483 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:11.483 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:11.483 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:11.483 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:11.483 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:11.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf760 - 1,2,3 [ CSSD]2013-05-23 12:00:11.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd840) proc(0x7f82b42cf760) pid(14270/14270) version 11:1:1:4 [ CSSD]2013-05-23 12:00:11.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041a002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:11.489 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:11.489 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:11.500 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42cf760), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:00:11.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:00:11.500 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:00:11.500 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:00:11.633 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42cf760), client(2/0x7f82b4207960) [ CSSD]2013-05-23 12:00:11.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:00:11.633 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:00:11.633 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:00:11.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:12.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:12.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:13.490 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcfc0) allocated [ CSSD]2013-05-23 12:00:13.491 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:00:13.492 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcfc0 - 1,2,3 [ CSSD]2013-05-23 12:00:13.492 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c98b0) proc(0x7f82b42dcfc0) pid(14289) version 11:1:1:4 [ CSSD]2013-05-23 12:00:13.497 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dcfc0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:00:13.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:00:13.497 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42caf60, requested num -1 [ CSSD]2013-05-23 12:00:13.497 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:13.497 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd740/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:00:13.498 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:00:13.498 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:13.504 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:00:13.504 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:00:13.504 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dda40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:13.504 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dda40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:00:13.706 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcfc0 [ CSSD]2013-05-23 12:00:13.706 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcfc0) con(0x7f82b42c98b0) skgpid ospid 14289 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:13.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:14.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:00:14.702 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:00:14.702 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:00:14.702 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 12:00:14.703 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b427c5d0) skgpid 8527 ospid 8527 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:00:14.712 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid 8529 ospid 8529 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:14.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:14.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:15.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:15.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:15.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:16.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:16.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:17.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:18.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:18.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:19.039 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:19.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:19.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041b002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:19.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:19.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:19.871 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:19.871 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:19.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041c002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:19.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:19.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:20.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:20.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:20.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:20.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:21.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041d002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:21.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:22.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:22.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:23.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:24.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:00:24.710 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:00:24.710 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:00:24.710 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf760 [ CSSD]2013-05-23 12:00:24.716 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf760) con(0x7f82b42cd840) skgpid 14270 ospid 14270 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:24.728 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:00:24.729 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:00:24.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:00:24.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(14425/14425) version 11:1:1:4 [ CSSD]2013-05-23 12:00:24.745 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:00:24.745 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:00:24.745 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:00:24.745 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:00:24.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:24.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:25.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:25.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:00:25.666 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid 14425 ospid 14425 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:25.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:26.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:26.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:27.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:28.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:00:28.741 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:00:28.741 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:00:28.741 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(14451) version 11:1:1:4 [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:00:28.747 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:28.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:00:28.754 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:00:28.754 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:28.754 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:00:28.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:28.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:28.956 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:00:28.956 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 14451 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:29.066 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:29.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:29.668 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:00:29.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:31.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:31.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:31.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041e002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:31.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:33.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:33.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:33.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:34.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:34.672 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:35.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:35.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:35.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041f002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:35.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:35.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:35.125 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:35.125 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:35.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0420002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:35.132 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:35.132 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:35.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:37.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:37.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:38.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:39.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:39.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:39.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:39.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:39.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:40.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:41.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:41.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:41.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0421002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:42.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:43.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:43.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:43.989 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:00:43.990 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:00:43.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:00:43.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(14601) version 11:1:1:4 [ CSSD]2013-05-23 12:00:44.007 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:00:44.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:00:44.007 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:00:44.007 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:44.007 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:00:44.008 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:00:44.008 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:44.014 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:00:44.014 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:00:44.014 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:44.014 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:00:44.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:44.217 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:00:44.217 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 14601 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:00:44.678 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:44.678 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:45.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:45.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:46.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:47.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:47.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:47.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0422002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:47.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:47.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:47.754 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:47.754 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:47.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0423002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:47.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:47.761 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:48.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:48.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:48.681 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:00:49.112 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:49.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:49.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:50.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:50.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0424002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:50.372 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:00:50.372 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:00:50.372 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:00:50.372 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:50.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0425002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:50.379 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:00:50.379 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:00:51.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:51.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:51.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0426002a) incarnation(174631051) [ CSSD]2013-05-23 12:00:52.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:53.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:53.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:53.684 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:53.684 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:54.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:55.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:55.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:56.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:57.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:57.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:58.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:00:58.687 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:00:58.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:00:59.148 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:00:59.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:00:59.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:00:59.260 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:00:59.261 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:00:59.262 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:00:59.262 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(14757) version 11:1:1:4 [ CSSD]2013-05-23 12:00:59.267 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:00:59.267 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:00:59.267 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:00:59.267 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:59.267 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:00:59.268 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:00:59.268 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:00:59.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:00:59.275 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:00:59.275 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:00:59.275 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:00:59.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:00:59.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 14757 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:00.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:01.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:01.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:01.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0427002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:01.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0428002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:01.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:01.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:01.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:01:01.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:01.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0429002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:01.656 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:01.656 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:01.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:01.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:01.787 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:01.787 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:02.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:03.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:03.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:03.690 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:03.691 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:04.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:05.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:05.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:05.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042a002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:05.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:05.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:05.627 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:05.627 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:05.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042b002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:05.633 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:05.633 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:06.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:07.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:07.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:07.661 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:07.662 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:01:07.663 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:07.663 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(14863) version 11:1:1:4 [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:01:07.669 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:07.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:01:07.677 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:01:07.677 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:07.677 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:01:07.693 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:07.693 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:01:07.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:07.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 14863 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:08.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:09.173 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:09.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:09.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:10.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:11.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:11.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:11.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042c002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:11.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042d002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:11.735 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:11.735 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:11.735 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:11.735 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:11.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042e002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:11.743 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:11.743 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:12.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:12.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:12.697 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:13.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:13.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:14.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:14.513 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:14.514 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:01:14.514 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:14.514 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(14917) version 11:1:1:4 [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:01:14.520 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:14.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:01:14.527 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:01:14.528 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:14.528 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:01:14.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:14.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 14917 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:15.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:15.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:15.684 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:15.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:01:15.685 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:15.685 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(14966/14966) version 11:1:1:4 [ CSSD]2013-05-23 12:01:15.691 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:01:15.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:01:15.691 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:01:15.691 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:15.722 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid 14966 ospid 14966 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:16.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:17.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:17.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:17.699 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:17.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:18.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:19.195 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:19.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:19.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:20.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:20.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042f002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:20.874 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:20.874 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:20.874 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:20.874 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:20.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0430002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:20.880 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:20.880 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:21.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:21.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:21.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0431002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:22.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:22.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:22.703 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:23.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:23.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:24.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:25.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:25.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:26.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:27.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:27.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:27.706 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:27.706 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:28.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:29.217 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:29.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:29.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:29.773 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:29.774 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:01:29.775 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:29.775 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(15076) version 11:1:1:4 [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:01:29.791 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:29.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:01:29.798 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:01:29.798 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:29.798 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:01:30.001 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:30.001 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 15076 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:30.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:31.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:31.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:31.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0432002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:32.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:32.709 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:32.709 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:33.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:33.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:34.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:35.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:35.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:36.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0433002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:36.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:36.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:36.132 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:36.132 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:36.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0434002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:36.139 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:36.139 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:36.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:37.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:37.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:37.712 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:37.712 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:38.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:39.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:39.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:39.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:40.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:41.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0435002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:41.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:41.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:42.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:42.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:42.716 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:43.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:43.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:44.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:45.035 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:45.036 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:01:45.037 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:45.037 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(15228) version 11:1:1:4 [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:01:45.043 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:45.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:01:45.051 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:01:45.051 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:01:45.051 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:01:45.253 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:45.253 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 15228 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:45.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:45.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:46.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:47.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:47.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:47.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:47.719 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:48.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:49.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:49.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:49.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:50.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:51.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0436002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:51.380 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:51.380 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:51.380 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:51.380 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:51.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0437002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:51.387 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:51.387 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:51.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0438002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:51.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:51.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:52.579 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:01:52.580 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:01:52.581 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:01:52.581 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(15323/15323) version 11:1:1:4 [ CSSD]2013-05-23 12:01:52.596 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:01:52.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:01:52.596 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:01:52.596 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:01:52.615 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid 15323 ospid 15323 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:01:52.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:52.721 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:52.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:53.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:53.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:54.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:55.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:55.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:56.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:57.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:57.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:01:57.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0439002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:57.720 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:57.720 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:57.720 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:01:57.720 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:01:57.724 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:01:57.725 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:01:57.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043a002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:57.729 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:57.729 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:58.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:01:58.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:58.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:58.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:58.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:01:58.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043b002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:58.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:01:58.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:01:58.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:01:58.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:01:58.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043c002a) incarnation(174631051) [ CSSD]2013-05-23 12:01:58.999 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:01:58.999 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:01:59.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:01:59.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:01:59.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:00.287 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:00.288 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:02:00.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:00.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(15402) version 11:1:1:4 [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:02:00.295 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:00.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:02:00.303 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:02:00.303 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:00.303 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:02:00.506 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:00.506 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 15402 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:00.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:01.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043d002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:01.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:01.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:02.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:02.728 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:02.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:03.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:03.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:04.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:05.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:05.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:06.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043e002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:06.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:02:06.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:02:06.627 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:02:06.627 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:06.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043f002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:06.634 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:02:06.634 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:02:06.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:07.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:07.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:07.731 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:07.731 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:07.929 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:07.930 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:07.931 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:07.931 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(15506) version 11:1:1:4 [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:02:07.937 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:07.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:02:07.945 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:02:07.945 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:07.945 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:02:08.148 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:08.148 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 15506 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:08.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:09.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:09.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:09.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:10.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:11.406 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:11.407 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:11.408 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:11.408 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207c10) pid(15569) version 11:1:1:4 [ CSSD]2013-05-23 12:02:11.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0440002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:11.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:11.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:11.733 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:11.733 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:02:11.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0441002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:11.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:02:11.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:02:11.997 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:02:11.997 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:12.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0442002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:12.004 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:02:12.004 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:02:12.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:13.191 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 12:02:13.191 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:13.192 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 12:02:13.192 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b427d340) pid(14997/14997) version 11:1:1:4 [ CSSD]2013-05-23 12:02:13.202 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b427d340), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:02:13.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:02:13.202 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:02:13.202 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:02:13.223 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf570) allocated [ CSSD]2013-05-23 12:02:13.224 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:13.224 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf570 - 1,2,3 [ CSSD]2013-05-23 12:02:13.224 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cf570) pid(14995/14995) version 11:1:1:4 [ CSSD]2013-05-23 12:02:13.229 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42cf570), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:02:13.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:02:13.229 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:02:13.229 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:02:13.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:13.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:13.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:13.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42ccc30) skgpid ospid 15569 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:14.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:15.542 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:15.543 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:02:15.543 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:15.543 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(15889) version 11:1:1:4 [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4207c10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cf430, requested num -1 [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c96a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:02:15.549 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:15.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:02:15.556 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:02:15.556 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c99a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:15.556 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c99a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:02:15.727 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42cf570), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 12:02:15.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:02:15.727 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:02:15.727 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:02:15.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:15.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:15.759 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:15.759 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 15889 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:16.736 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:16.736 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:17.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:17.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:17.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:19.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:19.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:19.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:19.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:21.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:21.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0443002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:21.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:21.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:21.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:21.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:21.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0444002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:21.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:02:21.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:02:21.876 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:02:21.877 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:21.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0445002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:21.883 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:02:21.883 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:02:23.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:23.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:23.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:25.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:25.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:25.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:26.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:26.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:27.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:27.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:27.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:29.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:29.367 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:29.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:29.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:30.793 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:30.794 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:02:30.795 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:30.795 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(16066) version 11:1:1:4 [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4207c10), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c99c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:02:30.800 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:30.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:02:30.807 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:02:30.807 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:30.807 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:02:31.010 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:31.010 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 16066 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:31.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:31.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0446002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:31.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:31.745 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:31.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:31.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:33.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:33.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:33.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:35.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:35.747 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:35.747 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:02:35.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:35.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:37.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0447002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:37.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:02:37.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:02:37.123 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:02:37.123 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:37.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0448002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:37.130 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:02:37.130 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:02:37.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:37.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:37.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:39.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:39.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:40.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:40.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:40.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:40.750 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:41.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:41.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0449002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:42.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:42.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:43.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:44.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:44.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42a1690) skgpid 10473 ospid 10473 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:02:44.725 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:02:44.729 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 12:02:44.729 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:02:44.729 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:02:44.729 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:02:44.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:02:44.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42b3da0) skgpid 10475 ospid 10475 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:45.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:45.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:45.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:46.047 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 12:02:46.048 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:02:46.048 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 12:02:46.048 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207c10) pid(16218) version 11:1:1:4 [ CSSD]2013-05-23 12:02:46.054 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:02:46.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:02:46.054 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:02:46.054 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:46.054 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:02:46.055 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:02:46.055 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:46.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:02:46.061 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:02:46.061 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:02:46.061 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:02:46.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:46.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:46.264 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 12:02:46.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c6340) skgpid ospid 16218 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:47.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:02:47.017 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:47.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:02:47.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(16210/16210) version 11:1:1:4 [ CSSD]2013-05-23 12:02:47.032 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:02:47.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:02:47.032 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:02:47.032 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:02:47.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:48.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:48.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:48.408 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:02:48.408 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:02:48.409 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:02:48.409 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd060) proc(0x7f82b42583a0) pid(16208/16208) version 11:1:1:4 [ CSSD]2013-05-23 12:02:48.415 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42583a0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:02:48.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:02:48.415 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:02:48.415 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:02:49.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:49.421 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:49.675 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:02:49.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:02:49.675 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:02:49.675 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:02:50.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:50.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:50.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:50.756 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:51.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 12:02:51.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42a29f0) skgpid 12431 ospid 12431 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:02:51.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044a002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:52.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:52.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:52.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044b002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:52.372 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:02:52.372 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:02:52.372 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:02:52.373 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:02:52.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044c002a) incarnation(174631051) [ CSSD]2013-05-23 12:02:52.379 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:02:52.379 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:02:53.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:54.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:54.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:55.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:55.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:55.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:02:56.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:56.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:57.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:58.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:02:58.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:02:59.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:02:59.440 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:02:59.761 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:02:59.762 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:03:00.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:00.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:01.297 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c91e0) allocated [ CSSD]2013-05-23 12:03:01.298 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:03:01.299 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c91e0 - 1,2,3 [ CSSD]2013-05-23 12:03:01.299 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c91e0) pid(16375) version 11:1:1:4 [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c91e0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7830/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:01.303 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:01.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:01.309 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:03:01.309 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:01.309 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:01.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:01.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c91e0 [ CSSD]2013-05-23 12:03:01.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c91e0) con(0x7f82b42a29f0) skgpid ospid 16375 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:01.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044d002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:02.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:02.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:02.755 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b427d340), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 12:03:02.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:03:02.755 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:03:02.755 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:03:03.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:04.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:04.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:04.765 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:04.765 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:05.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:06.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:06.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:07.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:07.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044e002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:07.620 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:03:07.620 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:03:07.620 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:03:07.620 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:07.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044f002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:07.627 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:03:07.627 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:03:08.185 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:08.186 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:08.187 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:08.187 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16468) version 11:1:1:4 [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:08.193 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:08.199 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:08.199 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:03:08.199 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:08.199 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:08.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:08.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:08.401 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:08.401 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid ospid 16468 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:09.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:09.461 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:03:09.768 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:09.768 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:10.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:10.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:11.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:11.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0450002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:12.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0451002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:12.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:03:12.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:03:12.248 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:03:12.248 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:12.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0452002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:12.254 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:03:12.254 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:03:12.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:12.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:13.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:14.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:14.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:14.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:14.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:15.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:16.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:16.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:16.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:16.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:03:16.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:16.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16536) version 11:1:1:4 [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:16.552 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:16.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:16.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:03:16.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:16.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:16.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:16.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid ospid 16536 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:17.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:18.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:18.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:18.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:18.773 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:03:19.483 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:03:19.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:20.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:20.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:21.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:21.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0453002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:22.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:22.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:22.495 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:22.496 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:22.496 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:22.496 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16630) version 11:1:1:4 [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427d5c0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7900/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:22.503 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:22.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:03:22.509 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:03:22.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d7c00) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:03:22.510 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:22.616 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe160) allocated [ CSSD]2013-05-23 12:03:22.617 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe160 - 1,2,3 [ CSSD]2013-05-23 12:03:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b41fe160) pid(16635) version 11:1:1:4 [ CSSD]2013-05-23 12:03:22.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:03:22.635 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:03:22.637 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:03:22.639 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe160 [ CSSD]2013-05-23 12:03:22.639 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe160) con(0x7f82b42bad40) skgpid ospid 16635 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:22.712 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:22.712 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid ospid 16630 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:22.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0454002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:22.874 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:03:22.874 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:03:22.874 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:03:22.874 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:22.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0455002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:22.880 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:03:22.880 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:03:23.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:23.776 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:23.776 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:24.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:24.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:25.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:26.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:26.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:27.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:28.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:28.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:28.779 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:28.779 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:28.882 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:28.883 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:28.883 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:28.883 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16682/16682) version 11:1:1:4 [ CSSD]2013-05-23 12:03:28.899 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:03:28.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:03:28.899 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:03:28.899 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:28.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid 16682 ospid 16682 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:29.135 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:29.135 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:29.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:29.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16686/16686) version 11:1:1:4 [ CSSD]2013-05-23 12:03:29.142 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:03:29.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:03:29.142 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:03:29.142 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:03:29.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:03:29.187 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:03:29.187 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:03:29.187 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:03:29.188 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:29.188 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid 16686 ospid 16686 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:29.505 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:03:29.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:30.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:30.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:31.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:31.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0456002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:31.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:31.795 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:03:31.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:31.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42c92b0) pid(16713) version 11:1:1:4 [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b429ed80, requested num -1 [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7a80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:31.801 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:31.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:03:31.808 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:03:31.808 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:31.808 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:32.011 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:32.011 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42bad40) skgpid ospid 16713 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:32.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:32.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:33.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:33.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:33.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:34.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:34.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:35.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:36.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:36.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:37.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:38.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0457002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:38.130 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:03:38.130 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:03:38.131 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:03:38.131 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:38.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0458002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:38.137 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:03:38.137 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:03:38.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:38.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:38.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:38.786 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:39.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:03:39.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:40.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:40.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:41.207 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:41.208 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:03:41.208 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:41.208 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(16831) version 11:1:1:4 [ CSSD]2013-05-23 12:03:41.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0459002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:41.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:41.814 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:41.814 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid ospid 16831 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:42.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:42.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:43.789 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:43.789 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:43.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:44.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:44.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:45.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:46.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:46.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:47.044 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:03:47.045 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:03:47.046 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:03:47.046 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c92b0) pid(17029) version 11:1:1:4 [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:03:47.052 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:47.059 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:03:47.059 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:03:47.059 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:03:47.059 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:03:47.262 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:03:47.262 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42ccc30) skgpid ospid 17029 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:47.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:48.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:48.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:48.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:48.792 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 12:03:49.378 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d3690) skgpid 11134 ospid 11134 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:49.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:03:49.385 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:03:49.385 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:03:49.385 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:03:49.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:03:49.396 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:03:49.396 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:03:49.396 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:03:49.397 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:03:49.397 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42b3350) skgpid 11136 ospid 11136 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:03:49.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:03:49.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:50.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:50.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:51.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045a002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:51.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:52.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:52.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:53.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045b002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:53.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:03:53.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:03:53.378 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:03:53.378 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:03:53.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045c002a) incarnation(174631051) [ CSSD]2013-05-23 12:03:53.385 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:03:53.385 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:03:53.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:53.796 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:53.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:54.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:54.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:55.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:56.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:56.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:58.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:03:58.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:03:58.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:03:58.799 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:03:58.799 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:03:59.572 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:00.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:00.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:00.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:01.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045d002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:02.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:02.295 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:04:02.296 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:04:02.296 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:04:02.296 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42573d0) pid(17187) version 11:1:1:4 [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42573d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:02.303 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:02.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:02.310 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:04:02.310 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4204620) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:02.310 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4204620) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:02.512 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:04:02.512 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42ccc30) skgpid ospid 17187 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:02.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:02.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:03.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:03.803 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:04.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:04.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:04.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:06.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:06.311 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:04:06.312 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:04:06.312 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:04:06.312 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42573d0) pid(17091/17091) version 11:1:1:4 [ CSSD]2013-05-23 12:04:06.329 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42573d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:04:06.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:04:06.329 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:04:06.329 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:04:06.343 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42573d0), client(2/0x7f82b4286810) [ CSSD]2013-05-23 12:04:06.343 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 12:04:06.343 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:04:06.343 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:04:06.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:06.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:08.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:08.446 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:04:08.447 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:04:08.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:04:08.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(17282) version 11:1:1:4 [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:08.454 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:08.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:08.462 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:04:08.462 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:08.462 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:08.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045e002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:08.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:04:08.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:04:08.636 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:04:08.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:08.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045f002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:08.643 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:04:08.643 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:04:08.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:04:08.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 17282 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:08.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:08.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:08.777 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:04:08.777 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:04:08.778 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:04:08.778 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b429e7a0) pid(17291) version 11:1:1:4 [ CSSD]2013-05-23 12:04:08.806 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:08.806 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:08.908 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42bacc0) allocated [ CSSD]2013-05-23 12:04:08.908 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:04:08.909 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42bacc0 - 1,2,3 [ CSSD]2013-05-23 12:04:08.909 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cf0) proc(0x7f82b42bacc0) pid(17301) version 11:1:1:4 [ CSSD]2013-05-23 12:04:08.926 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:04:08.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:04:08.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42bacc0 [ CSSD]2013-05-23 12:04:08.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42bacc0) con(0x7f82b42c7cf0) skgpid ospid 17301 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5293/0x7f82b42d9760) [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5293 (0x7f82b42d9760) [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42d9760 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42ba890/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:09.010 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:04:09.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5293 (0x7f82b42d9760) [ CSSD]2013-05-23 12:04:09.016 [1199044928] >TRACE: clssgmExitGrock: client 5293 (0x7f82b42d9760), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:04:09.016 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:04:09.016 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:09.017 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:04:09.017 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42a19b0) skgpid ospid 17291 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:09.592 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:10.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:10.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:10.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:11.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0460002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:12.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:12.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0461002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:12.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:04:12.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:04:12.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:04:12.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:12.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0462002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:12.511 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:04:12.511 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:04:12.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:12.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:13.809 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:13.809 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:14.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:14.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:14.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:16.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:16.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:16.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:17.550 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:04:17.551 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:04:17.552 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:04:17.552 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(17369) version 11:1:1:4 [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:17.558 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:17.566 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:04:17.566 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:04:17.566 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:17.566 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:17.768 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:04:17.768 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 17369 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:18.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:18.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:18.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:18.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:18.812 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:19.612 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:20.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:20.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:20.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:21.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0463002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:22.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:22.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:22.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:23.815 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:23.815 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:23.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0464002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:23.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:04:23.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:04:23.883 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:04:23.883 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:23.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0465002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:23.891 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:04:23.891 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:04:24.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:24.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:24.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:26.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:26.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:26.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:28.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:28.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:28.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:28.818 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:28.818 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:29.634 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:30.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:30.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:30.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:31.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0466002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:32.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:32.812 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:04:32.813 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:04:32.814 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:04:32.814 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(17521) version 11:1:1:4 [ CSSD]2013-05-23 12:04:32.819 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:32.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:32.819 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 12:04:32.819 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:32.819 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:04:32.820 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:32.820 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:32.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:04:32.826 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:04:32.826 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:32.826 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:32.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:32.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:33.029 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:04:33.029 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 17521 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:33.821 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:33.821 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:34.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:34.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:34.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:36.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:36.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:36.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:38.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:38.824 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:38.824 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:38.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:38.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:39.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0467002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:39.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:04:39.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:04:39.134 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:04:39.134 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:39.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0468002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:39.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:04:39.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:04:39.656 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:40.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:40.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:40.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:41.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0469002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:42.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:42.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:42.827 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:04:42.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:42.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:44.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:44.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:44.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:46.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:46.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:46.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:47.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:47.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:48.063 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:04:48.063 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:04:48.064 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:04:48.064 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(17668) version 11:1:1:4 [ CSSD]2013-05-23 12:04:48.070 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:04:48.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:04:48.070 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:04:48.070 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:48.070 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:04:48.071 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:04:48.071 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:48.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:04:48.078 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:04:48.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:04:48.078 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:04:48.280 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:04:48.280 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 17668 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:04:48.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:48.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:48.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:49.679 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:04:50.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:50.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:50.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:51.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046a002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:52.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:52.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:52.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:52.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:52.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:54.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046b002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:54.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:04:54.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:04:54.392 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:04:54.392 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:04:54.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046c002a) incarnation(174631051) [ CSSD]2013-05-23 12:04:54.399 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:04:54.399 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:04:54.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:55.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:55.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:56.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:57.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:57.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:57.835 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:04:57.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:04:58.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:04:59.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:04:59.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:04:59.703 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:00.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:01.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:01.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:01.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046d002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:02.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:02.838 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:02.838 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:03.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:03.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:03.314 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:03.315 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:05:03.316 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:03.316 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(17846) version 11:1:1:4 [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:05:03.322 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:03.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:05:03.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:05:03.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:03.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:05:03.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:03.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 17846 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:04.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:05.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:05.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:05.158 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:05.158 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:05:05.159 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:05.159 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b429e7a0) pid(17904/17904) version 11:1:1:4 [ CSSD]2013-05-23 12:05:05.175 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:05:05.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:05:05.175 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:05:05.175 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:05.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42a19b0) skgpid 17904 ospid 17904 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:06.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:06.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:06.841 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:05:07.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:07.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:08.705 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:08.706 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:05:08.706 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:08.706 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b429e7a0) pid(17928) version 11:1:1:4 [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:05:08.713 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:08.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:05:08.719 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:05:08.719 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:08.719 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:05:08.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:08.922 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:08.922 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42a19b0) skgpid ospid 17928 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:09.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:09.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:09.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046e002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:09.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:05:09.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:05:09.641 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:05:09.641 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:09.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046f002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:09.648 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:05:09.648 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:05:09.727 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:10.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:11.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:11.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:11.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:11.844 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:12.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0470002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:12.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0471002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:12.759 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:05:12.759 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:05:12.759 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:05:12.759 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:12.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0472002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:12.765 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:05:12.765 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:05:12.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:13.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:13.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:14.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:15.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:15.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:16.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:16.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:16.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:17.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:17.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:18.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:18.566 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:05:18.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:18.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b429e7a0) pid(18003) version 11:1:1:4 [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:05:18.573 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:18.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:05:18.580 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:05:18.580 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:18.580 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:05:18.783 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:18.783 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42a19b0) skgpid ospid 18003 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:18.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:19.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:19.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:19.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:20.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:21.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:21.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:21.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:21.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:22.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0473002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:22.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:23.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:23.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:24.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0474002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:24.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:05:24.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:05:24.892 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:05:24.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:24.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0475002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:24.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:05:24.899 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:05:24.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:25.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:25.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:25.852 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:25.852 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:05:27.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:27.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:27.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:29.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:29.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:29.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:29.791 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:30.855 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:30.855 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:31.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:31.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:31.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:32.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0476002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:33.028 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:33.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:33.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:33.816 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:33.817 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:05:33.817 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:33.817 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b429e7a0) pid(18142) version 11:1:1:4 [ CSSD]2013-05-23 12:05:33.823 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:05:33.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:05:33.823 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:05:33.823 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:33.823 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:05:33.824 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:05:33.824 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:33.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:05:33.830 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:05:33.830 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:33.830 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:05:34.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:34.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42a19b0) skgpid ospid 18142 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:35.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:35.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:35.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:35.858 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:35.859 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:37.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:37.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:37.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:39.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:39.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:39.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:39.815 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:40.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0477002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:40.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:05:40.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:05:40.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:05:40.150 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:40.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0478002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:40.158 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:05:40.158 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:05:40.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:40.862 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:41.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:41.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:41.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:42.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0479002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:43.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:43.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:43.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:45.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:45.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:45.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:45.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:45.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:47.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:47.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:47.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:49.066 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:05:49.067 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:05:49.068 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:05:49.068 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(18288) version 11:1:1:4 [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:05:49.074 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:49.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:05:49.082 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:05:49.082 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:05:49.083 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:05:49.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:49.285 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:05:49.285 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 18288 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:05:49.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:49.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:49.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:05:50.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:50.868 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:51.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:51.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:51.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:52.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047a002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:53.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:53.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:53.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:55.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:55.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047b002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:55.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:05:55.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:05:55.401 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:05:55.401 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:05:55.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047c002a) incarnation(174631051) [ CSSD]2013-05-23 12:05:55.408 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:05:55.408 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:05:55.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:55.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:55.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:05:55.871 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:05:57.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:57.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:57.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:59.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:05:59.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:05:59.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:05:59.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:00.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:00.875 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:01.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:01.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:01.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:01.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047d002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:01.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:01.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:01.940 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:06:01.940 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:01.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047e002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:01.947 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:01.947 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:02.077 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:02.077 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:02.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:02.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:02.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047f002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:03.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:03.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:03.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:04.318 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:06:04.318 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:06:04.319 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:06:04.319 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(18451) version 11:1:1:4 [ CSSD]2013-05-23 12:06:04.325 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:06:04.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:06:04.325 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:06:04.325 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:04.325 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:06:04.326 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:06:04.326 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:04.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:06:04.333 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:06:04.333 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:04.333 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:06:04.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:06:04.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 18451 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:05.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:05.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:05.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:05.877 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:05.877 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:07.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:07.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:07.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:08.959 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:06:08.960 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:06:08.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:06:08.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(18522) version 11:1:1:4 [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42a19b0, requested num -1 [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:06:08.967 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:08.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:06:08.975 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:06:08.975 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:08.975 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:06:09.177 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:06:09.177 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid ospid 18522 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:09.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:09.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:09.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:09.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:09.880 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:06:09.882 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:10.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0480002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:10.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:10.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:10.652 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:06:10.652 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:10.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0481002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:10.660 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:10.660 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:11.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:11.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:11.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:12.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0482002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:13.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0483002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:13.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:13.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:13.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:06:13.014 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:13.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0484002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:13.021 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:13.021 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:13.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:13.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:13.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:14.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:14.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:15.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:15.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:15.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:16.159 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 12:06:16.160 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:06:16.161 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 12:06:16.161 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429e7a0) pid(18586/18586) version 11:1:1:4 [ CSSD]2013-05-23 12:06:16.176 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e7a0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:06:16.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:06:16.176 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:06:16.176 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:06:16.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:06:16.194 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:06:16.194 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:06:16.194 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:06:16.195 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 12:06:16.195 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b42d9340) skgpid 18586 ospid 18586 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:17.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:17.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:17.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:19.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 12:06:19.429 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:06:19.429 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:06:19.429 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:06:19.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 12:06:19.432 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:06:19.432 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:06:19.433 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:06:19.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:06:19.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid 13206 ospid 13206 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:19.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:19.571 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:06:19.572 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:06:19.573 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:06:19.573 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a5440) pid(18631) version 11:1:1:4 [ CSSD]2013-05-23 12:06:19.578 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:06:19.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:06:19.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:06:19.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:19.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:06:19.579 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:06:19.579 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:19.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:06:19.585 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:06:19.585 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:19.586 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:06:19.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:19.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:19.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:06:19.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9340) skgpid ospid 18631 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:19.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:19.886 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:19.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:21.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:21.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:21.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:22.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0485002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:23.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:23.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:23.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:24.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:24.889 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:25.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:25.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:25.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:25.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0486002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:25.904 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:25.904 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:25.904 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:06:25.904 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:25.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0487002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:25.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:25.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:27.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:27.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:27.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:29.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:29.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:29.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:29.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:29.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:29.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:31.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:31.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:31.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:32.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0488002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:33.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:33.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:33.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:34.832 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:06:34.833 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:06:34.834 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:06:34.834 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42a5440) pid(18775) version 11:1:1:4 [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:06:34.850 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:34.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:06:34.858 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:06:34.858 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:34.858 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:06:34.895 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:34.895 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:35.061 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:06:35.061 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a19b0) skgpid ospid 18775 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:35.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:35.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:35.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:37.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:37.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:37.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:39.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:39.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:39.898 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:39.949 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:40.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:40.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:41.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0489002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:41.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:41.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:41.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:06:41.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:41.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048a002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:41.162 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:41.162 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:41.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:42.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:42.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:42.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048b002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:43.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:44.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:44.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:44.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:44.901 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:45.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:46.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:46.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:47.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:48.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:48.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:49.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:49.904 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:49.904 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:49.970 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:06:50.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:50.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:50.104 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:06:50.105 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:06:50.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:06:50.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42a5440) pid(18923) version 11:1:1:4 [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:06:50.111 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:50.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:06:50.119 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:06:50.119 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:06:50.119 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:06:50.321 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:06:50.321 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a19b0) skgpid ospid 18923 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:06:51.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:52.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:52.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:52.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048c002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:53.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:53.907 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:53.907 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:06:54.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:54.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:55.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:56.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:56.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:56.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048d002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:56.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:56.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:56.403 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:06:56.403 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:06:56.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048e002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:56.411 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:56.411 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:57.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:58.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:06:58.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:06:58.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:06:58.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:06:59.227 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:59.228 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:59.229 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:59.230 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:06:59.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048f002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:59.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:06:59.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:06:59.309 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:06:59.309 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:06:59.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0490002a) incarnation(174631051) [ CSSD]2013-05-23 12:06:59.316 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:06:59.316 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:06:59.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:06:59.994 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:00.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:00.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:01.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:02.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:02.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:02.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0491002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:03.274 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:07:03.275 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:07:03.276 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:07:03.276 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42a5440) pid(19070) version 11:1:1:4 [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:03.282 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:03.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:07:03.289 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:03.289 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:03.289 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:03.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:07:03.492 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a19b0) skgpid ospid 19070 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:03.913 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:03.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:03.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:04.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:04.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:05.361 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:07:05.363 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:07:05.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:07:05.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(19097) version 11:1:1:4 [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:05.369 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:05.377 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:05.377 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:05.377 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:05.377 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:05.580 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:07:05.580 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 19097 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:05.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:06.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:06.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:07.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:08.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:08.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:08.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:08.917 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:09.223 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:07:09.224 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:07:09.224 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:07:09.224 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42a5440) pid(19171) version 11:1:1:4 [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:09.231 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:09.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:09.238 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:09.238 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbd00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:09.239 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbd00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:09.441 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:07:09.441 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a19b0) skgpid ospid 19171 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:09.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:10.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:10.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:10.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:11.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0492002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:11.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:07:11.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:07:11.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:07:11.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:11.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0493002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:11.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:07:11.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:07:12.025 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:07:12.025 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:07:12.026 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:07:12.026 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a5440) pid(19228) version 11:1:1:4 [ CSSD]2013-05-23 12:07:12.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:12.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:12.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:12.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0494002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:12.919 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:12.919 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:07:13.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0495002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:13.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:07:13.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:07:13.267 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:07:13.267 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:13.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0496002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:13.274 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:07:13.274 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:07:14.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:14.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:14.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:14.612 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:07:14.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9340) skgpid ospid 19228 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:16.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:16.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:16.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:16.581 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:07:16.582 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:07:16.582 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:07:16.582 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42a5440) pid(18676/18676) version 11:1:1:4 [ CSSD]2013-05-23 12:07:16.598 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:07:16.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:07:16.598 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:07:16.598 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:07:17.922 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:17.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:18.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:18.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:18.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:20.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:20.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:20.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:20.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:20.615 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:07:20.615 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:07:20.616 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:07:20.616 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c92b0) pid(19587) version 11:1:1:4 [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c92b0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d82d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:20.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:20.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:07:20.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:20.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:20.630 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:20.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:07:20.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42d9340) skgpid ospid 19587 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:22.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:22.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0497002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:22.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:22.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:22.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:22.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:24.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:24.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:24.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:26.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:26.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:26.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:26.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0498002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:26.925 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:07:26.925 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:07:26.925 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:07:26.925 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:26.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0499002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:26.933 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:07:26.933 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:07:27.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:27.929 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:28.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:28.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:28.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:30.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:30.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:30.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:30.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:32.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:32.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049a002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:32.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:32.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:32.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:07:32.776 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:07:32.777 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:07:32.777 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c92b0) pid(19716) version 11:1:1:4 [ CSSD]2013-05-23 12:07:32.783 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c92b0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:32.783 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:32.783 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 12:07:32.783 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:32.783 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d82d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:32.784 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:32.784 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:32.790 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:07:32.790 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:32.790 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:32.791 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:32.931 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:32.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:32.993 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:07:32.993 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42d9340) skgpid ospid 19716 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:34.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:34.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:34.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:35.866 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 12:07:35.867 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:07:35.867 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 12:07:35.867 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c92b0) pid(19747) version 11:1:1:4 [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c92b0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d82d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:35.874 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:35.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:07:35.881 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:35.881 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:35.881 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:36.083 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 12:07:36.083 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42d9340) skgpid ospid 19747 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:36.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:36.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:36.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:36.666 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 12:07:36.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:07:36.666 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:07:36.666 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:07:37.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:37.935 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:38.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:38.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:38.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:40.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:40.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:40.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:40.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:42.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049b002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:42.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:07:42.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:07:42.175 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:07:42.175 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:42.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049c002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:42.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:07:42.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:07:42.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:42.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049d002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:42.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:42.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:42.938 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:42.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:44.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:44.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:44.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:46.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:46.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:46.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:47.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:47.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:48.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:48.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:48.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:50.100 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:07:50.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:50.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:50.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:51.117 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 12:07:51.118 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:07:51.118 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 12:07:51.118 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204620) proc(0x7f82b429e400) pid(19913) version 11:1:1:4 [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e400), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:07:51.125 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:51.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:07:51.132 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:07:51.132 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:07:51.132 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:07:51.334 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 12:07:51.334 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b4204620) skgpid ospid 19913 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:07:52.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049e002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:52.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:52.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:52.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:52.944 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:52.944 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:07:54.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:54.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:54.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:56.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:56.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:56.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:07:56.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:07:56.947 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:07:57.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049f002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:57.435 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:07:57.435 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:07:57.435 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:07:57.435 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:07:57.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a0002a) incarnation(174631051) [ CSSD]2013-05-23 12:07:57.443 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:07:57.443 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:07:58.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:07:58.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:07:58.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:00.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:00.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:00.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:00.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:01.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:01.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:02.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a1002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:02.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:02.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:02.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:04.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:04.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:04.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:06.367 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 12:08:06.368 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:08:06.369 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 12:08:06.369 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d46b0) proc(0x7f82b429e400) pid(20081) version 11:1:1:4 [ CSSD]2013-05-23 12:08:06.374 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e400), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:08:06.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:08:06.374 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 12:08:06.375 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:06.375 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:08:06.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:06.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:06.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:08:06.381 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:08:06.381 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:06.381 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:06.584 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 12:08:06.584 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42d46b0) skgpid ospid 20081 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:06.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:06.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:06.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:06.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:06.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:08.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:08.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:08.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:09.476 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 12:08:09.477 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:09.478 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 12:08:09.478 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c92d0) proc(0x7f82b42d8e90) pid(20144) version 11:1:1:4 [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8e90), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b429ef50, requested num -1 [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:09.484 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:09.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:08:09.491 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:08:09.491 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429edd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:09.491 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429edd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:09.693 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 12:08:09.693 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42c92d0) skgpid ospid 20144 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:10.140 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:10.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:10.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:10.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:11.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:11.956 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:12.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a2002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:12.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:12.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:12.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:12.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a3002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:12.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:08:12.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:08:12.706 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:08:12.706 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:12.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a4002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:12.713 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:08:12.713 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:08:13.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a5002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:13.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:08:13.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:08:13.525 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:08:13.525 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:13.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a6002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:13.533 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:08:13.533 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:08:14.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:14.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:14.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:15.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:15.958 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:08:16.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:16.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:16.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:18.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:18.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:18.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:20.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:20.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:20.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:20.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:20.961 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:20.961 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:21.627 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 12:08:21.628 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:08:21.628 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 12:08:21.628 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d46b0) proc(0x7f82b429e400) pid(20233) version 11:1:1:4 [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e400), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:21.634 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:21.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:21.641 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:08:21.641 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:21.641 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:21.843 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 12:08:21.843 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42d46b0) skgpid ospid 20233 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:22.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a7002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:22.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:22.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:22.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:22.796 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 12:08:22.797 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:22.797 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 12:08:22.797 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c92d0) proc(0x7f82b42d8e90) pid(20283) version 11:1:1:4 [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8e90), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4207ce0 with con 0x7f82b429ef50, requested num -1 [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:22.805 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:22.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:22.811 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:08:22.811 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429edd0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:08:22.811 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b429edd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:22.919 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4203130) allocated [ CSSD]2013-05-23 12:08:22.920 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:22.921 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4203130 - 1,2,3 [ CSSD]2013-05-23 12:08:22.921 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e880) proc(0x7f82b4203130) pid(20288) version 11:1:1:4 [ CSSD]2013-05-23 12:08:22.936 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:08:22.938 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:08:22.940 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:08:22.941 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4203130 [ CSSD]2013-05-23 12:08:22.941 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4203130) con(0x7f82b429e880) skgpid ospid 20288 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:23.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 12:08:23.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42c92d0) skgpid ospid 20283 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:24.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:24.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:24.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:25.964 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:25.964 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:26.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:26.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:26.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:27.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a8002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:27.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:08:27.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:08:27.969 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:08:27.969 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:27.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a9002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:27.977 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:08:27.977 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:08:28.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:28.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:28.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:30.184 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:30.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:30.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:30.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:30.967 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:30.967 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:32.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04aa002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:32.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:32.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:32.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:34.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:34.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:34.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:35.970 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:35.970 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:36.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:36.877 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 12:08:36.878 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:08:36.879 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 12:08:36.879 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c92d0) proc(0x7f82b42d8e90) pid(20387) version 11:1:1:4 [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8e90), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b429ef50, requested num -1 [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:36.885 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:36.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:08:36.891 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:08:36.891 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429edd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:36.891 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429edd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:36.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:36.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:37.093 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 12:08:37.093 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42c92d0) skgpid ospid 20387 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:38.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:38.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:38.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:40.206 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:40.353 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 12:08:40.353 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:40.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 12:08:40.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c91e0) proc(0x7f82b429e6d0) pid(20463/20463) version 11:1:1:4 [ CSSD]2013-05-23 12:08:40.370 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429e6d0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:40.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:40.370 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:08:40.370 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 12:08:40.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42c91e0) skgpid 20463 ospid 20463 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:40.534 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 12:08:40.535 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:40.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 12:08:40.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e8f0) proc(0x7f82b42c7c00) pid(20507/20507) version 11:1:1:4 [ CSSD]2013-05-23 12:08:40.540 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:08:40.540 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:08:40.540 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:08:40.540 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:08:40.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 12:08:40.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:08:40.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 12:08:40.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b41fe180) pid(20479) version 11:1:1:4 [ CSSD]2013-05-23 12:08:40.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:40.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:40.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:40.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:40.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:41.331 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 12:08:41.331 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42bad40) skgpid ospid 20479 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:42.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ab002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:42.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:42.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:42.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:43.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ac002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:43.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:08:43.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:08:43.237 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:08:43.237 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:43.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ad002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:43.244 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:08:43.244 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:08:44.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:45.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:45.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:45.977 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:45.977 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:46.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:47.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:47.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:48.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:49.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:49.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:49.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:08:49.545 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:08:49.545 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:08:49.545 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:08:49.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:08:49.548 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:08:49.548 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:08:49.548 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf570 [ CSSD]2013-05-23 12:08:49.549 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf570) con(0x7f82b427c5d0) skgpid 14995 ospid 14995 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 12:08:49.559 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b4257120) skgpid 14997 ospid 14997 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:50.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:08:50.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:50.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:50.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:51.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:51.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:52.127 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:08:52.128 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:08:52.128 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:08:52.128 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(20712) version 11:1:1:4 [ CSSD]2013-05-23 12:08:52.134 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:52.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:52.134 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 12:08:52.134 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:52.134 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:08:52.135 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:08:52.135 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:52.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:08:52.141 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:08:52.141 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:08:52.141 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:08:52.344 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:08:52.344 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid ospid 20712 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:08:52.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ae002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:52.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:53.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:53.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:54.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:55.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:55.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:55.982 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:08:55.982 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:08:57.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:57.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:57.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:08:58.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04af002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:58.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:08:58.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:08:58.488 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:08:58.488 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:08:58.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b0002a) incarnation(174631051) [ CSSD]2013-05-23 12:08:58.495 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:08:58.495 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:08:59.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:08:59.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:08:59.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:00.260 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:00.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:00.985 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:01.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:01.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:01.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:02.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b1002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:03.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:03.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:03.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:05.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:05.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:05.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:05.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:05.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:07.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:07.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:07.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:07.377 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:07.377 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:09:07.378 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:07.378 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(20873) version 11:1:1:4 [ CSSD]2013-05-23 12:09:07.384 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:09:07.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:09:07.384 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 12:09:07.384 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:07.384 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:09:07.385 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:07.385 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:07.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:09:07.391 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:09:07.391 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a5140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:07.391 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a5140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:07.593 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:07.594 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid ospid 20873 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:09.098 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:09.099 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:09:09.100 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:09.100 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(20932) version 11:1:1:4 [ CSSD]2013-05-23 12:09:09.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:09.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:09.219 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 12:09:09.220 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:09:09.221 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 12:09:09.221 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b427c510) pid(20942) version 11:1:1:4 [ CSSD]2013-05-23 12:09:09.237 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:09:09.239 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:09:09.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 12:09:09.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42a29f0) skgpid ospid 20942 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:09.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5294/0x7f82b42adc50) [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5294 (0x7f82b42adc50) [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42adc50 with con 0x7f82b4207270, requested num -1 [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d83a0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:09.321 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:09:09.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5294 (0x7f82b42adc50) [ CSSD]2013-05-23 12:09:09.327 [1199044928] >TRACE: clssgmExitGrock: client 5294 (0x7f82b42adc50), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:09:09.327 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:09:09.327 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:09.328 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:09.328 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid ospid 20932 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:09.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:09.743 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:09:09.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:09.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(20958) version 11:1:1:4 [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:09.750 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:09.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:09:09.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:09:09.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:09.758 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:09.960 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:09.960 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid ospid 20958 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:10.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:10.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:10.991 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:11.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:11.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:11.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:12.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b2002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:13.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:13.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b3002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:09:13.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:09:13.737 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:09:13.737 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:13.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b4002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.745 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:09:13.745 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:09:13.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b5002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:09:13.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:09:13.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:09:13.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:13.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b6002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:13.792 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:09:13.792 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:09:15.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:15.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:15.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:15.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:15.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:17.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:17.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:17.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:19.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:19.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:19.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:20.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:20.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:20.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:21.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:21.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:21.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:22.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b7002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:22.633 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:22.634 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:09:22.635 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:22.635 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c8340) pid(21078) version 11:1:1:4 [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:22.641 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:22.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:09:22.647 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:09:22.647 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:22.647 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:22.850 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:22.850 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b42a29f0) skgpid ospid 21078 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:23.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:23.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:23.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:25.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:25.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:25.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:25.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:25.999 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:27.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:27.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:27.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:28.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b8002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:28.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:09:28.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:09:28.994 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:09:28.994 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:29.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b9002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:29.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:09:29.001 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:09:29.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:29.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:29.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:30.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:31.001 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:31.001 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:31.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:31.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:31.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:32.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ba002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:33.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:33.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:33.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:35.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:35.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:35.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:36.004 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:36.004 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:37.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:37.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:37.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:37.883 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:37.884 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:09:37.885 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:37.885 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c8340) pid(21213) version 11:1:1:4 [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e170, requested num -1 [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:37.891 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:37.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:09:37.899 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:09:37.899 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a5140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:37.899 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a5140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:38.102 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:38.102 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b42a29f0) skgpid ospid 21213 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:39.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:39.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:39.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:40.361 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:41.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:41.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:41.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:41.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:41.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:42.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bb002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:43.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:43.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:43.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:44.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04bc002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:44.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:09:44.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:09:44.243 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:09:44.243 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:44.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04bd002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:44.251 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:09:44.251 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:09:45.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:45.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:45.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:46.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:46.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:47.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:47.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:47.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:49.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:49.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:49.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:50.394 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:09:51.011 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:51.011 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:09:51.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:51.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:51.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:52.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04be002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:53.135 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:09:53.136 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:09:53.137 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:09:53.137 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c8340) pid(21366) version 11:1:1:4 [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:09:53.143 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:53.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:09:53.150 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:09:53.150 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:09:53.150 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:09:53.352 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:09:53.352 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b42a29f0) skgpid ospid 21366 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:09:53.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:53.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:53.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:55.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:09:55.013 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:09:55.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:55.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:55.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:57.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:57.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:57.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:09:59.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04bf002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:59.493 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:09:59.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:09:59.494 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:09:59.494 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:09:59.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c0002a) incarnation(174631051) [ CSSD]2013-05-23 12:09:59.501 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:09:59.502 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:09:59.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:09:59.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:09:59.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:00.016 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:00.017 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:00.425 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:01.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:01.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:01.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:02.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c1002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:03.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:03.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:03.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:04.563 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:10:04.564 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:10:04.564 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:10:04.564 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c8340) pid(21691/21691) version 11:1:1:4 [ CSSD]2013-05-23 12:10:04.580 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:10:04.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:10:04.580 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:10:04.580 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:10:04.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:10:04.858 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:10:04.858 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:10:04.858 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:10:04.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:10:04.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b42a29f0) skgpid 21691 ospid 21691 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:05.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:05.020 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:05.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:05.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:05.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:07.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:07.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:07.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:08.386 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:10:08.387 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:10:08.387 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:10:08.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c8340) pid(21721) version 11:1:1:4 [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:10:08.394 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:08.401 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:10:08.401 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:10:08.401 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a5140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:08.401 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a5140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:10:08.603 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:10:08.603 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b42a29f0) skgpid ospid 21721 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:09.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:09.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:09.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:09.996 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:10:09.997 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:10:09.997 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:10:09.997 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(21774) version 11:1:1:4 [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:10:10.003 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:10.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:10:10.010 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:10:10.010 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a5140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:10.010 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a5140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:10:10.022 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:10.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:10.212 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:10:10.212 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid ospid 21774 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:10.449 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:11.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:11.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:11.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:12.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c2002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:13.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:13.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:13.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:14.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c3002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:14.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:10:14.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:10:14.044 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:10:14.044 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:14.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c4002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:14.050 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:10:14.050 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:10:14.399 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8340) allocated [ CSSD]2013-05-23 12:10:14.400 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:10:14.401 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8340 - 1,2,3 [ CSSD]2013-05-23 12:10:14.401 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c8340) pid(20693/20693) version 11:1:1:4 [ CSSD]2013-05-23 12:10:14.417 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8340), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:10:14.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:10:14.417 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:10:14.417 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:10:14.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c5002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:14.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:10:14.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:10:14.756 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:10:14.756 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:14.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c6002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:14.762 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:10:14.762 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:10:14.830 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cd060) skgpid 16208 ospid 16208 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:14.836 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:10:14.836 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:10:14.836 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:10:14.836 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:10:14.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:10:14.842 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:10:14.842 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:10:14.843 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:10:14.843 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:10:14.843 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid 16210 ospid 16210 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:15.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:15.025 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:15.133 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5140) allocated [ CSSD]2013-05-23 12:10:15.134 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:10:15.135 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5140 - 1,2,3 [ CSSD]2013-05-23 12:10:15.135 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42a5140) pid(21817/21817) version 11:1:1:4 [ CSSD]2013-05-23 12:10:15.141 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5140), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:10:15.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:10:15.141 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:10:15.141 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:10:15.145 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5140), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 12:10:15.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:10:15.145 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:10:15.145 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:10:15.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:15.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:15.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:17.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:17.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:17.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:19.027 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:19.028 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:10:19.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:19.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:19.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:20.474 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:21.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:21.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:22.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:22.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c7002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:23.648 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 12:10:23.649 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:10:23.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 12:10:23.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42c5f40) pid(21884) version 11:1:1:4 [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:10:23.655 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:23.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:10:23.662 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:10:23.662 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:23.662 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:10:23.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:23.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:23.864 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 12:10:23.864 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9290) skgpid ospid 21884 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:24.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:24.030 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:24.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:25.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:25.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:26.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:27.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:27.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:28.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:29.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:29.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:29.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:29.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:30.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c8002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:30.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:10:30.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:10:30.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:10:30.015 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:30.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c9002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:30.021 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:10:30.021 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:10:30.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:30.502 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:31.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:31.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:32.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:32.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ca002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:33.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:33.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:34.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:34.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:34.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:35.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:35.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:36.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:37.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:37.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:38.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:38.897 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1a60) allocated [ CSSD]2013-05-23 12:10:38.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:10:38.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1a60 - 1,2,3 [ CSSD]2013-05-23 12:10:38.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42a1a60) pid(22028) version 11:1:1:4 [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1a60), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:10:38.904 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:38.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:10:38.910 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:10:38.910 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:38.911 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:10:39.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:39.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:39.113 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1a60 [ CSSD]2013-05-23 12:10:39.113 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1a60) con(0x7f82b42b35f0) skgpid ospid 22028 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:39.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:39.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:40.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:40.532 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:41.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:41.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:42.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:42.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04cb002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:43.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:43.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:10:43.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:43.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:44.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:45.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04cc002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:45.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:10:45.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:10:45.261 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:10:45.261 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:45.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04cd002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:45.267 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:10:45.267 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:10:45.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:45.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:46.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:47.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:47.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:48.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:48.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:48.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ce002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:48.109 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:10:48.109 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:10:48.109 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:10:48.109 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:48.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04cf002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:48.116 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:10:48.116 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:10:48.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 12:10:49.052 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b429e8f0) skgpid 20507 ospid 20507 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:49.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:49.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:50.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:50.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:10:51.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:51.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:52.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:52.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d0002a) incarnation(174631051) [ CSSD]2013-05-23 12:10:53.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:53.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:53.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:53.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:54.146 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:10:54.147 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:10:54.147 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:10:54.147 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd060) proc(0x7f82b42583a0) pid(22172) version 11:1:1:4 [ CSSD]2013-05-23 12:10:54.153 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:10:54.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:10:54.153 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:10:54.154 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:54.154 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:10:54.154 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:10:54.154 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:10:54.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:10:54.160 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:10:54.160 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c5f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:10:54.160 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c5f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:10:54.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:10:54.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cd060) skgpid ospid 22172 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:10:54.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:55.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:55.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:56.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:10:57.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:10:57.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:10:58.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:10:58.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:10:58.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:00.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:00.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:00.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d1002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:00.512 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:00.512 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:00.512 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:00.512 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:00.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:00.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d2002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:00.517 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:00.517 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:00.580 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:02.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:02.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:02.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d3002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:02.239 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:02.239 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:02.239 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:11:02.239 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:02.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d4002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:02.246 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:02.246 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:02.373 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:02.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:02.375 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:02.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:02.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:02.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d5002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:03.053 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:03.053 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:04.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:04.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:04.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:06.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:06.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:06.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:07.055 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:07.056 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:11:08.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:08.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:08.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:09.397 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 12:11:09.398 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:11:09.399 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 12:11:09.399 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd060) proc(0x7f82b42c5f40) pid(22349) version 11:1:1:4 [ CSSD]2013-05-23 12:11:09.405 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42c5f40), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:11:09.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:11:09.405 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:11:09.405 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:09.405 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:11:09.406 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:11:09.406 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:09.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:11:09.413 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:11:09.413 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:09.413 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:11:09.615 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 12:11:09.615 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42cd060) skgpid ospid 22349 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:10.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:10.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:10.252 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:11:10.253 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:11:10.253 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:11:10.253 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd060) proc(0x7f82b42ae300) pid(22390) version 11:1:1:4 [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ae300), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:11:10.260 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:10.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:11:10.266 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:11:10.266 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:10.266 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:11:10.469 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:11:10.469 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42cd060) skgpid ospid 22390 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:10.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:10.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:11.130 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 12:11:11.131 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:11:11.131 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 12:11:11.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd060) proc(0x7f82b42a3ea0) pid(21810/21810) version 11:1:1:4 [ CSSD]2013-05-23 12:11:11.146 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a3ea0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:11:11.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:11:11.146 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:11:11.146 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:11:12.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:12.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:12.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:12.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:12.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:12.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d6002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:14.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:14.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:14.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d7002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:14.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:14.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:14.296 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:14.296 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:14.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d8002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:14.304 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:14.304 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:14.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:15.563 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd840) allocated [ CSSD]2013-05-23 12:11:15.564 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:11:15.564 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd840 - 1,2,3 [ CSSD]2013-05-23 12:11:15.564 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b42cd840) pid(22440/22440) version 11:1:1:4 [ CSSD]2013-05-23 12:11:15.570 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cd840), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:11:15.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:11:15.570 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:11:15.570 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd840 [ CSSD]2013-05-23 12:11:15.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd840) con(0x7f82b42a1690) skgpid 22440 ospid 22440 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:15.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d9002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:15.766 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:15.766 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:15.766 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:15.766 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:15.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04da002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:15.773 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:15.773 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:16.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:16.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:16.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:17.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:17.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:18.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:18.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:18.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:19.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 12:11:19.564 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4286810), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:11:19.564 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4286810), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:11:19.564 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:11:19.569 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42ccc30) skgpid 17091 ospid 17091 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:20.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:20.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:20.629 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:20.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:22.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:22.064 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:22.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:22.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:22.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:22.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04db002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:24.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:24.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:24.653 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:11:24.654 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:11:24.655 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:11:24.655 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(22507) version 11:1:1:4 [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:11:24.661 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:24.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:11:24.667 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:11:24.667 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:24.667 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:11:24.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:24.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:11:24.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid ospid 22507 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:26.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:26.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:26.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:27.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:27.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:28.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:28.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:28.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:30.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:30.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:30.658 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:30.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:31.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04dc002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:31.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:31.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:31.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:31.014 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:31.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04dd002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:31.020 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:31.020 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:32.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:32.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:32.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:32.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:32.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:32.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04de002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:34.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:34.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:34.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:36.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:36.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:36.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:37.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:37.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:38.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:38.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:38.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:39.906 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 12:11:39.907 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:11:39.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 12:11:39.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b429dac0) pid(22649) version 11:1:1:4 [ CSSD]2013-05-23 12:11:39.913 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429dac0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:11:39.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:11:39.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 12:11:39.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:39.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:11:39.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:11:39.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:39.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:11:39.920 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:11:39.920 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:39.920 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:11:40.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 12:11:40.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42b3350) skgpid ospid 22649 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:40.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:40.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:40.684 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:40.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:42.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:42.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:42.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:42.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:42.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04df002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:42.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:43.248 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:11:43.248 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:11:43.249 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:11:43.249 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(22470/22470) version 11:1:1:4 [ CSSD]2013-05-23 12:11:43.265 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b42b5c30) [ CSSD]2013-05-23 12:11:43.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b5c30) [ CSSD]2013-05-23 12:11:43.265 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:11:43.265 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:11:44.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:44.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:45.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:46.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e0002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:46.260 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:46.260 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:46.260 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:46.260 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:46.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e1002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:46.266 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:46.266 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:46.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:46.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:47.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:47.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:47.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:48.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:48.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:49.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:50.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:50.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:50.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:11:51.028 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:52.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:52.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:52.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:52.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:52.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e2002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:53.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:54.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:54.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:55.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:55.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 12:11:55.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:11:55.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 12:11:55.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e6d0) pid(22793) version 11:1:1:4 [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e6d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:11:55.173 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:55.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:11:55.179 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:11:55.179 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:11:55.179 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:11:55.382 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 12:11:55.382 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42ccc30) skgpid ospid 22793 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:11:56.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:56.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:57.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:11:57.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:11:57.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:58.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e3002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:58.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:58.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:58.076 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:11:58.076 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:11:58.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e4002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:58.084 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:58.084 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:11:58.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:11:58.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:11:59.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:11:59.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:59.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:59.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:59.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:11:59.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e5002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:59.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:11:59.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:11:59.635 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:11:59.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:11:59.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e6002a) incarnation(174631051) [ CSSD]2013-05-23 12:11:59.642 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:11:59.642 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:00.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:00.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:00.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:01.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:01.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e7002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:01.512 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:12:01.512 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:12:01.512 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:12:01.512 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:01.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e8002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:01.518 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:12:01.518 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:02.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:02.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:02.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:02.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:03.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e9002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:03.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:04.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:04.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:05.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:06.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:06.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:07.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:07.093 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:07.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:08.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:08.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:09.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:10.415 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 12:12:10.416 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:12:10.417 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 12:12:10.417 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e6d0) pid(22973) version 11:1:1:4 [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e6d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:12:10.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:10.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:12:10.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:12:10.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:10.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:12:10.505 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 12:12:10.506 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:12:10.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 12:12:10.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e8f0) proc(0x7f82b42b3800) pid(22996) version 11:1:1:4 [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42b3800), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:12:10.513 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:10.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:12:10.520 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:12:10.520 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:10.520 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:12:10.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 12:12:10.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42d9290) skgpid ospid 22973 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:10.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:10.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:10.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 12:12:10.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b429e8f0) skgpid ospid 22996 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:10.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:11.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:11.434 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:12:11.435 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:12:11.435 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:12:11.435 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(23053) version 11:1:1:4 [ CSSD]2013-05-23 12:12:12.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:12.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:12.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:12.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:13.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ea002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:13.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:14.019 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:12:14.019 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 23053 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:14.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04eb002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:14.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:12:14.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:12:14.559 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:12:14.559 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:14.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ec002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:14.565 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:12:14.565 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:14.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:14.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:15.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:16.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:16.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:16.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ed002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:16.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:12:16.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:12:16.756 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:12:16.756 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:16.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ee002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:16.763 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:12:16.763 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:17.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:17.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:17.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:18.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:18.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:19.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:20.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:20.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:20.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:21.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:22.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:22.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:22.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:22.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:23.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ef002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:23.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:24.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:24.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:25.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:25.676 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:12:25.677 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:12:25.678 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:12:25.678 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(23461) version 11:1:1:4 [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:12:25.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:25.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:12:25.691 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:12:25.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:25.691 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:12:25.893 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:12:25.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 23461 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:26.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:26.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:27.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:27.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:27.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:28.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:28.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:29.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:30.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:30.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:30.807 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:31.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:31.107 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:12:31.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:32.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f0002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:32.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:12:32.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:12:32.015 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:12:32.015 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:32.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f1002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:32.022 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:12:32.022 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:32.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:32.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:33.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f2002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:33.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:34.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:34.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:35.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:36.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:36.111 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:36.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:36.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:37.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:38.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:38.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:39.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:40.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:40.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:40.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:40.938 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:12:40.939 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:12:40.939 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:12:40.939 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(23609) version 11:1:1:4 [ CSSD]2013-05-23 12:12:40.945 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:12:40.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:12:40.945 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:12:40.945 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:40.945 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:12:40.946 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:12:40.946 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:40.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:12:40.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:12:40.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:40.952 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:12:41.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:41.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:41.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:12:41.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 23609 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:41.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:42.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:42.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:43.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f3002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:43.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:44.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:44.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:45.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:46.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:46.117 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:46.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:46.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:47.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f4002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:47.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:12:47.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:12:47.275 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:12:47.275 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:47.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f5002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:47.282 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:12:47.282 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:12:47.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:48.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:48.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:49.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:50.854 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:12:50.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:50.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:51.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:51.119 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:12:51.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:52.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:52.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:53.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f6002a) incarnation(174631051) [ CSSD]2013-05-23 12:12:53.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:54.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:54.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:55.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:12:55.122 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:12:55.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:56.181 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:12:56.183 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:12:56.183 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:12:56.183 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(23778) version 11:1:1:4 [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:12:56.189 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:12:56.195 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:12:56.195 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:12:56.195 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:12:56.195 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:12:56.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:12:56.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 23778 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:12:56.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:56.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:57.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:12:58.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:12:58.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:12:59.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:00.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:00.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:00.874 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:01.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:01.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:01.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:02.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f7002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:02.522 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:13:02.522 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:13:02.522 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:13:02.522 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:02.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f8002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:02.529 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:13:02.530 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:13:03.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:03.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:03.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f9002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:03.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:05.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:05.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:05.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:05.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:05.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:07.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:07.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:07.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:09.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:09.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:09.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:10.130 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:10.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:10.772 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:10.773 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:13:10.774 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:10.774 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(23923) version 11:1:1:4 [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:10.781 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:10.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:13:10.788 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:13:10.788 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:10.788 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:10.895 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:10.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:10.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 23923 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:11.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:11.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:11.433 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:11.434 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:13:11.435 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:11.435 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(23940) version 11:1:1:4 [ CSSD]2013-05-23 12:13:11.441 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:11.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:11.441 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:13:11.442 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:11.442 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:13:11.442 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:11.442 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:11.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:11.448 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:13:11.448 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:11.448 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:11.651 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:11.651 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 23940 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:11.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:13.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:13.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:13.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04fa002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:13.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:14.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04fb002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:14.820 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:13:14.820 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:13:14.820 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:13:14.820 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:14.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fc002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:14.827 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:13:14.827 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:13:15.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:15.134 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:15.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:15.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:15.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:17.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:17.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:17.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04fd002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:17.789 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:13:17.789 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:13:17.789 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:13:17.789 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:17.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fe002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:17.796 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:13:17.796 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:13:18.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:19.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:19.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:20.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:20.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:20.137 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:20.915 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:21.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:21.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:22.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:23.088 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:23.089 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:13:23.089 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:23.089 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(24062) version 11:1:1:4 [ CSSD]2013-05-23 12:13:23.096 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:13:23.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:13:23.096 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b00d0 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:13:23.096 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:13:23.096 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:13:23.097 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:23.097 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:23.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:13:23.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:13:23.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:13:23.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:23.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:23.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:23.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd950) allocated [ CSSD]2013-05-23 12:13:23.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:13:23.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd950 - 1,2,3 [ CSSD]2013-05-23 12:13:23.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9370) proc(0x7f82b42cd950) pid(24067) version 11:1:1:4 [ CSSD]2013-05-23 12:13:23.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ff002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:23.227 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:13:23.228 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:13:23.230 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:13:23.231 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd950 [ CSSD]2013-05-23 12:13:23.231 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd950) con(0x7f82b42c9370) skgpid ospid 24067 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:23.306 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:23.306 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 24062 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:24.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:25.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:25.139 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:25.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:25.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:26.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:26.688 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:26.689 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:13:26.690 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:26.690 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(24102) version 11:1:1:4 [ CSSD]2013-05-23 12:13:26.695 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:26.696 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:26.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:13:26.702 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:13:26.702 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:26.702 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:26.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:26.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 24102 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:27.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:27.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:28.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:29.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:29.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:30.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:30.142 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:30.142 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:30.945 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:31.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:31.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:32.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:33.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0500002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:33.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:13:33.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:13:33.036 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:13:33.036 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:33.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0501002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:33.042 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:13:33.043 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:13:33.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0502002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:33.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:33.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:34.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:35.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:35.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:35.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:35.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:36.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:37.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:37.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:38.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:39.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:39.147 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:13:39.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:39.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:40.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:40.965 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:41.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:41.229 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:13:41.229 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:41.229 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(24258) version 11:1:1:4 [ CSSD]2013-05-23 12:13:41.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:41.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:41.838 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:41.838 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 24258 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:41.938 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:13:41.939 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:13:41.939 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:13:41.939 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e550) proc(0x7f82b42c7b30) pid(24365) version 11:1:1:4 [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:41.946 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:41.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:13:41.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:13:41.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:41.952 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:42.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:13:42.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b429e550) skgpid ospid 24365 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:42.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:43.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0503002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:43.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:43.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:44.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:44.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:44.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:45.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:45.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:46.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:47.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:47.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:48.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:48.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0504002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:48.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:13:48.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:13:48.281 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:13:48.281 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:48.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0505002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:48.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:13:48.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:13:49.154 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:49.154 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:49.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:49.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:50.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:51.305 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:13:51.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:51.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:52.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:53.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0506002a) incarnation(174631051) [ CSSD]2013-05-23 12:13:53.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:53.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:54.157 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:54.157 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:13:54.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:55.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:55.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:56.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:57.198 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:13:57.199 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:13:57.199 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:13:57.199 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(24572) version 11:1:1:4 [ CSSD]2013-05-23 12:13:57.205 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:13:57.206 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:13:57.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:13:57.213 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:13:57.213 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:13:57.213 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:13:57.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:13:57.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 24572 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:13:57.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:57.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:13:58.159 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:13:58.160 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:13:58.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:13:59.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:13:59.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:00.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:01.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:01.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:01.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:02.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:03.163 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:03.163 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:03.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0507002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:03.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:03.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:03.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0508002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:03.529 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:14:03.529 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:14:03.529 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:14:03.529 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:03.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0509002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:03.535 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:14:03.535 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:14:04.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:05.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:05.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:06.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:07.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:07.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:08.165 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:08.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:08.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:09.409 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:14:09.410 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:14:09.411 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:14:09.411 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(24717) version 11:1:1:4 [ CSSD]2013-05-23 12:14:09.529 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd950) allocated [ CSSD]2013-05-23 12:14:09.530 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:14:09.531 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd950 - 1,2,3 [ CSSD]2013-05-23 12:14:09.531 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9370) proc(0x7f82b42cd950) pid(24727) version 11:1:1:4 [ CSSD]2013-05-23 12:14:09.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:14:09.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:14:09.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd950 [ CSSD]2013-05-23 12:14:09.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd950) con(0x7f82b42c9370) skgpid ospid 24727 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:09.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:09.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5295/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5295 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b429e550, requested num -1 [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:09.631 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:14:09.637 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5295 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:09.637 [1199044928] >TRACE: clssgmExitGrock: client 5295 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:14:09.637 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:14:09.637 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:09.638 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:14:09.638 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 24717 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:10.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:11.040 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:14:11.041 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:14:11.042 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:14:11.042 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c7b30) pid(24753) version 11:1:1:4 [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42a4fb0, requested num -1 [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:11.048 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:11.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:14:11.055 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:14:11.055 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:11.055 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:11.257 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:14:11.257 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42ccc30) skgpid ospid 24753 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:11.356 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:11.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:11.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:12.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:12.451 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:14:12.452 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:14:12.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:14:12.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(24770) version 11:1:1:4 [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4286810) [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:12.469 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:12.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:14:12.477 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:14:12.477 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:12.477 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:12.679 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:14:12.679 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 24770 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:13.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:13.168 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:13.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050a002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:13.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:13.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:14.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:15.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050b002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:15.077 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:14:15.077 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:14:15.077 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:14:15.077 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:15.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050c002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:15.085 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:14:15.085 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:14:15.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:15.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:16.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:17.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:17.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:18.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:18.171 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:18.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:18.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050d002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:18.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:14:18.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:14:18.776 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:14:18.776 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:18.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050e002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:18.784 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:14:18.784 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:14:19.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:19.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:20.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:21.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:21.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:21.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:22.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:22.174 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:14:22.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:23.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050f002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:23.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:23.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:24.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:25.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:25.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:26.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:27.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:27.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:27.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:27.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:27.723 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:14:27.724 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:14:27.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:14:27.725 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(24912) version 11:1:1:4 [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:27.742 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:27.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:14:27.750 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:14:27.750 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:27.750 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:27.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:14:27.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 24912 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:28.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:29.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:29.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:30.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:31.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:31.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:31.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:32.180 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:32.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:32.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:33.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0510002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:33.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:33.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:34.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0511002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:34.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:14:34.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:14:34.025 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:14:34.025 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:34.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0512002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:34.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:14:34.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:14:34.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:35.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:35.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:36.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:37.183 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:37.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:37.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:37.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:38.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:39.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:39.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:40.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:41.417 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:41.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:41.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:42.186 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:42.187 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:42.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:42.996 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:14:42.997 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:14:42.998 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:14:42.998 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(25060) version 11:1:1:4 [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:43.004 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:43.011 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:14:43.011 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:14:43.011 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:43.011 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:43.214 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:14:43.214 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 25060 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:43.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0513002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:43.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:43.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:44.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:45.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:45.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:46.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:47.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:47.189 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:47.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:47.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:48.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:49.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0514002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:49.287 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:14:49.287 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:14:49.287 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:14:49.287 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:49.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0515002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:49.293 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:14:49.293 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:14:50.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:50.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:50.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:51.447 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:14:52.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:52.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:52.192 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:52.193 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:52.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:53.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0516002a) incarnation(174631051) [ CSSD]2013-05-23 12:14:54.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:54.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:54.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:56.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:56.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:56.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:14:57.196 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:14:57.196 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:14:58.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:14:58.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:14:58.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:14:58.258 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:14:58.259 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:14:58.259 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(25200) version 11:1:1:4 [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:14:58.266 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:14:58.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:14:58.273 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:14:58.273 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:14:58.273 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:14:58.476 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:14:58.476 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 25200 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:14:58.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:00.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:00.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:00.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:01.467 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:02.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:02.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:02.199 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:02.199 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:02.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:03.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0517002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:04.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:04.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:04.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0518002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:04.534 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:15:04.534 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:15:04.534 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:15:04.534 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:04.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0519002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:04.541 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:15:04.541 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:15:04.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:05.082 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:05.082 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:15:05.083 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:05.083 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(25311/25311) version 11:1:1:4 [ CSSD]2013-05-23 12:15:05.088 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:15:05.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:15:05.088 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:15:05.088 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:15:05.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid 25311 ospid 25311 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:15:06.202 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:06.202 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:15:06.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:06.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:07.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:08.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:08.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:09.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:10.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:10.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:11.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:11.205 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:11.205 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:11.299 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:11.301 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:15:11.301 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:11.301 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(25360) version 11:1:1:4 [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4286810) [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:15:11.308 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:11.315 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:15:11.315 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:15:11.315 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:11.315 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:15:11.498 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:11.518 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:15:11.518 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 25360 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:15:12.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:12.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:13.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:13.501 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:13.506 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:15:13.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:13.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(25386) version 11:1:1:4 [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:15:13.513 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:13.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:15:13.521 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:15:13.521 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:13.521 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:15:13.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051a002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:13.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:15:13.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 25386 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:15:14.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:14.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:15.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:15.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051b002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:15.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:15:15.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:15:15.333 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:15:15.333 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:15.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051c002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:15.340 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:15:15.341 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:15:16.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:16.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:16.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:16.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:17.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:18.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:18.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:19.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:19.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051d002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:19.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:15:19.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:15:19.783 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:15:19.783 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:19.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051e002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:19.791 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:15:19.791 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:15:20.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:20.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:21.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:21.212 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:21.212 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:21.518 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:22.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:22.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:23.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:23.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051f002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:24.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:24.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:25.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:25.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:25.215 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:15:26.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:26.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:27.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:28.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:28.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:28.756 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:28.757 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:15:28.758 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:28.758 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b429e330) pid(25552) version 11:1:1:4 [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:15:28.764 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:28.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:15:28.771 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:15:28.771 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:28.772 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:15:28.974 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:15:28.974 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42d9290) skgpid ospid 25552 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:15:29.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:30.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:30.218 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:30.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:30.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:31.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:31.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:32.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:32.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:33.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:33.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0520002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:34.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:34.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:35.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0521002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:35.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:15:35.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:15:35.041 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:15:35.041 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:35.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0522002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:35.048 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:15:35.048 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:15:35.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:35.221 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:35.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:36.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:36.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:37.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:38.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:38.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:39.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:40.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:40.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:40.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:40.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:41.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:41.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:42.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:42.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:43.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:43.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0523002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:44.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:44.009 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:15:44.010 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:44.010 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(25698) version 11:1:1:4 [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:15:44.016 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:44.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:15:44.023 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:15:44.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:44.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:15:44.226 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:15:44.226 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid ospid 25698 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:15:44.226 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:44.226 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:15:44.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:44.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:45.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:46.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:46.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:47.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:15:47.313 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:15:47.314 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:15:47.314 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e330) pid(25448/25448) version 11:1:1:4 [ CSSD]2013-05-23 12:15:47.330 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 12:15:47.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:15:47.330 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:15:47.330 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:15:47.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:48.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:48.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:49.229 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:49.229 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:49.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:50.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0524002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:50.292 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:15:50.292 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:15:50.292 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:15:50.292 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:50.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0525002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:50.299 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:15:50.299 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:15:50.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:50.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:51.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:51.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:15:52.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:52.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:53.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:53.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0526002a) incarnation(174631051) [ CSSD]2013-05-23 12:15:54.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:54.232 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:54.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:54.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:55.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:56.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:56.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:57.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:58.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:15:58.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:15:59.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:15:59.236 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:15:59.259 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5250) allocated [ CSSD]2013-05-23 12:15:59.260 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:15:59.261 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5250 - 1,2,3 [ CSSD]2013-05-23 12:15:59.261 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e880) proc(0x7f82b42d5250) pid(25851) version 11:1:1:4 [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d5250), client(1/0x7f82b4286810) [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ea70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:15:59.267 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:15:59.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 12:15:59.273 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:15:59.273 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:15:59.273 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:15:59.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:15:59.476 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5250 [ CSSD]2013-05-23 12:15:59.476 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5250) con(0x7f82b429e880) skgpid ospid 25851 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:00.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:00.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:01.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:01.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:02.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0527002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:02.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:02.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:02.533 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:16:02.533 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:02.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0528002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:02.540 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:02.540 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:02.670 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:02.670 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:02.672 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:02.672 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:02.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:02.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:03.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:03.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0529002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:04.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:04.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:04.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:04.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:05.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:05.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052a002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:05.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:05.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:05.541 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:16:05.541 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:05.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052b002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:05.547 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:05.547 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:06.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:06.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:07.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:08.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:08.241 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:16:08.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:08.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:09.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:09.811 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e330), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 12:16:09.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:16:09.811 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:16:09.811 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:16:10.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:10.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:11.569 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd770) allocated [ CSSD]2013-05-23 12:16:11.569 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:16:11.570 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd770 - 1,2,3 [ CSSD]2013-05-23 12:16:11.570 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9370) proc(0x7f82b42cd770) pid(25983) version 11:1:1:4 [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cd770), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d52d0, requested num -1 [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:16:11.577 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:11.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:16:11.584 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:16:11.584 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:11.584 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:16:11.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:11.639 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:11.786 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd770 [ CSSD]2013-05-23 12:16:11.786 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd770) con(0x7f82b42c9370) skgpid ospid 25983 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:13.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:13.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:13.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:13.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:13.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:13.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052c002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:14.519 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d51e0) allocated [ CSSD]2013-05-23 12:16:14.520 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:16:14.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d51e0 - 1,2,3 [ CSSD]2013-05-23 12:16:14.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9370) proc(0x7f82b42d51e0) pid(26012) version 11:1:1:4 [ CSSD]2013-05-23 12:16:14.526 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d51e0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:16:14.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:16:14.526 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:16:14.526 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:14.526 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:16:14.527 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:16:14.527 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:14.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:16:14.533 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:16:14.533 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d85f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:14.533 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d85f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:16:14.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d51e0 [ CSSD]2013-05-23 12:16:14.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d51e0) con(0x7f82b42c9370) skgpid ospid 26012 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:15.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:15.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:15.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052d002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:15.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:15.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:15.609 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:16:15.609 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:15.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052e002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:15.617 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:15.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:15.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:16.089 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d51e0) allocated [ CSSD]2013-05-23 12:16:16.090 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:16:16.090 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d51e0 - 1,2,3 [ CSSD]2013-05-23 12:16:16.090 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42d51e0) pid(26063/26063) version 11:1:1:4 [ CSSD]2013-05-23 12:16:16.106 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d51e0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:16:16.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:16:16.106 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:16:16.106 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:16:16.122 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:16:16.122 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:16:16.122 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:16:16.122 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:16:16.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d51e0 [ CSSD]2013-05-23 12:16:16.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d51e0) con(0x7f82b42bad40) skgpid 26063 ospid 26063 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:17.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:17.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:17.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:18.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:18.248 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:19.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:19.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8340 [ CSSD]2013-05-23 12:16:19.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8340) con(0x7f82b4257120) skgpid 20693 ospid 20693 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:19.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:20.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052f002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:20.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:20.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:20.798 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:16:20.798 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:20.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0530002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:20.805 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:20.805 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:21.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:21.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:21.660 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:21.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:23.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:23.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:23.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:23.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:23.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:23.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0531002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:25.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:25.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:25.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:27.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:27.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:27.253 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:27.253 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:16:27.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:29.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:29.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:29.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:29.768 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 12:16:29.769 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:16:29.769 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 12:16:29.769 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b4207a80) pid(26177) version 11:1:1:4 [ CSSD]2013-05-23 12:16:29.775 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:16:29.776 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:29.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:16:29.782 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:16:29.782 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:29.782 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:16:29.985 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 12:16:29.985 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a29f0) skgpid ospid 26177 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:31.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:31.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:31.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:31.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:32.256 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:32.256 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:33.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:33.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:33.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0532002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:33.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:35.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:35.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:35.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:36.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0533002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:36.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:36.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:36.050 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:16:36.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:36.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0534002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:36.056 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:36.056 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:37.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:37.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:37.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:37.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:37.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:39.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:39.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:39.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:41.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:41.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:41.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:41.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:42.262 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:42.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:43.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:43.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:43.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0535002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:43.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:45.019 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 12:16:45.020 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:16:45.020 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 12:16:45.020 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b4207a80) pid(26326) version 11:1:1:4 [ CSSD]2013-05-23 12:16:45.026 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:16:45.026 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:16:45.026 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:16:45.026 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:45.026 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:16:45.027 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:16:45.027 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:45.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:16:45.034 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:16:45.034 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:16:45.034 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:16:45.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:45.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:45.236 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 12:16:45.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a29f0) skgpid ospid 26326 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:16:45.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:47.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:47.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:47.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:47.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:47.554 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 12:16:47.555 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:16:47.555 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 12:16:47.555 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b4207a80) pid(26098/26098) version 11:1:1:4 [ CSSD]2013-05-23 12:16:47.560 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:16:47.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:16:47.560 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:16:47.560 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:16:47.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:49.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:49.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:49.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:51.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:51.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:51.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:51.268 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:16:51.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0536002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:51.298 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:51.298 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:51.298 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:16:51.298 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:16:51.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0537002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:51.304 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:51.304 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:51.740 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:16:51.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:53.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:53.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:53.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0538002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:53.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:55.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:55.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:55.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:56.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:16:56.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:16:57.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:57.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:57.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:16:59.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:16:59.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:16:59.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:59.860 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:59.862 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:59.862 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:16:59.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0539002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:59.938 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:16:59.938 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:16:59.938 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:16:59.939 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:16:59.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053a002a) incarnation(174631051) [ CSSD]2013-05-23 12:16:59.945 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:16:59.945 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:16:59.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:00.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 12:17:00.270 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:17:00.271 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 12:17:00.271 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42d3c90) pid(26465) version 11:1:1:4 [ CSSD]2013-05-23 12:17:00.277 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c90), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:17:00.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:17:00.277 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d8430, requested num -1 [ CSSD]2013-05-23 12:17:00.277 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:00.277 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:00.278 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:00.278 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:00.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:17:00.285 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:00.285 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8320) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:00.285 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8320) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:00.488 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 12:17:00.488 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b4286800) skgpid ospid 26465 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:01.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:01.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:01.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:01.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:01.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:01.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:03.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:03.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:03.612 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d51e0) allocated [ CSSD]2013-05-23 12:17:03.613 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:17:03.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d51e0 - 1,2,3 [ CSSD]2013-05-23 12:17:03.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d51e0) pid(26532) version 11:1:1:4 [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d51e0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:03.619 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:03.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:17:03.626 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:03.626 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:03.627 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:03.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053b002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:03.829 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d51e0 [ CSSD]2013-05-23 12:17:03.829 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d51e0) con(0x7f82b4257120) skgpid ospid 26532 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:03.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:05.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:05.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:05.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:06.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:06.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:06.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(053c002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:06.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:17:06.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:17:06.565 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:17:06.565 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:06.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053d002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:06.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:17:06.571 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:17:07.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:07.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:08.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:09.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:09.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:10.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:10.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:10.280 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:17:10.866 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 12:17:10.867 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:17:10.868 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 12:17:10.868 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d3c90) pid(26626) version 11:1:1:4 [ CSSD]2013-05-23 12:17:11.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:11.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:11.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:11.821 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdec0) allocated [ CSSD]2013-05-23 12:17:11.821 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:17:11.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdec0 - 1,2,3 [ CSSD]2013-05-23 12:17:11.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b41fdec0) pid(26770) version 11:1:1:4 [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fdec0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b41fe260, requested num -1 [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4203200/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:11.827 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:11.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:17:11.833 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:11.833 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4203500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:11.833 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4203500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:12.036 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdec0 [ CSSD]2013-05-23 12:17:12.036 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdec0) con(0x7f82b4286800) skgpid ospid 26770 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:12.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:13.277 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 12:17:13.277 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b4257120) skgpid ospid 26626 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:13.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:13.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:13.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053e002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:14.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:15.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:15.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:15.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:15.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:15.519 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d51e0) allocated [ CSSD]2013-05-23 12:17:15.520 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:17:15.521 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d51e0 - 1,2,3 [ CSSD]2013-05-23 12:17:15.521 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42d51e0) pid(27024) version 11:1:1:4 [ CSSD]2013-05-23 12:17:15.527 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d51e0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:17:15.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:17:15.527 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:17:15.527 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:15.527 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:15.528 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:15.528 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:15.534 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:17:15.534 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:15.534 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:15.534 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:15.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d51e0 [ CSSD]2013-05-23 12:17:15.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d51e0) con(0x7f82b4286800) skgpid ospid 27024 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:15.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(053f002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:15.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:17:15.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:17:15.862 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:17:15.862 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:15.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0540002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:15.868 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:17:15.868 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:17:16.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:17.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:17.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:18.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:19.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:19.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:20.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:20.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:20.287 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:21.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:21.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:21.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:21.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0541002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:21.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:17:21.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:17:21.809 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:17:21.809 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:21.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0542002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:21.816 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:17:21.816 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:17:22.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:23.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:23.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:23.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0543002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:24.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:25.290 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:25.290 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:25.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:25.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:26.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:27.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:27.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:28.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:29.292 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:29.292 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:17:29.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:29.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:30.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:30.780 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 12:17:30.781 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:17:30.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 12:17:30.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42d3c90) pid(27195) version 11:1:1:4 [ CSSD]2013-05-23 12:17:30.787 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c90), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:17:30.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:17:30.787 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d8300, requested num -1 [ CSSD]2013-05-23 12:17:30.787 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:30.787 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:30.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:30.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:30.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:17:30.795 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:30.795 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:30.795 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:30.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 12:17:30.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b4286800) skgpid ospid 27195 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:31.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:31.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:31.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:32.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:33.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 12:17:33.121 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:17:33.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 12:17:33.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42d3c90) pid(27257) version 11:1:1:4 [ CSSD]2013-05-23 12:17:33.128 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c90), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d8300, requested num -1 [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:33.129 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:33.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:17:33.137 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:33.137 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:33.137 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:33.339 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 12:17:33.339 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b4286800) skgpid ospid 27257 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:33.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:33.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:33.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0544002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:34.295 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:34.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:34.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:35.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:35.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:36.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:37.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0545002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:37.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:17:37.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:17:37.053 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:17:37.053 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:37.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0546002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:37.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:17:37.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:17:37.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:37.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:38.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:39.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:39.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:39.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:39.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:40.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:41.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:41.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:41.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:42.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:43.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:43.597 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:43.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0547002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:44.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:44.302 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:44.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:44.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:17:44.936 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:17:44.936 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:17:44.936 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:17:44.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 12:17:44.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42cd060) skgpid 21810 ospid 21810 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:45.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:45.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:46.033 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1a60) allocated [ CSSD]2013-05-23 12:17:46.034 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:17:46.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1a60 - 1,2,3 [ CSSD]2013-05-23 12:17:46.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42a1a60) pid(27357) version 11:1:1:4 [ CSSD]2013-05-23 12:17:46.041 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1a60), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:17:46.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:17:46.041 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd060, requested num -1 [ CSSD]2013-05-23 12:17:46.041 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:46.041 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5000/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:17:46.042 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:17:46.042 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:46.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:17:46.048 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:17:46.048 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:17:46.048 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:17:46.251 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1a60 [ CSSD]2013-05-23 12:17:46.251 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1a60) con(0x7f82b42b35f0) skgpid ospid 27357 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:17:46.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:47.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:47.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:48.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:49.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:49.305 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:49.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:49.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:50.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:51.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:51.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:51.867 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:17:52.140 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 12:17:52.140 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:17:52.141 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 12:17:52.141 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a3ea0) pid(27440/27440) version 11:1:1:4 [ CSSD]2013-05-23 12:17:52.146 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a3ea0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:17:52.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:17:52.146 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:17:52.146 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:17:52.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0548002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:52.300 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:17:52.300 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:17:52.300 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:17:52.300 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:17:52.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0549002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:52.306 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:17:52.306 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:17:52.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:53.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:53.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:53.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054a002a) incarnation(174631051) [ CSSD]2013-05-23 12:17:54.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:54.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:54.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:55.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:55.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:55.996 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(2/0x7f82b4204870) [ CSSD]2013-05-23 12:17:55.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 12:17:55.996 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:17:55.996 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:17:56.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:57.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:57.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:17:58.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:17:59.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:17:59.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:17:59.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:17:59.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:00.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:01.294 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ea70) allocated [ CSSD]2013-05-23 12:18:01.295 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:18:01.296 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ea70 - 1,2,3 [ CSSD]2013-05-23 12:18:01.296 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429ea70) pid(27504) version 11:1:1:4 [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ea70), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd7b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:01.302 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:01.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:01.308 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:18:01.308 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdab0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:01.309 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:01.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ea70 [ CSSD]2013-05-23 12:18:01.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ea70) con(0x7f82b42b35f0) skgpid ospid 27504 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:01.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:01.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:01.887 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:02.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:03.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:03.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:03.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054b002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:04.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:04.315 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:04.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:05.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:05.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:06.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:07.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(054c002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:07.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:18:07.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:18:07.547 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:18:07.548 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:07.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(054d002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:07.554 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:18:07.554 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:18:07.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:07.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:08.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:09.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:09.318 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:09.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:09.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:10.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:11.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:11.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:11.908 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:12.084 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85b0) allocated [ CSSD]2013-05-23 12:18:12.085 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:12.085 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85b0 - 1,2,3 [ CSSD]2013-05-23 12:18:12.085 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42d85b0) pid(27634) version 11:1:1:4 [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85b0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:12.091 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:12.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:18:12.098 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:18:12.098 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd9e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:12.098 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd9e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:12.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85b0 [ CSSD]2013-05-23 12:18:12.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85b0) con(0x7f82b42b35f0) skgpid ospid 27634 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:12.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:13.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:13.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:13.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054e002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:14.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:14.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:14.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:15.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:15.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:16.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(054f002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:16.126 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:18:16.126 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:18:16.126 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:18:16.126 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:16.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0550002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:16.132 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:18:16.132 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:18:16.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85b0) allocated [ CSSD]2013-05-23 12:18:16.549 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:18:16.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85b0 - 1,2,3 [ CSSD]2013-05-23 12:18:16.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42d85b0) pid(27679) version 11:1:1:4 [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85b0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:16.556 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:16.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:18:16.562 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:18:16.562 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd9e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:16.563 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd9e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:16.765 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85b0 [ CSSD]2013-05-23 12:18:16.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85b0) con(0x7f82b42b35f0) skgpid ospid 27679 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:16.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:17.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:17.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:18.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:19.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:19.325 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:19.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:19.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:20.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:21.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:21.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:21.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:22.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0551002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:22.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:18:22.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:18:22.795 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:18:22.795 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:22.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0552002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:22.801 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:18:22.802 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:18:22.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:23.388 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ea70) allocated [ CSSD]2013-05-23 12:18:23.389 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:23.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ea70 - 1,2,3 [ CSSD]2013-05-23 12:18:23.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429ea70) pid(27778) version 11:1:1:4 [ CSSD]2013-05-23 12:18:23.396 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ea70), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:23.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:23.396 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42cbf40 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:18:23.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:18:23.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd7b0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:18:23.397 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:23.397 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:23.403 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:18:23.403 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:18:23.403 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdab0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:18:23.403 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b41fdab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:23.511 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6c70) allocated [ CSSD]2013-05-23 12:18:23.512 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:23.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6c70 - 1,2,3 [ CSSD]2013-05-23 12:18:23.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42d6c70) pid(27789) version 11:1:1:4 [ CSSD]2013-05-23 12:18:23.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:18:23.531 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:18:23.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:18:23.534 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6c70 [ CSSD]2013-05-23 12:18:23.534 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6c70) con(0x7f82b42bad40) skgpid ospid 27789 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:23.605 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ea70 [ CSSD]2013-05-23 12:18:23.605 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ea70) con(0x7f82b42b35f0) skgpid ospid 27778 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:23.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:23.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:24.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0553002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:24.328 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:24.328 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:24.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:25.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:25.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:26.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:27.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:27.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:28.212 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85b0) allocated [ CSSD]2013-05-23 12:18:28.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:28.213 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85b0 - 1,2,3 [ CSSD]2013-05-23 12:18:28.213 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42d85b0) pid(27824/27824) version 11:1:1:4 [ CSSD]2013-05-23 12:18:28.218 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85b0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:18:28.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:18:28.218 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:18:28.218 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:18:28.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:18:28.256 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:18:28.256 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:18:28.256 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:18:28.257 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85b0 [ CSSD]2013-05-23 12:18:28.257 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85b0) con(0x7f82b42b35f0) skgpid 27824 ospid 27824 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:28.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:28.331 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:18:28.434 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42bacc0) allocated [ CSSD]2013-05-23 12:18:28.435 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:28.435 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42bacc0 - 1,2,3 [ CSSD]2013-05-23 12:18:28.435 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42bacc0) pid(27827/27827) version 11:1:1:4 [ CSSD]2013-05-23 12:18:28.451 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42bacc0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:18:28.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:18:28.452 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:18:28.452 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42bacc0 [ CSSD]2013-05-23 12:18:28.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42bacc0) con(0x7f82b42b35f0) skgpid 27827 ospid 27827 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:28.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:29.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:29.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:30.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:31.799 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ea70) allocated [ CSSD]2013-05-23 12:18:31.799 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:18:31.800 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ea70 - 1,2,3 [ CSSD]2013-05-23 12:18:31.800 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429ea70) pid(27856) version 11:1:1:4 [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ea70), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd7b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:31.817 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:31.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:18:31.825 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:18:31.825 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdab0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:31.825 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdab0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:31.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:31.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:31.950 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:32.028 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ea70 [ CSSD]2013-05-23 12:18:32.028 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ea70) con(0x7f82b42b35f0) skgpid ospid 27856 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:32.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:33.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:33.335 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:33.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:33.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:34.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0554002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:34.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:35.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:35.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:36.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:37.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:37.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:38.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0555002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:38.042 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:18:38.042 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:18:38.042 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:18:38.042 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:38.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0556002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:38.049 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:18:38.049 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:18:38.338 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:38.338 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:38.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:39.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:39.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:40.617 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85b0) allocated [ CSSD]2013-05-23 12:18:40.617 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:18:40.618 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85b0 - 1,2,3 [ CSSD]2013-05-23 12:18:40.618 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42d85b0) pid(27964) version 11:1:1:4 [ CSSD]2013-05-23 12:18:41.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:41.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85b0 [ CSSD]2013-05-23 12:18:41.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85b0) con(0x7f82b42b35f0) skgpid ospid 27964 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:41.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:41.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:41.972 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:43.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:43.341 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:43.341 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:43.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:43.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:44.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0557002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:45.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:46.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:46.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:47.061 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85b0) allocated [ CSSD]2013-05-23 12:18:47.062 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:18:47.063 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85b0 - 1,2,3 [ CSSD]2013-05-23 12:18:47.063 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42d85b0) pid(28165) version 11:1:1:4 [ CSSD]2013-05-23 12:18:47.068 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85b0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:18:47.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:18:47.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:18:47.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:47.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:18:47.069 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:18:47.069 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:47.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:18:47.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:18:47.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd9e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:18:47.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd9e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:18:47.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:47.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85b0 [ CSSD]2013-05-23 12:18:47.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85b0) con(0x7f82b42cd900) skgpid ospid 28165 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:47.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:47.344 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:18:48.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:48.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:49.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b5c30) [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b5c30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b5c30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:18:49.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid 22470 ospid 22470 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:49.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:18:49.683 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:18:49.683 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:18:49.683 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:18:49.695 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a19b0) skgpid 18676 ospid 18676 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:18:50.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:50.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:51.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:51.993 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:18:52.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:52.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:52.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:52.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:53.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:53.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0558002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:53.289 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:18:53.289 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:18:53.289 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:18:53.289 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:18:53.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0559002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:53.297 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:18:53.297 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:18:54.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055a002a) incarnation(174631051) [ CSSD]2013-05-23 12:18:54.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:54.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:55.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:56.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:56.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:57.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:18:57.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:18:57.351 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:18:58.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:18:58.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:18:59.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:00.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:00.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:01.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:02.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:02.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:02.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:02.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:19:02.313 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:19:02.314 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:19:02.314 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42583a0) pid(28319) version 11:1:1:4 [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:02.320 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:02.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:19:02.327 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:19:02.327 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:02.327 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:02.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:02.354 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:02.529 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:19:02.529 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42cd900) skgpid ospid 28319 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:03.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:04.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055b002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:04.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:04.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:05.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:06.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:06.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:07.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:07.357 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:07.357 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:08.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:08.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:08.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(055c002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:08.538 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:19:08.538 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:19:08.538 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:19:08.538 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:08.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(055d002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:08.545 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:19:08.545 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:19:09.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:09.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:19:09.714 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:19:09.715 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:19:09.715 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42a5440) pid(28409) version 11:1:1:4 [ CSSD]2013-05-23 12:19:09.836 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a18e0) allocated [ CSSD]2013-05-23 12:19:09.838 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:19:09.838 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a18e0 - 1,2,3 [ CSSD]2013-05-23 12:19:09.838 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a18e0) pid(28425) version 11:1:1:4 [ CSSD]2013-05-23 12:19:09.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:19:09.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:19:09.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a18e0 [ CSSD]2013-05-23 12:19:09.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a18e0) con(0x7f82b42d9340) skgpid ospid 28425 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:09.935 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5296/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5296 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41c8ba0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d1e80/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:09.936 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:19:09.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5296 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:09.941 [1199044928] >TRACE: clssgmExitGrock: client 5296 (0x7f82b41c8ba0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:19:09.941 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:19:09.942 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:09.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:19:09.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42cd900) skgpid ospid 28409 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:10.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:10.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:11.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:12.039 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:12.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:12.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:12.346 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:19:12.347 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:19:12.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:19:12.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42583a0) pid(28453) version 11:1:1:4 [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:12.354 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:12.360 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:12.360 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:12.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:19:12.361 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:19:12.361 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:12.361 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:12.564 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:19:12.564 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427d8a0) skgpid ospid 28453 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:13.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:14.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055e002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:14.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:14.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:15.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:16.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:16.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:16.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(055f002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:16.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:19:16.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:19:16.386 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:19:16.386 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:16.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0560002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:16.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:19:16.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:19:17.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:17.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:17.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:17.567 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:19:17.568 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:19:17.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:19:17.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a5440) pid(28495) version 11:1:1:4 [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:17.575 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:17.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:19:17.582 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:19:17.582 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:17.582 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:17.785 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:19:17.785 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b3350) skgpid ospid 28495 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:18.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:18.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:19.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:20.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:20.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:21.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:22.062 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:22.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:22.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:22.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:22.367 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:23.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:23.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0561002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:23.793 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:19:23.793 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:19:23.793 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:19:23.793 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:23.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0562002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:23.800 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:19:23.800 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:19:24.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0563002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:24.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:24.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:25.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:26.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:26.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:27.370 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:27.370 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:27.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:28.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:28.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:29.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:30.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:30.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:31.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:32.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:32.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:32.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:32.373 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:32.373 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:32.818 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:19:32.819 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:19:32.820 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:19:32.820 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(28655) version 11:1:1:4 [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:32.826 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:32.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:19:32.833 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:19:32.833 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:32.833 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:33.035 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:19:33.035 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid ospid 28655 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:33.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:34.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0564002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:34.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:34.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:35.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:36.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:36.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:37.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:37.376 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:37.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:38.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:38.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:39.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0565002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:39.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:19:39.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:19:39.040 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:19:39.040 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:39.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0566002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:39.047 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:19:39.047 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:19:39.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:40.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:40.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:41.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:42.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:42.379 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:42.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:42.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:42.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:43.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:44.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0567002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:44.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:44.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:45.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:46.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:46.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:47.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:47.383 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:47.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:48.068 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:19:48.069 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:19:48.070 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:19:48.070 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a5440) pid(28805) version 11:1:1:4 [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:19:48.076 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:48.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:19:48.083 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:19:48.083 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:19:48.083 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:19:48.285 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:19:48.285 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b3350) skgpid ospid 28805 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:19:48.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:48.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:49.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:50.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:50.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:51.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:52.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:19:52.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:52.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:52.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:52.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:53.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:54.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0568002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:54.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0569002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:54.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:19:54.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:19:54.284 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:19:54.284 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:19:54.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056a002a) incarnation(174631051) [ CSSD]2013-05-23 12:19:54.291 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:19:54.291 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:19:54.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:54.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:55.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:56.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:56.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:57.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:19:57.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:19:57.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:19:58.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:19:58.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:19:59.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:00.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:00.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:01.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:02.143 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:02.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:02.393 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:02.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:02.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:03.319 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:20:03.320 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:20:03.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:20:03.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(29146) version 11:1:1:4 [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:20:03.327 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:03.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:03.333 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:20:03.333 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:03.333 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:20:03.535 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:20:03.535 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid ospid 29146 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:03.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:04.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056b002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:04.479 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:20:04.480 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:20:04.481 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:20:04.481 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a5440) pid(29199/29199) version 11:1:1:4 [ CSSD]2013-05-23 12:20:04.497 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:04.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:04.497 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:20:04.497 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:20:04.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:04.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:20:04.804 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a9150) skgpid 29199 ospid 29199 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:05.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:06.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:06.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:07.396 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:07.396 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:07.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:08.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:08.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:09.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056c002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:09.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:09.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:09.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:09.531 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:09.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056d002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:09.538 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:09.539 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:09.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:10.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:10.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:11.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:12.166 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:12.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:12.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:12.599 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:20:12.600 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:20:12.601 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:20:12.601 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42583a0) pid(29261) version 11:1:1:4 [ CSSD]2013-05-23 12:20:12.607 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:20:12.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:20:12.607 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:20:12.607 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:12.607 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:20:12.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:20:12.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:12.614 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:20:12.614 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:20:12.614 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:12.614 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:20:12.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:12.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:12.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:20:12.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427d8a0) skgpid ospid 29261 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:13.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:14.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056e002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:14.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:14.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:16.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:16.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056f002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:16.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:16.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:16.637 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:16.637 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:16.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0570002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:16.645 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:16.645 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:16.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:16.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:17.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:17.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:18.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:18.570 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:20:18.571 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:20:18.572 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:20:18.572 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a5440) pid(29336) version 11:1:1:4 [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:20:18.578 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:18.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:20:18.585 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:20:18.585 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:18.585 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:20:18.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:18.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:18.787 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:20:18.787 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b3350) skgpid ospid 29336 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:20.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:20.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:20.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:22.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:22.189 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:22.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:22.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:22.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:22.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:24.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:24.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0571002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:24.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0572002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:24.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:24.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:24.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:24.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:24.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0573002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:24.791 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:24.791 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:24.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:24.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:26.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:26.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:26.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:27.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:27.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:28.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:29.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:29.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:30.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:31.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:31.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:31.410 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:31.410 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:20:32.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:32.211 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:33.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:33.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:33.820 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:20:33.821 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:20:33.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:20:33.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(29473) version 11:1:1:4 [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:20:33.828 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:33.835 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:20:33.835 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:20:33.835 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:33.835 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:20:34.038 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:20:34.038 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid ospid 29473 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:34.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:34.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0574002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:35.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:35.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:36.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:36.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:36.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:37.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:37.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:38.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:39.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:39.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:40.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0575002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:40.032 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:40.032 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:40.032 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:40.032 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:40.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0576002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:40.038 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:40.038 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:40.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:41.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:41.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:41.416 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:41.417 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:42.233 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:42.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:43.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:43.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:44.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:44.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0577002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:45.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:45.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:46.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:46.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:46.420 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:47.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:47.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:48.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:48.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0578002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:48.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:48.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:48.449 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:48.449 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:48.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0579002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:48.455 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:48.455 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:49.081 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:20:49.082 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:20:49.082 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:20:49.082 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a5440) pid(29621) version 11:1:1:4 [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:20:49.089 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:49.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:20:49.096 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:20:49.096 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:20:49.096 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:20:49.298 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:20:49.298 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b3350) skgpid ospid 29621 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:20:49.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:49.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:50.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:51.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:51.423 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:51.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:51.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:52.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:20:52.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:53.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:53.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:54.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(057a002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:54.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:55.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057b002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:55.286 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:20:55.286 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:20:55.286 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:20:55.286 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:20:55.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057c002a) incarnation(174631051) [ CSSD]2013-05-23 12:20:55.293 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:20:55.293 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:20:55.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:55.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:56.426 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:20:56.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:20:56.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:57.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:57.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:20:58.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:20:59.079 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:20:59.080 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:20:59.081 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:20:59.081 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42583a0) pid(29282/29282) version 11:1:1:4 [ CSSD]2013-05-23 12:20:59.096 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42583a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:20:59.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:20:59.096 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:20:59.096 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:20:59.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:20:59.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:00.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:01.429 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:01.429 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:01.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:01.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:02.299 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:02.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:02.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057d002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:02.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:02.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:02.826 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:21:02.826 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:02.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057e002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:02.832 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:02.832 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:02.960 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:21:02.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:21:02.962 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:21:02.963 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:21:03.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:03.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:04.341 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:04.342 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:21:04.342 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:04.342 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42a1690) pid(29759) version 11:1:1:4 [ CSSD]2013-05-23 12:21:04.348 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:21:04.349 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:04.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:21:04.356 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:21:04.356 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:04.356 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:21:04.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(057f002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:04.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:04.558 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:04.558 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42b35f0) skgpid ospid 29759 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:05.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:05.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:06.432 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:06.432 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:06.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:07.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:07.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:08.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:09.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:09.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:10.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0580002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:10.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:10.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:10.544 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:10.544 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:10.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0581002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:10.552 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:10.552 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:10.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:11.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:11.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:11.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:11.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:12.321 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:12.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:12.862 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:12.863 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:21:12.863 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:12.863 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42a1690) pid(29893) version 11:1:1:4 [ CSSD]2013-05-23 12:21:12.869 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:21:12.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:21:12.869 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 12:21:12.869 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:12.869 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:21:12.870 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:21:12.870 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:12.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:21:12.876 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:21:12.876 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:12.876 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:21:13.078 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:13.078 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42cd900) skgpid ospid 29893 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:13.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:13.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:14.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0582002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:14.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:15.404 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:15.404 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:21:15.405 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:15.405 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a1690) pid(29916/29916) version 11:1:1:4 [ CSSD]2013-05-23 12:21:15.411 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 12:21:15.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:21:15.411 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:21:15.411 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:15.429 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42d9340) skgpid 29916 ospid 29916 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:15.437 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:15.438 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:21:15.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:15.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:16.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:16.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0583002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:16.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:16.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:16.904 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:16.904 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:16.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0584002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:16.911 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:16.911 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:17.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:17.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:18.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:19.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:19.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:19.591 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:19.592 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:21:19.593 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:19.593 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a1690) pid(29944) version 11:1:1:4 [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:21:19.599 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:19.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:21:19.605 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:21:19.605 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:19.605 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:21:19.807 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:19.807 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42a9150) skgpid ospid 29944 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:20.440 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:20.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:20.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:21.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:21.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:22.348 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:22.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:23.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:23.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:24.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0585002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:24.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:25.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:25.444 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:25.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:25.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:25.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0586002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:25.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:25.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:25.793 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:25.793 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:25.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0587002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:25.799 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:25.799 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:26.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:27.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:27.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:28.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:29.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:29.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:30.447 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:30.447 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:30.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:31.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:31.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:32.372 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:32.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:33.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:33.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:34.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0588002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:34.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:34.840 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:34.840 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:21:34.841 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:34.841 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42a1690) pid(30098) version 11:1:1:4 [ CSSD]2013-05-23 12:21:34.847 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:21:34.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:21:34.847 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:21:34.847 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:34.847 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:21:34.848 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:21:34.848 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:34.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:21:34.855 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:21:34.855 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:34.855 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:21:35.057 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:35.057 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42cd900) skgpid ospid 30098 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:35.450 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:35.450 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:35.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:35.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:36.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:37.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:37.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:38.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:39.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:39.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:40.453 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:40.453 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:40.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:41.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0589002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:41.042 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:41.042 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:41.042 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:41.042 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:41.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058a002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:41.049 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:41.049 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:41.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:41.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:42.395 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:42.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:43.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:43.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:44.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(058b002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:44.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:45.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:45.456 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:45.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:45.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:46.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:47.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:47.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:48.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:49.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:49.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:50.100 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:21:50.101 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:21:50.102 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:21:50.102 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a1690) pid(30242) version 11:1:1:4 [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:21:50.109 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:50.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:21:50.116 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:21:50.116 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:21:50.116 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:21:50.319 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:21:50.319 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42a9150) skgpid ospid 30242 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:21:50.459 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:50.460 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:50.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:51.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:51.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:52.416 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:21:52.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:53.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:53.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:54.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(058c002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:54.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:55.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:55.463 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:21:55.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:55.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:56.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058d002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:56.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:56.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:56.291 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:56.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:56.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058e002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:56.297 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:56.297 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:56.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:57.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:57.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:21:58.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058f002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:58.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:21:58.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:21:58.420 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:21:58.420 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:21:58.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0590002a) incarnation(174631051) [ CSSD]2013-05-23 12:21:58.427 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:21:58.427 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:21:59.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:21:59.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:21:59.465 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:21:59.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:21:59.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:00.159 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:22:00.160 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:22:00.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:22:00.162 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:22:00.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0591002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:00.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:00.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:00.254 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:22:00.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:22:00.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0592002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:00.260 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:00.260 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:01.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:01.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:01.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:02.456 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:03.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:03.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:03.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:04.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:04.469 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:04.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0593002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:05.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:05.362 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:22:05.363 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:22:05.364 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:22:05.364 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42a1690) pid(30389) version 11:1:1:4 [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:22:05.381 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:05.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:05.390 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:22:05.390 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:05.390 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:22:05.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:22:05.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42b35f0) skgpid ospid 30389 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:05.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:05.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:07.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:07.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:07.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:09.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:09.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:09.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:09.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:09.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:11.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:11.315 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:22:11.316 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:22:11.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:22:11.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42a1690) pid(30502) version 11:1:1:4 [ CSSD]2013-05-23 12:22:11.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0594002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:11.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:11.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:11.537 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:22:11.537 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:11.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0595002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:11.543 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:11.543 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:11.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:11.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:12.479 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:13.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8180) allocated [ CSSD]2013-05-23 12:22:13.121 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:22:13.121 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8180 - 1,2,3 [ CSSD]2013-05-23 12:22:13.121 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a19b0) proc(0x7f82b42d8180) pid(30734) version 11:1:1:4 [ CSSD]2013-05-23 12:22:13.132 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8180), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:22:13.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:22:13.132 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:22:13.132 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:13.132 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:22:13.133 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:22:13.133 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:13.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:22:13.140 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:22:13.140 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:13.140 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:22:13.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:13.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8180 [ CSSD]2013-05-23 12:22:13.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8180) con(0x7f82b42a19b0) skgpid ospid 30734 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:13.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:22:13.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42b35f0) skgpid ospid 30502 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:13.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:13.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:14.475 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:14.475 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:14.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0596002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:15.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:16.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:16.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:17.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0597002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:17.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:17.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:17.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:22:17.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:17.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0598002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:17.162 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:17.162 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:17.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:18.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:18.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:18.478 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:18.478 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:22:19.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:20.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:20.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:20.636 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:22:20.637 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:22:20.637 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:22:20.637 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a1690) pid(30892) version 11:1:1:4 [ CSSD]2013-05-23 12:22:20.643 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:22:20.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:22:20.643 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:22:20.643 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:20.643 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:22:20.644 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:22:20.644 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:20.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:22:20.651 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:22:20.651 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:20.651 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:22:20.853 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:22:20.853 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42a9150) skgpid ospid 30892 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:21.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:22.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:22.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:22.500 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:23.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:23.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:23.481 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:24.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:24.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:24.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0599002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:25.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:26.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:26.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:26.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059a002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:26.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:26.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:26.803 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:22:26.803 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:26.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059b002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:26.811 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:26.811 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:27.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:28.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:28.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:28.484 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:28.484 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:29.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:30.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:30.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:31.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:32.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:32.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:32.523 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:33.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:33.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:33.487 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:34.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:34.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:34.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(059c002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:35.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:35.896 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:22:35.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:22:35.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:22:35.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a1690) pid(31044) version 11:1:1:4 [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:22:35.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:35.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:22:35.913 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:22:35.913 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:35.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:22:36.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:22:36.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42d9340) skgpid ospid 31044 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:36.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:36.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:37.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:37.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:37.490 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:22:38.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:38.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:39.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:40.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:40.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:41.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:42.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059d002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:42.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:42.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:42.054 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:22:42.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:42.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059e002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:42.061 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:42.061 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:42.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:42.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:42.493 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:42.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:42.543 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:43.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:44.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:44.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:44.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(059f002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:44.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:22:44.977 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:22:44.977 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:22:44.977 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:22:44.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:22:44.988 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:22:44.988 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:22:44.988 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:22:44.989 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5140 [ CSSD]2013-05-23 12:22:44.989 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5140) con(0x7f82b4207f10) skgpid 21817 ospid 21817 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:45.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:46.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:46.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:47.496 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:47.496 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:47.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:48.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:48.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:49.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:50.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:50.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:51.152 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:22:51.153 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:22:51.153 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:22:51.153 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42a5440) pid(31197) version 11:1:1:4 [ CSSD]2013-05-23 12:22:51.159 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:22:51.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:22:51.160 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:22:51.160 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:51.160 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:22:51.160 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:22:51.160 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:51.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:22:51.166 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:22:51.166 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:22:51.166 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:22:51.368 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:22:51.368 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4207f10) skgpid ospid 31197 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:51.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:52.164 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:22:52.164 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:22:52.164 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:22:52.164 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:22:52.164 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 12:22:52.165 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4257120) skgpid 27440 ospid 27440 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:22:52.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:52.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:52.499 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:52.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:22:52.565 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:22:53.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:54.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:54.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:54.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a0002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:55.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:56.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:56.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:56.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:22:56.502 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:22:57.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a1002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:57.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:22:57.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:22:57.314 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:22:57.314 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:22:57.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a2002a) incarnation(174631051) [ CSSD]2013-05-23 12:22:57.321 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:22:57.321 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:22:57.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:22:58.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:22:58.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:22:59.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:00.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:00.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:01.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:01.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:01.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:02.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:02.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:02.587 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:03.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:04.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:04.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:04.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a3002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:05.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:06.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:06.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:06.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:06.413 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:23:06.413 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:06.413 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a5440) pid(31367) version 11:1:1:4 [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:06.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:06.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:23:06.426 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:23:06.426 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:06.426 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:06.509 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:06.509 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:06.629 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:06.629 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9340) skgpid ospid 31367 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:07.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:08.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:08.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:09.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:10.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:10.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:11.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:11.512 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:11.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:12.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:12.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:12.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a4002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:12.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:23:12.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:23:12.563 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:23:12.563 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:12.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a5002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:12.570 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:23:12.570 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:23:12.608 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:13.391 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:13.392 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:13.393 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:13.393 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42a5440) pid(31453) version 11:1:1:4 [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:13.399 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:13.406 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:23:13.406 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:23:13.406 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:13.406 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:13.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:13.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4286800) skgpid ospid 31453 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:13.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:14.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:14.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:14.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a6002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:15.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:16.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:16.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:16.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:16.515 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:17.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a7002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:17.412 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:23:17.412 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:23:17.412 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:23:17.412 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:17.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a8002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:17.420 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:23:17.420 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:23:17.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:18.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:18.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:19.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:20.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:20.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:21.518 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:21.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:21.662 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:21.663 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:23:21.663 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:21.663 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(31544) version 11:1:1:4 [ CSSD]2013-05-23 12:23:21.669 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:23:21.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:23:21.669 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:23:21.669 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:21.670 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:23:21.670 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:21.670 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:21.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:23:21.676 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:23:21.676 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:21.676 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:21.879 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:21.879 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 31544 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:21.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:22.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:22.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:22.635 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:23.682 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:23.683 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:23.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:23.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42a5440) pid(31599) version 11:1:1:4 [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42d9760 with con 0x7f82b42cd900, requested num -1 [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:23.692 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:23.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:23:23.699 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:23:23.699 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:23:23.699 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:23.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3530) allocated [ CSSD]2013-05-23 12:23:23.807 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:23.808 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3530 - 1,2,3 [ CSSD]2013-05-23 12:23:23.808 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3530) pid(31604) version 11:1:1:4 [ CSSD]2013-05-23 12:23:23.823 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:23:23.825 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:23:23.827 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:23:23.828 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3530 [ CSSD]2013-05-23 12:23:23.828 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3530) con(0x7f82b42c6340) skgpid ospid 31604 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:23.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:23.901 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:23.901 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4286800) skgpid ospid 31599 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:24.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:24.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:24.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a9002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:25.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:26.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:26.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:26.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:26.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:27.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05aa002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:27.811 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:23:27.811 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:23:27.811 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:23:27.811 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:27.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ab002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:27.817 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:23:27.817 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:23:27.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:28.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:28.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:29.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:30.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:30.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:31.524 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:31.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:31.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:32.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:32.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:32.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:33.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:34.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:34.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:34.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ac002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:35.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:36.527 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:36.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:36.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:36.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:36.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:36.917 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:23:36.917 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:36.917 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a5440) pid(31697) version 11:1:1:4 [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:36.923 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:36.929 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:23:36.929 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:23:36.929 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:36.929 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:37.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:37.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9340) skgpid ospid 31697 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:38.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:38.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:38.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:40.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:40.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:40.530 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:23:40.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:40.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:41.065 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:41.066 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:41.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:41.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd900) proc(0x7f82b42a5440) pid(31779) version 11:1:1:4 [ CSSD]2013-05-23 12:23:41.675 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:41.675 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42cd900) skgpid ospid 31779 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:42.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:42.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:42.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:42.684 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:43.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ad002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:43.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:23:43.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:23:43.058 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:23:43.058 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:43.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ae002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:43.064 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:23:43.064 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:23:44.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:44.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:44.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:44.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05af002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:45.532 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:45.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:46.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:46.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:46.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:48.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:48.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:48.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:49.820 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 12:23:49.820 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:23:49.820 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:23:49.820 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 12:23:49.829 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a29f0) skgpid 26098 ospid 26098 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:50.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:50.535 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:50.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:50.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:50.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:52.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:52.165 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:52.166 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:23:52.167 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:52.167 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a5440) pid(32027) version 11:1:1:4 [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:23:52.184 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:52.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:23:52.191 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:23:52.191 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:23:52.191 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:23:52.289 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:23:52.290 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:52.291 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:23:52.291 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(31882/31882) version 11:1:1:4 [ CSSD]2013-05-23 12:23:52.307 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:23:52.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:23:52.307 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:23:52.307 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 12:23:52.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:23:52.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9340) skgpid ospid 32027 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:23:52.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:23:52.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:52.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:54.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:54.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:54.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:54.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b0002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:55.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:23:55.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:23:56.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:56.259 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:23:56.259 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:23:56.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:23:56.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(32010/32010) version 11:1:1:4 [ CSSD]2013-05-23 12:23:56.266 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:23:56.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:23:56.266 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:23:56.266 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:23:56.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:56.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:23:58.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:23:58.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b1002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:58.305 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:23:58.305 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:23:58.305 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:23:58.305 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:23:58.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b2002a) incarnation(174631051) [ CSSD]2013-05-23 12:23:58.312 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:23:58.312 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:23:58.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:23:58.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:00.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:00.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:00.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:00.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:00.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:02.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:02.777 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:02.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:02.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:04.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:04.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b3002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:04.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:04.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:05.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:05.545 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:06.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:06.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:06.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:07.426 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:24:07.427 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:24:07.428 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:24:07.428 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ae300) pid(32170) version 11:1:1:4 [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ae300), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:07.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:07.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:24:07.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:24:07.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:07.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:07.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:24:07.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42c6340) skgpid ospid 32170 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:08.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:09.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:09.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:10.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 12:24:10.017 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:24:10.018 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 12:24:10.018 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42cbb70) pid(32249) version 11:1:1:4 [ CSSD]2013-05-23 12:24:10.139 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 12:24:10.140 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:24:10.140 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 12:24:10.140 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b429db90) pid(32259) version 11:1:1:4 [ CSSD]2013-05-23 12:24:10.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:24:10.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:24:10.164 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 12:24:10.164 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42c6340) skgpid ospid 32259 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5297/0x7f82b427d5c0) [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5297 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b427d5c0 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:10.240 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:24:10.246 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5297 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:24:10.246 [1199044928] >TRACE: clssgmExitGrock: client 5297 (0x7f82b427d5c0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:24:10.246 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b46e0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:24:10.246 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b46e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:10.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 12:24:10.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b4207f10) skgpid ospid 32249 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:10.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:10.548 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:10.548 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:11.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:11.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:12.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:12.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:13.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:13.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:13.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b4002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:13.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:24:13.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:24:13.553 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:24:13.553 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:13.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b5002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:13.560 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:24:13.560 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:24:13.649 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:24:13.650 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:24:13.651 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:24:13.651 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42ae300) pid(32291) version 11:1:1:4 [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ae300), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:13.657 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:13.664 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:24:13.664 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:24:13.664 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:13.664 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:13.867 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:24:13.867 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b4286800) skgpid ospid 32291 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:14.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:14.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b6002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:15.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:15.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:15.551 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:15.551 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:16.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:17.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:17.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:17.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b7002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:17.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:24:17.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:24:17.671 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:24:17.671 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:17.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b8002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:17.678 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:24:17.678 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:24:18.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:19.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:19.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:20.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:20.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:20.555 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:21.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:21.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:24:22.356 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid 31882 ospid 31882 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:22.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:22.680 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:24:22.681 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:24:22.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:24:22.682 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42833d0) pid(32363) version 11:1:1:4 [ CSSD]2013-05-23 12:24:22.688 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:24:22.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:24:22.688 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:24:22.688 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:22.688 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:24:22.689 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:22.689 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:22.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:24:22.696 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:24:22.696 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:22.696 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:22.821 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:22.898 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:24:22.898 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42c6340) skgpid ospid 32363 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:23.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:23.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:24.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:24.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b9002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:25.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:25.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:25.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:25.558 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:26.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:27.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:27.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:28.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:28.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ba002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:28.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:24:28.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:24:28.809 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:24:28.809 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:28.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05bb002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:28.815 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:24:28.815 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:24:29.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:29.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:30.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:30.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:30.561 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:31.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:31.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:32.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:32.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:33.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:33.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:34.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:34.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05bc002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:35.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:35.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:35.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:35.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:36.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:37.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:37.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:37.940 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:24:37.941 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:24:37.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:24:37.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(32504) version 11:1:1:4 [ CSSD]2013-05-23 12:24:37.947 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:24:37.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:24:37.947 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:24:37.947 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:37.947 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:24:37.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:37.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:37.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:24:37.954 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:24:37.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:37.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:38.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:24:38.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 32504 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:38.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:39.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:39.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:40.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:40.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:40.568 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:41.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:41.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:42.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:42.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:43.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:43.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:44.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05bd002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:44.066 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:24:44.066 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:24:44.066 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:24:44.066 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:44.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05be002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:44.072 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:24:44.072 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:24:44.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:44.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05bf002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:45.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:45.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:45.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:45.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:46.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:47.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:47.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:48.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:49.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:49.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:50.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:50.574 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:50.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:51.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:51.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:52.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:52.892 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:24:53.190 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:24:53.191 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:24:53.191 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:24:53.191 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42833d0) pid(32660) version 11:1:1:4 [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:24:53.197 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:24:53.198 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:53.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:24:53.204 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:24:53.204 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:24:53.205 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:24:53.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:53.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:53.407 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:24:53.407 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42c6340) skgpid ospid 32660 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:24:54.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:55.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c0002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:55.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:55.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:55.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:24:55.577 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:24:56.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:57.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:57.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:24:58.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:24:59.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c1002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:59.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:24:59.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:24:59.313 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:24:59.313 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:24:59.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c2002a) incarnation(174631051) [ CSSD]2013-05-23 12:24:59.321 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:24:59.321 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:24:59.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:24:59.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:00.580 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:00.580 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:00.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:01.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:01.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:02.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:02.927 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:03.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:03.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:04.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:04.583 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:25:04.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:04.994 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:04.994 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:04.995 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:04.995 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(329/329) version 11:1:1:4 [ CSSD]2013-05-23 12:25:05.011 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:25:05.011 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:25:05.011 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:25:05.011 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:25:05.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c3002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:25:05.349 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid 329 ospid 329 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:05.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:05.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:06.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:07.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:07.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:08.454 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:08.455 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:25:08.455 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:08.456 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42833d0) pid(356) version 11:1:1:4 [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:25:08.462 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:08.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:25:08.469 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:25:08.469 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:08.469 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:25:08.671 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:25:08.671 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4286800) skgpid ospid 356 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:08.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:09.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:09.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:09.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:09.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:10.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:11.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:11.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:12.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:12.950 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:13.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:13.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:13.905 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:13.906 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:13.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:13.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(429) version 11:1:1:4 [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:25:13.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:13.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:25:13.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:25:13.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:13.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:25:14.124 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:25:14.124 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 429 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:14.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c4002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:14.561 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:25:14.561 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:25:14.561 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:25:14.561 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:14.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c5002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:14.568 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:25:14.568 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:25:14.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:14.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:14.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:15.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c6002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:15.252 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:25:15.252 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:25:15.252 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:25:15.252 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 23 [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:25:15.262 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ccc30) skgpid 25448 ospid 25448 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:15.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:15.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:16.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:17.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:17.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:17.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c7002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:17.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:25:17.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:25:17.928 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:25:17.928 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:17.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c8002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:17.935 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:25:17.935 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:25:18.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:19.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:19.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:19.592 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:19.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:20.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:21.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:21.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:21.953 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:21.954 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:21.955 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:21.955 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42833d0) pid(510/510) version 11:1:1:4 [ CSSD]2013-05-23 12:25:21.971 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:25:21.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:25:21.971 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:25:21.971 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 12:25:22.395 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:25:22.396 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:22.397 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:25:22.397 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42ae300) pid(458/458) version 11:1:1:4 [ CSSD]2013-05-23 12:25:22.413 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:25:22.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:25:22.413 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:25:22.413 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:25:22.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:22.970 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:25:23.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9290) skgpid 510 ospid 510 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:23.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:23.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:23.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:23.596 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:25:23.708 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:23.709 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:25:23.709 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:23.709 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42833d0) pid(530) version 11:1:1:4 [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:25:23.715 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:23.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:25:23.723 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:25:23.723 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:23.723 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:25:23.925 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 12:25:23.925 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42c6340) skgpid ospid 530 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:24.822 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 12:25:24.823 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:24.823 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 12:25:24.823 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42833d0) pid(32008/32008) version 11:1:1:4 [ CSSD]2013-05-23 12:25:24.839 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 12:25:24.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 12:25:24.839 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:25:24.839 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:25:24.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:25.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c9002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:25.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:25.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:26.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:27.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:27.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:28.598 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:28.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:28.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:29.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:29.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:29.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ca002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:29.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:25:29.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:25:29.809 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:25:29.809 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:29.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05cb002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:29.816 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:25:29.816 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:25:29.941 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 12:25:29.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:25:29.941 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:25:29.941 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 24 [ CSSD]2013-05-23 12:25:30.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:31.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:31.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:32.990 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:33.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:33.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:33.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:33.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:33.601 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:33.768 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(2/0x7f82b41edd50) [ CSSD]2013-05-23 12:25:33.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 12:25:33.768 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:25:33.768 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 12:25:35.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:35.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05cc002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:35.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:35.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:37.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:37.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:37.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:38.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:38.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:38.962 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5220) allocated [ CSSD]2013-05-23 12:25:38.964 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:25:38.964 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5220 - 1,2,3 [ CSSD]2013-05-23 12:25:38.964 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d5220) pid(684) version 11:1:1:4 [ CSSD]2013-05-23 12:25:38.970 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5220), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:25:38.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:25:38.970 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 12:25:38.970 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:38.970 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:25:38.971 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:25:38.971 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:38.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:25:38.977 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:25:38.977 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:38.977 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:25:39.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:39.179 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5220 [ CSSD]2013-05-23 12:25:39.179 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5220) con(0x7f82b42c6340) skgpid ospid 684 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:39.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:39.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:41.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:41.462 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(2/0x7f82b427d5c0) [ CSSD]2013-05-23 12:25:41.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:25:41.462 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:25:41.462 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:25:41.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:41.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:43.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:43.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:43.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:43.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:43.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:43.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:44.619 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5220) allocated [ CSSD]2013-05-23 12:25:44.620 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:25:44.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5220 - 1,2,3 [ CSSD]2013-05-23 12:25:44.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42d5220) pid(456/456) version 11:1:1:4 [ CSSD]2013-05-23 12:25:44.636 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5220), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:25:44.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:25:44.636 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:25:44.636 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:25:45.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05cd002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:45.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:25:45.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:25:45.058 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:25:45.058 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:45.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ce002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:45.065 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:25:45.065 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:25:45.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05cf002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:45.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:45.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:45.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:47.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:47.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:47.609 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:25:47.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:47.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:49.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:49.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:49.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:51.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:51.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:51.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:52.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:52.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:53.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:25:53.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:53.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:53.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:54.216 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:25:54.217 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:25:54.217 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:25:54.218 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a1690) pid(851) version 11:1:1:4 [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cd1e0, requested num -1 [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:25:54.224 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:25:54.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:25:54.232 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:25:54.232 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:25:54.232 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:25:54.435 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:25:54.435 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42bad40) skgpid ospid 851 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:25:55.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d0002a) incarnation(174631051) [ CSSD]2013-05-23 12:25:55.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:55.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:55.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:57.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:57.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:25:57.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:25:57.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:57.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:25:59.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:25:59.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:25:59.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:00.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d1002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:00.327 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:00.327 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:00.327 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:26:00.327 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:00.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d2002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:00.333 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:00.333 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:01.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:01.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:01.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:02.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:02.619 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:03.059 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:03.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d3002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:03.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:03.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:03.125 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:26:03.125 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:03.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d4002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:03.132 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:03.132 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:03.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:26:03.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:26:03.266 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:26:03.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:26:03.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:03.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:03.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:05.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d5002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:05.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:05.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:05.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:06.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:06.621 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:26:07.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:07.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:07.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:09.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:09.478 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:09.479 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:26:09.479 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:09.479 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b3990) pid(1006) version 11:1:1:4 [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cd240, requested num -1 [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:26:09.485 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:09.493 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:09.493 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:26:09.493 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:09.493 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:26:09.696 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:26:09.696 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b42bad40) skgpid ospid 1006 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:09.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:09.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:11.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:11.625 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:11.625 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:11.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:11.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:13.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:13.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:14.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:14.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:14.169 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 12:26:14.171 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:26:14.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 12:26:14.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a1690) pid(1079) version 11:1:1:4 [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1690), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cd1e0, requested num -1 [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:26:14.188 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:14.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:26:14.194 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:26:14.194 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:14.194 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:26:14.397 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 12:26:14.397 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42bad40) skgpid ospid 1079 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:15.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d6002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:15.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:15.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d7002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:15.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:15.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:15.575 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:26:15.575 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:15.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d8002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:15.583 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:15.583 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:15.858 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:15.859 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:26:15.859 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:15.859 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e330) proc(0x7f82b42b3990) pid(1106/1106) version 11:1:1:4 [ CSSD]2013-05-23 12:26:15.876 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:26:15.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:26:15.876 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:26:15.876 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:26:15.893 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b429e330) skgpid 1106 ospid 1106 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:16.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:16.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:16.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:16.628 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:17.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:18.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:18.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:18.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d9002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:18.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:18.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:18.186 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:26:18.186 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:18.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05da002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:18.194 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:18.194 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:19.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:20.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:20.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:21.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:21.631 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:21.631 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:22.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:22.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:23.104 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:23.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:24.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:24.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:24.730 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:24.730 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:26:24.731 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:24.731 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e6d0) proc(0x7f82b42b3990) pid(1198) version 11:1:1:4 [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:26:24.738 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:24.745 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:26:24.745 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:26:24.745 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:24.745 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:26:24.948 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:26:24.948 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b429e6d0) skgpid ospid 1198 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:25.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05db002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:25.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:25.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:25.634 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:26:26.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:26.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:27.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:28.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:28.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:29.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:30.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:30.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:30.637 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:30.637 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:30.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05dc002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:30.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:30.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:30.826 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:26:30.827 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:30.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05dd002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:30.834 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:30.834 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:31.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:32.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:32.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:33.127 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:33.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:34.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:34.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:35.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05de002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:35.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:35.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:35.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:36.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:36.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:37.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:38.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:38.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:39.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:39.980 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:39.981 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:26:39.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:39.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b3990) pid(1356) version 11:1:1:4 [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cd240, requested num -1 [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:26:39.998 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:40.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:26:40.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:26:40.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:40.005 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:26:40.207 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:26:40.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b42bad40) skgpid ospid 1356 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:40.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:40.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:40.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:40.644 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:41.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:42.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:42.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:43.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:43.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:44.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:44.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:45.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05df002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:45.647 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:45.647 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:45.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:46.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e0002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:46.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:26:46.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:26:46.076 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:26:46.076 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:46.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e1002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:46.082 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:26:46.082 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:26:46.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:46.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:47.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:48.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:48.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:49.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:50.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:50.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:50.651 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:50.651 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:51.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:52.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:52.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:53.171 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:26:53.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:54.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:54.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:55.240 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:55.240 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:26:55.241 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:55.241 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e6d0) proc(0x7f82b42b3990) pid(1510) version 11:1:1:4 [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c81a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:26:55.247 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:26:55.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:26:55.253 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:26:55.253 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:26:55.253 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:26:55.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e2002a) incarnation(174631051) [ CSSD]2013-05-23 12:26:55.456 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:26:55.456 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b429e6d0) skgpid ospid 1510 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:26:55.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:26:55.655 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:26:55.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:56.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:56.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:57.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:58.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:26:58.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:26:59.957 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3990) allocated [ CSSD]2013-05-23 12:26:59.957 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:26:59.958 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3990 - 1,2,3 [ CSSD]2013-05-23 12:26:59.958 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e330) proc(0x7f82b42b3990) pid(1170/1170) version 11:1:1:4 [ CSSD]2013-05-23 12:26:59.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:26:59.964 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3990), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:26:59.964 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:26:59.964 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:26:59.964 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:27:00.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:27:00.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:27:00.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:27:00.486 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:27:00.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:00.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:00.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e3002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:00.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:00.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:00.563 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:27:00.563 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:27:00.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e4002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:00.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:00.571 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:00.658 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:00.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:01.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e5002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:01.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:01.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:01.334 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:27:01.334 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:01.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e6002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:01.341 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:01.341 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:02.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:02.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:02.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:03.192 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:03.954 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 12:27:03.955 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:27:03.956 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 12:27:03.956 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42d8560) pid(1608) version 11:1:1:4 [ CSSD]2013-05-23 12:27:03.973 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:03.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:03.973 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a1820, requested num -1 [ CSSD]2013-05-23 12:27:03.973 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:03.973 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:03.974 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:03.974 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:03.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:03.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:03.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:03.981 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:04.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:04.184 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 12:27:04.184 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42bad40) skgpid ospid 1608 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:04.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:04.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:05.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e7002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:05.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:05.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:06.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:06.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:06.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:08.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:08.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:08.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:10.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:10.490 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 12:27:10.491 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:27:10.491 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 12:27:10.491 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1820) proc(0x7f82b42d8560) pid(1695) version 11:1:1:4 [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b429ebf0, requested num -1 [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:10.496 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:10.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:10.500 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:10.500 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5ed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:10.500 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5ed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:10.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:10.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:10.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:10.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:10.703 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 12:27:10.703 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42a1820) skgpid ospid 1695 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:11.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ea70) allocated [ CSSD]2013-05-23 12:27:11.549 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:27:11.549 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ea70 - 1,2,3 [ CSSD]2013-05-23 12:27:11.549 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ea70) pid(1763) version 11:1:1:4 [ CSSD]2013-05-23 12:27:12.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:12.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:12.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:13.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:14.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:14.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ea70 [ CSSD]2013-05-23 12:27:14.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ea70) con(0x7f82b42bad40) skgpid ospid 1763 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:14.432 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ea70) allocated [ CSSD]2013-05-23 12:27:14.433 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:27:14.434 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ea70 - 1,2,3 [ CSSD]2013-05-23 12:27:14.434 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ea70) pid(2083) version 11:1:1:4 [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ea70), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d8550, requested num -1 [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:14.440 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:14.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:27:14.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:14.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d83d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:14.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d83d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:14.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:14.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:14.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ea70 [ CSSD]2013-05-23 12:27:14.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ea70) con(0x7f82b42bad40) skgpid ospid 2083 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:15.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e8002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:15.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:15.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:16.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:16.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e9002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:16.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:16.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:16.584 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:27:16.584 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:16.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ea002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:16.591 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:16.591 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:16.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:16.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:18.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:18.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05eb002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:18.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:18.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:18.446 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:27:18.446 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:18.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ec002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:18.453 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:18.453 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:18.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:18.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:20.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:20.672 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:20.672 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:20.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:20.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:22.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:22.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:22.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:23.247 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:24.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:24.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:24.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:25.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ed002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:25.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:25.676 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:25.741 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 12:27:25.742 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:27:25.743 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 12:27:25.743 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1820) proc(0x7f82b42d8560) pid(2175) version 11:1:1:4 [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:25.750 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:25.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:25.756 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:25.756 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:25.756 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:25.959 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 12:27:25.959 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42a1820) skgpid ospid 2175 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:26.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:26.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:26.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:28.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:28.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:28.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:30.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:30.679 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:30.679 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:30.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:30.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:31.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ee002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:31.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:31.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:31.836 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:27:31.836 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:31.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ef002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:31.843 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:31.843 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:32.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:32.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:32.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:33.266 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:33.471 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 12:27:33.472 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:27:33.473 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 12:27:33.473 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1820) proc(0x7f82b42d8560) pid(2271) version 11:1:1:4 [ CSSD]2013-05-23 12:27:33.479 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:33.479 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:33.479 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:27:33.479 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:33.479 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:33.480 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:33.480 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:33.486 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:33.486 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:33.486 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:33.486 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:33.688 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 12:27:33.688 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42a1820) skgpid ospid 2271 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:34.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:34.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:34.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:35.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f0002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:35.682 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:35.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:36.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:36.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:36.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:38.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:38.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:38.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:39.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:39.685 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:27:40.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:40.991 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 12:27:40.992 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:27:40.992 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 12:27:40.992 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1820) proc(0x7f82b42d8560) pid(2328) version 11:1:1:4 [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b429ebf0, requested num -1 [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5bd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:40.998 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:41.005 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:27:41.005 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:41.005 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5ed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:41.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:41.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:41.005 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5ed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:41.207 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 12:27:41.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42a1820) skgpid ospid 2328 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:42.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:43.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:43.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:43.287 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:44.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:44.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:44.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:45.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:45.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:27:45.291 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427d8a0) skgpid 29282 ospid 29282 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:45.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f1002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:46.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:47.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:47.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:47.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f2002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:47.085 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:27:47.085 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:27:47.085 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:27:47.085 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:47.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f3002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:47.091 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:27:47.091 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:27:48.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:48.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:27:48.587 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:27:48.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:27:48.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(2413/2413) version 11:1:1:4 [ CSSD]2013-05-23 12:27:48.594 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42583a0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 12:27:48.594 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:27:48.594 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:27:48.594 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:27:48.750 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42583a0), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:48.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:27:48.750 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:27:48.750 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:27:49.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:49.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:49.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:49.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:50.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:51.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:51.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:52.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:53.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:53.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:53.309 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:27:54.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:54.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:54.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:27:55.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:55.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:55.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f4002a) incarnation(174631051) [ CSSD]2013-05-23 12:27:56.240 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef10) allocated [ CSSD]2013-05-23 12:27:56.241 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:27:56.241 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef10 - 1,2,3 [ CSSD]2013-05-23 12:27:56.241 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8680) proc(0x7f82b429ef10) pid(2486) version 11:1:1:4 [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ef10), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b429ee40, requested num -1 [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:27:56.258 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:27:56.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:27:56.265 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:27:56.265 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d61f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:27:56.265 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d61f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:27:56.467 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef10 [ CSSD]2013-05-23 12:27:56.467 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef10) con(0x7f82b42d8680) skgpid ospid 2486 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:27:56.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:57.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:57.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:27:58.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:27:58.698 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:27:58.698 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:27:59.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:27:59.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:00.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:01.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:01.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:02.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f5002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:02.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:28:02.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:28:02.333 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:28:02.333 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:02.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f6002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:02.340 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:28:02.340 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:28:02.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:03.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:03.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:03.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:03.701 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:03.702 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:04.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:05.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:05.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:05.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f7002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:06.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:07.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:07.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:08.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:08.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:08.705 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:09.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:09.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:10.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:11.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:11.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:11.500 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef10) allocated [ CSSD]2013-05-23 12:28:11.501 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:28:11.501 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef10 - 1,2,3 [ CSSD]2013-05-23 12:28:11.501 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c81c0) proc(0x7f82b429ef10) pid(2627) version 11:1:1:4 [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ef10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c8270, requested num -1 [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5e20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:11.518 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:11.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:28:11.525 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:28:11.525 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6120) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:11.525 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6120) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:11.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef10 [ CSSD]2013-05-23 12:28:11.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef10) con(0x7f82b42c81c0) skgpid ospid 2627 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:12.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:13.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:13.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:13.352 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:13.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:13.708 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:14.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:14.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5980) allocated [ CSSD]2013-05-23 12:28:14.692 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:28:14.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5980 - 1,2,3 [ CSSD]2013-05-23 12:28:14.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ea70) proc(0x7f82b42d5980) pid(2694) version 11:1:1:4 [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d5980), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d3cc0, requested num -1 [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5f50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:14.699 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:14.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:14.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:28:14.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6250) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:14.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6250) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:14.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5980 [ CSSD]2013-05-23 12:28:14.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5980) con(0x7f82b429ea70) skgpid ospid 2694 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:15.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:15.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:15.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f8002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:16.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:17.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:17.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:17.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f9002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:17.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:28:17.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:28:17.583 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:28:17.583 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:17.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05fa002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:17.589 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:28:17.589 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:28:17.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:17.711 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:28:18.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:18.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05fb002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:18.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:28:18.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:28:18.703 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:28:18.703 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:18.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05fc002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:18.710 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:28:18.710 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:28:19.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:19.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:20.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:21.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:21.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:22.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:22.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:22.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:23.372 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:23.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:23.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:23.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef10) allocated [ CSSD]2013-05-23 12:28:23.972 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:28:23.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef10 - 1,2,3 [ CSSD]2013-05-23 12:28:23.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c81c0) proc(0x7f82b429ef10) pid(2775) version 11:1:1:4 [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ef10), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427c5e0 with con 0x7f82b42c8270, requested num -1 [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5e20/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:23.979 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:23.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:23.985 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:28:23.985 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6120) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:28:23.985 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d6120) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:24.093 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:28:24.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:28:24.095 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:28:24.095 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8270) proc(0x7f82b4204520) pid(2780) version 11:1:1:4 [ CSSD]2013-05-23 12:28:24.111 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:28:24.114 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:28:24.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:28:24.118 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:28:24.118 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b42c8270) skgpid ospid 2780 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:24.188 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef10 [ CSSD]2013-05-23 12:28:24.188 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef10) con(0x7f82b42c81c0) skgpid ospid 2775 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:24.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:25.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:25.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:25.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05fd002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:26.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:26.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5980) allocated [ CSSD]2013-05-23 12:28:26.772 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:28:26.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5980 - 1,2,3 [ CSSD]2013-05-23 12:28:26.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ea70) proc(0x7f82b42d5980) pid(2825) version 11:1:1:4 [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d5980), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d3cc0, requested num -1 [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5f50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:26.779 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:26.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:28:26.785 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:28:26.785 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6250) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:26.785 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6250) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:26.988 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5980 [ CSSD]2013-05-23 12:28:26.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5980) con(0x7f82b429ea70) skgpid ospid 2825 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:27.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:27.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:27.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:27.718 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:28.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:29.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:29.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:30.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:31.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:31.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:32.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:32.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:32.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:32.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05fe002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:32.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:28:32.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:28:32.833 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:28:32.833 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:32.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ff002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:32.841 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:28:32.841 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:28:33.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:33.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:33.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:34.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:35.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:35.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:35.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0600002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:36.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:36.725 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:28:36.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:37.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:37.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:38.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:39.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:39.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:40.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:41.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:41.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:41.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef10) allocated [ CSSD]2013-05-23 12:28:41.545 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:28:41.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef10 - 1,2,3 [ CSSD]2013-05-23 12:28:41.545 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c81c0) proc(0x7f82b429ef10) pid(2970) version 11:1:1:4 [ CSSD]2013-05-23 12:28:41.728 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:41.729 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:42.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42045f0) allocated [ CSSD]2013-05-23 12:28:42.017 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:28:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42045f0 - 1,2,3 [ CSSD]2013-05-23 12:28:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42045f0) pid(3071) version 11:1:1:4 [ CSSD]2013-05-23 12:28:42.022 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42045f0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:42.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:42.022 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b4204520, requested num -1 [ CSSD]2013-05-23 12:28:42.022 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:42.022 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:28:42.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:42.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:42.028 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:28:42.028 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:28:42.028 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:42.028 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:42.041 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef10 [ CSSD]2013-05-23 12:28:42.041 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef10) con(0x7f82b42c81c0) skgpid ospid 2970 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:42.230 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42045f0 [ CSSD]2013-05-23 12:28:42.230 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42045f0) con(0x7f82b42bad40) skgpid ospid 3071 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:42.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:43.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:43.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:43.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:44.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:45.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:45.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:45.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0601002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:46.731 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:46.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:46.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:47.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:47.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:48.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0602002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:48.095 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:28:48.095 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:28:48.095 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:28:48.095 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:48.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0603002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:48.101 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:28:48.101 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:28:48.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:49.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:49.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:50.029 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef10) allocated [ CSSD]2013-05-23 12:28:50.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:28:50.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef10 - 1,2,3 [ CSSD]2013-05-23 12:28:50.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c81c0) proc(0x7f82b429ef10) pid(2458/2458) version 11:1:1:4 [ CSSD]2013-05-23 12:28:50.046 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ef10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:28:50.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:28:50.046 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:28:50.046 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:28:50.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:51.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:51.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:51.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:51.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:28:52.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:53.435 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:28:53.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:53.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:54.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:55.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0604002a) incarnation(174631051) [ CSSD]2013-05-23 12:28:55.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:55.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:55.738 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:28:55.738 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:28:57.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:57.263 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:28:57.264 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:28:57.264 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:28:57.264 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6300) proc(0x7f82b4204520) pid(3288) version 11:1:1:4 [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4204520), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:28:57.269 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:28:57.276 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:28:57.276 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:28:57.276 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:28:57.276 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:28:57.478 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:28:57.478 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b42d6300) skgpid ospid 3288 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:28:57.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:57.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:28:59.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:28:59.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:28:59.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:00.741 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:00.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:01.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:01.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:01.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:03.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:03.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0605002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:03.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:29:03.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:29:03.344 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:29:03.344 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:03.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0606002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:03.351 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:29:03.351 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:29:03.457 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:03.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:03.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:05.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:05.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0607002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:05.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:05.745 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:05.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:05.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:07.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:07.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:07.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:09.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:09.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:09.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:10.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 12:29:10.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:29:10.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 12:29:10.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5ca0) proc(0x7f82b42042d0) pid(3431) version 11:1:1:4 [ CSSD]2013-05-23 12:29:10.439 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf420) allocated [ CSSD]2013-05-23 12:29:10.440 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:29:10.441 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf420 - 1,2,3 [ CSSD]2013-05-23 12:29:10.441 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42046e0) proc(0x7f82b42cf420) pid(3441) version 11:1:1:4 [ CSSD]2013-05-23 12:29:10.458 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:29:10.461 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:29:10.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf420 [ CSSD]2013-05-23 12:29:10.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf420) con(0x7f82b42046e0) skgpid ospid 3441 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:10.543 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5298/0x7f82b42a9160) [ CSSD]2013-05-23 12:29:10.543 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5298 (0x7f82b42a9160) [ CSSD]2013-05-23 12:29:10.543 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42a9160 with con 0x7f82b42046e0, requested num -1 [ CSSD]2013-05-23 12:29:10.543 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:29:10.543 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42cd9c0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:29:10.544 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:10.544 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:29:10.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5298 (0x7f82b42a9160) [ CSSD]2013-05-23 12:29:10.549 [1199044928] >TRACE: clssgmExitGrock: client 5298 (0x7f82b42a9160), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:29:10.549 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdcc0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:29:10.549 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42cdcc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:10.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 12:29:10.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d5ca0) skgpid ospid 3431 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:10.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:10.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:11.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:11.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:11.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:12.512 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6ec0) allocated [ CSSD]2013-05-23 12:29:12.513 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:29:12.514 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6ec0 - 1,2,3 [ CSSD]2013-05-23 12:29:12.514 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42d6ec0) pid(3463) version 11:1:1:4 [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d6ec0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:12.519 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:12.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:29:12.526 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:29:12.526 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:12.526 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:12.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6ec0 [ CSSD]2013-05-23 12:29:12.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6ec0) con(0x7f82b42bad40) skgpid ospid 3463 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:13.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:13.477 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:13.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:13.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:14.951 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6eb0) allocated [ CSSD]2013-05-23 12:29:14.951 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:29:14.952 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6eb0 - 1,2,3 [ CSSD]2013-05-23 12:29:14.952 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6230) proc(0x7f82b42d6eb0) pid(3518) version 11:1:1:4 [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d6eb0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:14.958 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:14.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:29:14.965 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:29:14.965 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:14.965 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:15.168 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6eb0 [ CSSD]2013-05-23 12:29:15.168 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6eb0) con(0x7f82b42d6230) skgpid ospid 3518 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:15.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:15.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0608002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:15.752 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:15.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:15.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:15.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:17.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:17.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:17.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:18.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0609002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:18.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:29:18.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:29:18.594 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:29:18.594 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:18.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060a002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:18.600 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:29:18.600 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:29:18.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060b002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:18.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:29:18.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:29:18.963 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:29:18.963 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:18.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060c002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:18.970 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:29:18.970 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:29:19.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:19.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:19.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:20.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:20.756 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:21.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:21.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:21.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:23.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:23.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:23.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:23.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:25.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:25.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(060d002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:25.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:25.760 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:25.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:25.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:27.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:27.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:29:27.772 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:29:27.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:29:27.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6300) proc(0x7f82b4204520) pid(3642) version 11:1:1:4 [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4204520), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:27.778 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:27.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:29:27.785 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:29:27.785 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:27.786 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:27.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:27.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:27.988 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:29:27.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b42d6300) skgpid ospid 3642 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:29.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:29.763 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:29.763 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:29:30.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:30.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:31.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:32.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:32.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:33.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:33.520 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:33.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060e002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:33.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:29:33.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:29:33.843 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:29:33.843 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:33.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060f002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:33.852 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:29:33.852 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:29:34.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:34.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:34.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:34.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:35.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:35.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0610002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:36.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:36.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:37.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:38.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:38.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:39.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:39.770 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:39.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:40.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:40.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:41.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:42.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:42.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:43.021 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6f20) allocated [ CSSD]2013-05-23 12:29:43.022 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:29:43.022 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6f20 - 1,2,3 [ CSSD]2013-05-23 12:29:43.022 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5980) proc(0x7f82b42d6f20) pid(3796) version 11:1:1:4 [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d6f20), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:43.028 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:43.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:29:43.034 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:29:43.034 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:43.034 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:43.237 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6f20 [ CSSD]2013-05-23 12:29:43.237 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6f20) con(0x7f82b42d5980) skgpid ospid 3796 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:43.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:43.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:43.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:43.774 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:29:44.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:44.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:45.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:45.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0611002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:46.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:46.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:47.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:48.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:48.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:48.776 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:48.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:49.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0612002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:49.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:29:49.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:29:49.093 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:29:49.093 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:49.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0613002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:49.100 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:29:49.100 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:29:49.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:50.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:50.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:51.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:52.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:52.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:53.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:53.562 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:29:53.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:53.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:53.784 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e90) allocated [ CSSD]2013-05-23 12:29:53.785 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:29:53.785 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e90 - 1,2,3 [ CSSD]2013-05-23 12:29:53.785 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6210) proc(0x7f82b42d6e90) pid(3224/3224) version 11:1:1:4 [ CSSD]2013-05-23 12:29:53.802 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d6e90), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:29:53.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:29:53.802 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:29:53.802 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:29:54.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:54.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:54.169 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9050) allocated [ CSSD]2013-05-23 12:29:54.170 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:29:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9050 - 1,2,3 [ CSSD]2013-05-23 12:29:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5980) proc(0x7f82b42c9050) pid(2411/2411) version 11:1:1:4 [ CSSD]2013-05-23 12:29:54.186 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42c9050), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:29:54.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:29:54.186 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:29:54.186 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:29:55.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:55.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0614002a) incarnation(174631051) [ CSSD]2013-05-23 12:29:56.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:56.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:57.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:29:58.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:29:58.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:29:58.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dca30) allocated [ CSSD]2013-05-23 12:29:58.271 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:29:58.271 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dca30 - 1,2,3 [ CSSD]2013-05-23 12:29:58.271 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42dca30) pid(3957) version 11:1:1:4 [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dca30), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42caff0, requested num -1 [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd0e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:29:58.277 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:29:58.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:29:58.284 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:29:58.284 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd3e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:29:58.284 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd3e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:29:58.486 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dca30 [ CSSD]2013-05-23 12:29:58.486 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dca30) con(0x7f82b42bad40) skgpid ospid 3957 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:29:58.784 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:29:58.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:29:59.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:00.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:00.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:01.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:02.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:02.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:03.585 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:03.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:03.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:03.787 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:04.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:04.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:04.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0615002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:04.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:04.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:04.342 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:04.343 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:04.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0616002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:04.349 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:04.349 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:04.986 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dca30) allocated [ CSSD]2013-05-23 12:30:04.986 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:30:04.987 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dca30 - 1,2,3 [ CSSD]2013-05-23 12:30:04.987 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9b70) proc(0x7f82b42dca30) pid(4249/4249) version 11:1:1:4 [ CSSD]2013-05-23 12:30:05.003 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dca30), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:30:05.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:30:05.003 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:30:05.003 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:30:05.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:05.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0617002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dca30 [ CSSD]2013-05-23 12:30:05.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dca30) con(0x7f82b42c9b70) skgpid 4249 ospid 4249 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:30:06.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:06.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:07.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:07.746 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d6e90), client(2/0x7f82b42a2a00) [ CSSD]2013-05-23 12:30:07.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:30:07.746 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:30:07.746 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:30:08.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:08.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:08.791 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:08.791 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:09.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:10.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:10.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:11.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:12.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:12.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:13.519 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae20) allocated [ CSSD]2013-05-23 12:30:13.520 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:30:13.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae20 - 1,2,3 [ CSSD]2013-05-23 12:30:13.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9f40) proc(0x7f82b42cae20) pid(4322) version 11:1:1:4 [ CSSD]2013-05-23 12:30:13.526 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cae20), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:13.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:13.526 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cad40, requested num -1 [ CSSD]2013-05-23 12:30:13.526 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:13.526 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:30:13.527 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:30:13.527 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:13.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:13.532 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:30:13.532 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:13.532 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:30:13.610 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:13.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:13.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae20 [ CSSD]2013-05-23 12:30:13.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae20) con(0x7f82b42c9f40) skgpid ospid 4322 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:30:13.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:13.795 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:14.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:14.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:15.210 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae40) allocated [ CSSD]2013-05-23 12:30:15.211 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:30:15.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae40 - 1,2,3 [ CSSD]2013-05-23 12:30:15.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9f60) proc(0x7f82b42cae40) pid(4373) version 11:1:1:4 [ CSSD]2013-05-23 12:30:15.218 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cae40), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:15.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:15.218 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42cad60, requested num -1 [ CSSD]2013-05-23 12:30:15.218 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:15.218 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:30:15.219 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:30:15.219 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:15.226 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:15.226 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:30:15.226 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:15.226 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:30:15.429 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae40 [ CSSD]2013-05-23 12:30:15.429 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae40) con(0x7f82b42c9f60) skgpid ospid 4373 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:30:15.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:15.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0618002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:16.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:16.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:17.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:18.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:18.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:18.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:18.798 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:19.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0619002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:19.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:19.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:19.222 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:19.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:19.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061a002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:19.229 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:19.229 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:19.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061b002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:19.603 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:19.603 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:19.603 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:19.603 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:19.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061c002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:19.610 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:19.611 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:19.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:20.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:20.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:21.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:22.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:22.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:22.801 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:22.801 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:30:23.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:23.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:24.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:24.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:25.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:25.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(061d002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:26.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:26.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:27.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:27.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:27.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:28.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:28.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:28.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cad60) allocated [ CSSD]2013-05-23 12:30:28.782 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:30:28.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cad60 - 1,2,3 [ CSSD]2013-05-23 12:30:28.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9e80) proc(0x7f82b42cad60) pid(4527) version 11:1:1:4 [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cad60), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cac80, requested num -1 [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:30:28.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:28.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:30:28.794 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:30:28.794 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:28.794 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:30:28.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cad60 [ CSSD]2013-05-23 12:30:28.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cad60) con(0x7f82b42c9e80) skgpid ospid 4527 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:30:29.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:30.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:30.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:31.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:32.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:32.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:32.808 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:32.808 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:33.657 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:33.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:34.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:34.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:34.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061e002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:34.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:34.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:34.854 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:34.854 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:34.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061f002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:34.863 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:34.863 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:35.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0620002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:35.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:36.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:36.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:37.811 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:37.812 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:37.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:38.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:38.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:39.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:40.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:40.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:41.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:42.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:42.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:42.815 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:42.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:43.680 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:43.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:44.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caef0) allocated [ CSSD]2013-05-23 12:30:44.043 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:30:44.043 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caef0 - 1,2,3 [ CSSD]2013-05-23 12:30:44.043 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca010) proc(0x7f82b42caef0) pid(4670) version 11:1:1:4 [ CSSD]2013-05-23 12:30:44.049 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42caef0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cae10, requested num -1 [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:30:44.050 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:44.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:30:44.056 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:30:44.056 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:44.056 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:30:44.258 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caef0 [ CSSD]2013-05-23 12:30:44.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caef0) con(0x7f82b42ca010) skgpid ospid 4670 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:30:44.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:44.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:45.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0621002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:45.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:46.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:46.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:47.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:47.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:48.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:48.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:48.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:48.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0622002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:48.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:48.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:48.787 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:48.787 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:48.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0623002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:48.794 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:48.794 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:50.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:50.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0624002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:50.108 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:30:50.108 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:30:50.108 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:30:50.108 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:50.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0625002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:50.115 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:30:50.115 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:30:50.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:50.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:52.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:52.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:52.822 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:30:52.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:52.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:53.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:30:54.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:54.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:54.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:55.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0626002a) incarnation(174631051) [ CSSD]2013-05-23 12:30:56.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:56.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:30:56.826 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:30:56.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:56.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:58.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:30:58.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:30:58.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:30:59.297 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cad60) allocated [ CSSD]2013-05-23 12:30:59.298 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:30:59.298 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cad60 - 1,2,3 [ CSSD]2013-05-23 12:30:59.298 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9e80) proc(0x7f82b42cad60) pid(4810) version 11:1:1:4 [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cad60), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42cac80, requested num -1 [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:30:59.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:30:59.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:30:59.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:30:59.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:30:59.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:30:59.514 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cad60 [ CSSD]2013-05-23 12:30:59.515 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cad60) con(0x7f82b42c9e80) skgpid ospid 4810 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:00.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:00.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:00.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:01.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:01.829 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:02.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:02.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:02.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:03.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0627002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:03.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:03.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:03.427 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:31:03.427 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:03.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0628002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:03.435 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:03.436 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:03.565 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:31:03.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:31:03.567 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:31:03.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:31:03.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:04.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:05.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:05.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:05.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0629002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:05.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:05.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:05.358 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:05.358 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:05.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(062a002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:05.366 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:05.366 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:05.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062b002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:06.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:06.832 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:06.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:07.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:07.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:08.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:09.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:09.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:10.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:11.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:11.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:11.836 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:11.836 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:12.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:13.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:13.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:13.753 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:14.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:14.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caef0) allocated [ CSSD]2013-05-23 12:31:14.548 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:31:14.549 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caef0 - 1,2,3 [ CSSD]2013-05-23 12:31:14.549 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca010) proc(0x7f82b42caef0) pid(4985) version 11:1:1:4 [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42caef0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cae10, requested num -1 [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:31:14.555 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:31:14.556 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:14.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:31:14.562 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:31:14.562 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:14.562 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:31:14.765 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caef0 [ CSSD]2013-05-23 12:31:14.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caef0) con(0x7f82b42ca010) skgpid ospid 4985 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:15.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:15.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:15.351 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cadc0) allocated [ CSSD]2013-05-23 12:31:15.351 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:31:15.352 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cadc0 - 1,2,3 [ CSSD]2013-05-23 12:31:15.352 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9e80) proc(0x7f82b42cadc0) pid(5207/5207) version 11:1:1:4 [ CSSD]2013-05-23 12:31:15.358 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cadc0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:15.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:15.358 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:31:15.358 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:31:15.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:15.380 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:31:15.380 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:31:15.380 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 12:31:15.381 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cadc0 [ CSSD]2013-05-23 12:31:15.381 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cadc0) con(0x7f82b42c9e80) skgpid 5207 ospid 5207 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:15.467 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cad60) allocated [ CSSD]2013-05-23 12:31:15.468 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:31:15.469 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cad60 - 1,2,3 [ CSSD]2013-05-23 12:31:15.469 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9e80) proc(0x7f82b42cad60) pid(5242) version 11:1:1:4 [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cad60), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42cac80, requested num -1 [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:31:15.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:31:15.475 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:15.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:31:15.481 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:31:15.481 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:15.482 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:31:15.685 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cad60 [ CSSD]2013-05-23 12:31:15.685 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cad60) con(0x7f82b42c9e80) skgpid ospid 5242 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:15.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:15.839 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:31:15.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062c002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:16.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:17.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:17.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:18.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:19.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:19.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:19.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062d002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:19.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:19.488 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:19.488 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:19.488 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:19.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(062e002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:19.495 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:19.495 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:20.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:20.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062f002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:20.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:20.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:20.618 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:20.618 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:20.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0630002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:20.624 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:20.624 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:20.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:20.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:21.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:21.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:22.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:23.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:23.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:23.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:24.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:25.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:25.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:25.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:25.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:26.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0631002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:26.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:27.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:27.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:28.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:29.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:29.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:29.808 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cad60) allocated [ CSSD]2013-05-23 12:31:29.808 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:31:29.809 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cad60 - 1,2,3 [ CSSD]2013-05-23 12:31:29.809 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9e80) proc(0x7f82b42cad60) pid(5429) version 11:1:1:4 [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cad60), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cac80, requested num -1 [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:31:29.815 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:29.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:31:29.822 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:31:29.822 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:29.822 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:31:30.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cad60 [ CSSD]2013-05-23 12:31:30.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cad60) con(0x7f82b42c9e80) skgpid ospid 5429 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:30.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:30.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:30.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:31.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:31.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:32.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:33.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:33.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:33.810 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:34.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:35.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:35.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:35.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:35.853 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:35.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0632002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:35.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:35.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:35.867 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:35.867 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:35.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0633002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:35.875 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:35.875 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:36.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0634002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:36.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:37.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:37.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:38.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:39.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:39.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:40.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:40.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:40.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:41.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:41.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:42.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:43.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:43.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:43.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:44.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:45.057 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caef0) allocated [ CSSD]2013-05-23 12:31:45.058 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:31:45.059 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caef0 - 1,2,3 [ CSSD]2013-05-23 12:31:45.059 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca010) proc(0x7f82b42caef0) pid(5576) version 11:1:1:4 [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42caef0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cae10, requested num -1 [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:31:45.065 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:45.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:31:45.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:31:45.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:31:45.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:31:45.274 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caef0 [ CSSD]2013-05-23 12:31:45.275 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caef0) con(0x7f82b42ca010) skgpid ospid 5576 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:31:45.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:45.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:45.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:45.861 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:46.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0635002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:46.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:47.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:47.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:48.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:49.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:49.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:49.864 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:49.864 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:31:50.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:51.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0636002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:51.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:51.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:51.128 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:51.128 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:51.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0637002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:51.137 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:51.137 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:51.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:51.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:52.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:53.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:53.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:53.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:31:54.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:54.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:54.867 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:31:55.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:55.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:56.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0638002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:56.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:57.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:57.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:58.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:31:58.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0639002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:58.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:31:58.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:31:58.760 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:31:58.760 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:31:58.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063a002a) incarnation(174631051) [ CSSD]2013-05-23 12:31:58.767 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:31:58.767 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:31:59.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:31:59.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:31:59.869 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:31:59.870 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:00.308 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae20) allocated [ CSSD]2013-05-23 12:32:00.308 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:32:00.309 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae20 - 1,2,3 [ CSSD]2013-05-23 12:32:00.309 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9f40) proc(0x7f82b42cae20) pid(5740) version 11:1:1:4 [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cae20), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42cad40, requested num -1 [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:32:00.325 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:00.332 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:00.332 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:32:00.332 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:00.332 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:32:00.535 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae20 [ CSSD]2013-05-23 12:32:00.535 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae20) con(0x7f82b42c9f40) skgpid ospid 5740 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:00.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:00.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:32:00.800 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:32:00.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:32:00.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:32:00.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063b002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:00.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:00.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:00.883 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:32:00.883 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:32:00.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063c002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:00.890 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:00.890 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:01.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:01.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:02.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:03.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:03.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:03.877 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:04.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:04.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:04.873 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:05.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:05.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:06.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(063d002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:06.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063e002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:06.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:06.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:06.381 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:32:06.381 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:06.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063f002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:06.388 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:06.388 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:06.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:07.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:07.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:08.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:09.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:09.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:09.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:09.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:10.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:11.207 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf50) allocated [ CSSD]2013-05-23 12:32:11.208 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:32:11.209 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf50 - 1,2,3 [ CSSD]2013-05-23 12:32:11.209 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca010) proc(0x7f82b42caf50) pid(5914) version 11:1:1:4 [ CSSD]2013-05-23 12:32:11.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:11.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:12.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:13.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:13.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:13.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:13.899 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf50 [ CSSD]2013-05-23 12:32:13.899 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf50) con(0x7f82b42ca010) skgpid ospid 5914 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:14.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:14.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:14.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:15.569 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caef0) allocated [ CSSD]2013-05-23 12:32:15.569 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:32:15.570 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caef0 - 1,2,3 [ CSSD]2013-05-23 12:32:15.570 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca010) proc(0x7f82b42caef0) pid(6292) version 11:1:1:4 [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42caef0), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42cae10, requested num -1 [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:32:15.576 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:15.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:15.582 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:32:15.582 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:15.582 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:32:15.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:15.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:15.728 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df760) allocated [ CSSD]2013-05-23 12:32:15.729 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:32:15.730 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df760 - 1,2,3 [ CSSD]2013-05-23 12:32:15.730 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42df760) pid(6333) version 11:1:1:4 [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42df760), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42df670, requested num -1 [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:32:15.747 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:15.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:32:15.754 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:32:15.754 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e01f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:15.754 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e01f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:32:15.785 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caef0 [ CSSD]2013-05-23 12:32:15.785 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caef0) con(0x7f82b42ca010) skgpid ospid 6292 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:15.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df760 [ CSSD]2013-05-23 12:32:15.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df760) con(0x7f82b42bad40) skgpid ospid 6333 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:16.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0640002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:16.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:17.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:17.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:18.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:19.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:19.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:19.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0641002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:19.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:19.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:19.741 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:32:19.742 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:19.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0642002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:19.749 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:19.749 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:19.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:19.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:20.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:21.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0643002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:21.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:21.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:21.643 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:32:21.643 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:21.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0644002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:21.650 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:21.650 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:21.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:21.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:22.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:23.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:23.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:23.922 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:24.886 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:24.887 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:24.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:25.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:25.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:26.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0645002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:26.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:27.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:27.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:28.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:28.890 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:32:28.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:29.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:29.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:30.820 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae40) allocated [ CSSD]2013-05-23 12:32:30.821 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:32:30.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae40 - 1,2,3 [ CSSD]2013-05-23 12:32:30.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9f60) proc(0x7f82b42cae40) pid(6492) version 11:1:1:4 [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cae40), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42cad60, requested num -1 [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:32:30.828 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:30.835 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:32:30.835 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:32:30.835 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:30.835 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:32:30.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:31.038 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae40 [ CSSD]2013-05-23 12:32:31.038 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae40) con(0x7f82b42c9f60) skgpid ospid 6492 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:31.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:31.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:32.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:33.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:33.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:33.893 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:33.893 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:33.942 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:34.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:35.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:35.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:36.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0646002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:36.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0647002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:36.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:36.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:36.894 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:32:36.894 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:36.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0648002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:36.901 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:36.901 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:36.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:37.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:37.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:38.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:38.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:39.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:39.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:39.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:41.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:41.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:41.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:43.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:43.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:43.900 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:43.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:43.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:43.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:45.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5220 [ CSSD]2013-05-23 12:32:45.377 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5220) con(0x7f82b42d9750) skgpid 456 ospid 456 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:45.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:32:45.385 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:32:45.385 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:32:45.385 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:32:45.395 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b4207f10) skgpid 458 ospid 458 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:45.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:45.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:46.074 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 12:32:46.075 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:32:46.075 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 12:32:46.075 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(6653) version 11:1:1:4 [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c5f40), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:32:46.082 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:46.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:32:46.088 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:32:46.088 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:32:46.088 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:32:46.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0649002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:46.291 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 12:32:46.291 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid ospid 6653 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:47.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:47.902 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:47.903 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:32:47.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:47.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:49.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:50.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:50.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:51.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:52.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:52.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:52.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064a002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:52.144 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:32:52.144 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:32:52.144 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:32:52.144 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:32:52.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(064b002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:52.152 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:32:52.152 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:32:52.504 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:32:52.504 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:32:52.504 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:32:52.504 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:32:52.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef10 [ CSSD]2013-05-23 12:32:52.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef10) con(0x7f82b42c81c0) skgpid 2458 ospid 2458 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:32:52.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:52.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:53.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:53.983 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:32:54.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:54.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:55.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:56.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:56.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:56.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064c002a) incarnation(174631051) [ CSSD]2013-05-23 12:32:57.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:32:57.909 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:32:57.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:32:58.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:32:58.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:32:59.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:00.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:00.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:01.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:01.324 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:01.324 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:33:01.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:01.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42c7b30) pid(6805) version 11:1:1:4 [ CSSD]2013-05-23 12:33:01.331 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:33:01.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:33:01.331 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:33:01.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:01.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:33:01.332 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:01.332 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:01.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:33:01.339 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:33:01.339 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:01.339 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:01.542 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:01.542 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42d9290) skgpid ospid 6805 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:02.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:02.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:02.913 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:02.913 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:03.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:04.007 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:04.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:04.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:05.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:06.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:06.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:06.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064d002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:06.916 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:06.916 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:33:07.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:07.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064e002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:07.402 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:33:07.402 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:33:07.402 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:33:07.402 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:07.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(064f002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:07.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:33:07.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:33:08.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:08.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:09.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:10.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:10.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:11.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:11.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:11.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:12.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:12.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:13.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:14.027 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:14.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:14.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:15.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:15.995 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:15.995 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:15.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:15.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c7b30) pid(6959) version 11:1:1:4 [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:16.002 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:16.009 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:33:16.009 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:33:16.009 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:16.010 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:16.212 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:16.212 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4207f10) skgpid ospid 6959 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:16.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:16.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:16.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0650002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:16.585 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:16.586 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:33:16.586 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:16.586 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42c7b30) pid(6969) version 11:1:1:4 [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:16.592 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:16.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:33:16.599 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:33:16.599 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:16.599 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:16.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:16.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42bad40) skgpid ospid 6969 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:16.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:16.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:17.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:18.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:18.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:19.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:20.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0651002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:20.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:33:20.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:33:20.004 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:33:20.004 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:20.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0652002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:20.011 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:33:20.011 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:33:20.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:20.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:21.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:21.927 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:21.927 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:22.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:22.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:22.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0653002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:22.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:33:22.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:33:22.654 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:33:22.654 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:22.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0654002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:22.662 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:33:22.662 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:33:23.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:24.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:24.266 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:24.267 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:24.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:24.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c7b30) pid(7065) version 11:1:1:4 [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41bf650 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:24.274 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:24.281 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:33:24.281 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:33:24.281 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:33:24.281 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:24.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:24.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:24.388 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 12:33:24.389 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:24.389 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 12:33:24.389 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cfa20) pid(7070) version 11:1:1:4 [ CSSD]2013-05-23 12:33:24.405 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:33:24.407 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:33:24.409 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:33:24.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 12:33:24.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b427c5d0) skgpid ospid 7070 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:24.483 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:24.483 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4257120) skgpid ospid 7065 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:25.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:26.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0655002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:26.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:26.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:26.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:26.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:27.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:28.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:28.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:28.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:28.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:28.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:28.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c7b30) pid(7106/7106) version 11:1:1:4 [ CSSD]2013-05-23 12:33:28.643 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:33:28.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:33:28.643 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:33:28.643 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d6fc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d6fc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:28.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4257120) skgpid 7106 ospid 7106 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:28.863 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:28.864 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:28.865 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:28.865 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c7b30) pid(7115/7115) version 11:1:1:4 [ CSSD]2013-05-23 12:33:28.880 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:33:28.880 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:33:28.880 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:33:28.880 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:28.928 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4207f10) skgpid 7115 ospid 7115 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:29.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:30.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:30.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:31.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:31.838 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:31.839 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:33:31.840 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:31.840 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42c7b30) pid(7141) version 11:1:1:4 [ CSSD]2013-05-23 12:33:31.846 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:33:31.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:33:31.846 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 12:33:31.846 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:31.846 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:33:31.847 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:31.847 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:31.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:33:31.854 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:33:31.854 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:31.854 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:31.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:31.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:32.057 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:32.057 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42bad40) skgpid ospid 7141 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:32.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:32.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:33.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:34.067 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:34.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:34.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:35.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:36.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0656002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:36.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:36.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:36.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:36.937 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:37.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:37.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0657002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:37.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:33:37.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:33:37.905 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:33:37.905 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:37.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0658002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:37.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:33:37.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:33:38.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:38.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:39.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:40.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:40.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:40.969 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:40.970 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:33:40.970 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:40.970 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c7b30) pid(7249) version 11:1:1:4 [ CSSD]2013-05-23 12:33:41.547 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:41.547 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4207f10) skgpid ospid 7249 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:41.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:41.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:41.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:42.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:42.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:43.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:44.089 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:44.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:44.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:45.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:46.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0659002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:46.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:46.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:46.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:46.943 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:47.090 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:33:47.090 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:33:47.091 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:33:47.091 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42c7b30) pid(7450) version 11:1:1:4 [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7b30), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:33:47.097 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:47.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:33:47.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:33:47.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:33:47.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:33:47.306 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:33:47.306 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42bad40) skgpid ospid 7450 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:47.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:48.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:48.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:49.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:49.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:33:49.949 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:33:49.949 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:33:49.949 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3990 [ CSSD]2013-05-23 12:33:49.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3990) con(0x7f82b429e330) skgpid 1170 ospid 1170 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:33:49.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid 32010 ospid 32010 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:33:50.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:50.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:51.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:51.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:51.946 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:52.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:52.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:53.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065a002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:53.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:33:53.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:33:53.154 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:33:53.154 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:33:53.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(065b002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:53.160 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:33:53.160 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:33:53.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:54.111 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:33:54.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:54.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:55.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:56.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065c002a) incarnation(174631051) [ CSSD]2013-05-23 12:33:56.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:56.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:56.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:33:56.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:33:57.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:33:58.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:33:58.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:33:59.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:00.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:00.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:01.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:01.952 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:01.952 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:02.339 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:02.340 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:34:02.340 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:02.340 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(7597) version 11:1:1:4 [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:02.346 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:02.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:34:02.353 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:34:02.353 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:02.353 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:02.556 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:02.556 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 7597 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:02.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:02.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:03.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:04.134 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:04.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:04.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:05.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:05.954 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:05.954 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:34:06.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065d002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:06.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:06.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:07.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:08.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065e002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:08.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:34:08.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:34:08.403 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:34:08.403 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:08.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(065f002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:08.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:34:08.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:34:08.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:08.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:09.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:10.628 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:10.629 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:34:10.630 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:10.630 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(7698) version 11:1:1:4 [ CSSD]2013-05-23 12:34:10.747 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 12:34:10.747 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:34:10.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 12:34:10.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b427c510) pid(7708) version 11:1:1:4 [ CSSD]2013-05-23 12:34:10.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:34:10.767 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:34:10.771 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 12:34:10.771 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42d5bd0) skgpid ospid 7708 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:10.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:10.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5299/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5299 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42d6fc0 with con 0x7f82b42d5bd0, requested num -1 [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:10.850 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:34:10.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5299 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:34:10.856 [1199044928] >TRACE: clssgmExitGrock: client 5299 (0x7f82b42d6fc0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:34:10.856 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:34:10.856 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:10.857 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:10.857 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 7698 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:10.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:10.958 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:11.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:12.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:12.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:14.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:14.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:14.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:14.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:15.961 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:15.962 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:16.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:16.255 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:16.256 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:34:16.256 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:16.256 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(7759) version 11:1:1:4 [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:16.263 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:16.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:34:16.269 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:34:16.269 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:16.269 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:16.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0660002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:16.472 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:16.472 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 7759 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:16.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:16.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:17.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:17.595 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:34:17.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:17.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(7780) version 11:1:1:4 [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:17.602 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:17.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:34:17.609 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:34:17.609 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:17.609 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:17.812 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:17.812 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 7780 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:18.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:18.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:18.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:20.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:20.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0661002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:20.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:34:20.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:34:20.275 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:34:20.275 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:20.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0662002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:20.283 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:34:20.283 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:34:20.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:20.965 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:20.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:20.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:22.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:22.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:22.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:23.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0663002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:23.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:34:23.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:34:23.655 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:34:23.656 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:23.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0664002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:23.662 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:34:23.662 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:34:24.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:24.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:24.967 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:24.968 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:34:24.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:24.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:26.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:26.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0665002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:27.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:27.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:28.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:29.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:29.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:29.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:29.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:30.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:31.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:31.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:32.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:32.855 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:32.856 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:34:32.857 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:32.857 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(7971) version 11:1:1:4 [ CSSD]2013-05-23 12:34:32.862 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:34:32.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:34:32.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 12:34:32.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:32.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:34:32.863 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:32.863 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:32.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:34:32.869 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:34:32.869 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:32.869 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:33.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:33.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:33.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:33.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 7971 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:34.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:34.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:34.974 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:34.974 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:35.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:35.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:36.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:36.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0666002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:37.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:37.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:38.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:38.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0667002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:38.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:34:38.903 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:34:38.903 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:34:38.904 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:38.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0668002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:38.910 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:34:38.910 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:34:39.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:39.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:39.977 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:39.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:40.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:41.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:41.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:42.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:43.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:43.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:43.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:43.981 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:34:44.219 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:44.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:45.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:45.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:46.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:46.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0669002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:47.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:47.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:48.105 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:34:48.106 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:34:48.106 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:34:48.106 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(8116) version 11:1:1:4 [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:34:48.123 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:48.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:34:48.129 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:34:48.129 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:34:48.129 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:34:48.332 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:34:48.332 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 8116 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:34:48.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:48.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:48.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:49.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:49.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:50.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:51.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:51.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:52.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:53.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:53.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:53.987 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:53.987 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:54.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066a002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:54.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:34:54.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:34:54.154 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:34:54.154 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:34:54.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(066b002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:54.161 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:34:54.161 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:34:54.241 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:34:54.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:55.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:55.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:56.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:56.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066c002a) incarnation(174631051) [ CSSD]2013-05-23 12:34:57.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:57.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:34:58.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:34:58.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:34:58.990 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:34:59.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:34:59.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:00.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:01.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:01.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:02.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:02.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:02.993 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:35:03.365 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:03.366 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:35:03.367 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:03.367 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(8279) version 11:1:1:4 [ CSSD]2013-05-23 12:35:03.373 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:35:03.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:35:03.373 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 12:35:03.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:03.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:35:03.374 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:35:03.374 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:03.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:35:03.380 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:35:03.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c83f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:03.380 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c83f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:35:03.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:03.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:03.582 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:03.582 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 8279 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:04.283 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:04.591 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:04.592 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:35:04.592 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:04.592 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(8337/8337) version 11:1:1:4 [ CSSD]2013-05-23 12:35:04.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:04.608 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:35:04.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:35:04.608 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:35:04.608 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:04.884 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid 8337 ospid 8337 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:05.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:05.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:06.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066d002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:06.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:07.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:07.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:07.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:07.997 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:08.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:09.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066e002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:09.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:35:09.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:35:09.405 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:35:09.405 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:09.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(066f002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:09.412 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:35:09.412 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:35:09.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:09.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:10.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:11.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:11.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:12.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:12.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:13.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:13.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:13.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:14.305 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:14.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:15.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:35:15.456 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:35:15.456 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:35:15.456 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:35:15.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 12:35:15.460 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:35:15.460 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:35:15.460 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:35:15.461 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:35:15.461 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid 2413 ospid 2413 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9050 [ CSSD]2013-05-23 12:35:15.469 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9050) con(0x7f82b42d5980) skgpid 2411 ospid 2411 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:15.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:15.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:16.505 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:16.506 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:35:16.506 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:16.506 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(8425) version 11:1:1:4 [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:35:16.513 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:16.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:35:16.520 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:35:16.520 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:16.520 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:35:16.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0670002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:16.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:16.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:16.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 8425 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:17.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:17.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:18.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:18.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:18.615 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:18.616 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:35:18.617 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:18.617 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42a5440) pid(8472) version 11:1:1:4 [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:35:18.633 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:18.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:35:18.640 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:35:18.640 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:18.640 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:35:18.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:18.842 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:18.842 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b3350) skgpid ospid 8472 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:19.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:19.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:20.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0671002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:20.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:35:20.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:35:20.537 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:35:20.537 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:20.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0672002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:20.545 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:35:20.545 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:35:20.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:21.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:21.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:22.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:22.006 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:35:22.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:23.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:23.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:24.327 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:24.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0673002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:24.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:35:24.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:35:24.658 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:35:24.658 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:24.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0674002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:24.665 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:35:24.665 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:35:24.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:25.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:25.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:26.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0675002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:26.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:27.008 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:27.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:27.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:27.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:28.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:29.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:29.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:30.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:31.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:31.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:32.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:32.012 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:32.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:33.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:33.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:33.885 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:33.885 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:35:33.886 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:33.886 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(8624) version 11:1:1:4 [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:35:33.891 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:33.898 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:35:33.898 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:35:33.898 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:33.898 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:35:34.100 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:34.100 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 8624 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:34.347 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:34.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:35.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:35.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:36.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0676002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:36.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:37.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:37.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:37.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:37.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:38.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:39.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:39.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:39.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0677002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:39.919 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:35:39.919 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:35:39.919 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:35:39.919 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:39.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0678002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:39.926 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:35:39.926 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:35:40.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:41.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:41.018 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:35:41.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:41.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:42.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:43.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:43.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:44.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:44.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:45.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:45.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:46.021 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:46.021 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:46.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0679002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:47.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:47.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:47.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:49.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:49.133 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:35:49.134 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:35:49.134 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:35:49.134 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5980) proc(0x7f82b42a5440) pid(8801) version 11:1:1:4 [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:35:49.151 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:49.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:35:49.157 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:35:49.157 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:35:49.157 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:35:49.360 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:35:49.360 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d5980) skgpid ospid 8801 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:35:49.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:49.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:51.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:51.024 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:51.025 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:51.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:51.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:53.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:53.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:53.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:54.388 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:35:55.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:55.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067a002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:55.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:35:55.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:35:55.180 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:35:55.180 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:35:55.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067b002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:55.188 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:35:55.188 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:35:55.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:55.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:56.027 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:35:56.028 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:35:56.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(067c002a) incarnation(174631051) [ CSSD]2013-05-23 12:35:57.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:57.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:57.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:35:59.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:35:59.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:35:59.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:01.030 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:01.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:01.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:01.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:01.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:03.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:03.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067d002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:03.722 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:03.722 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:03.722 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:36:03.722 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:03.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067e002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:03.729 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:03.729 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:03.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:36:03.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:36:03.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:36:03.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:36:03.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:03.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:04.392 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:36:04.393 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:36:04.394 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:36:04.394 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(8998) version 11:1:1:4 [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:36:04.399 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:04.406 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:04.406 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:36:04.406 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:04.406 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:36:04.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:04.608 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:36:04.608 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 8998 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:05.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:05.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:05.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:06.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:06.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:06.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(067f002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:07.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:07.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:07.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:09.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:09.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:09.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:10.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0680002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:10.432 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:10.432 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:10.432 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:36:10.433 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:10.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0681002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:10.439 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:10.439 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:11.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:11.037 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:11.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:12.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:12.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:13.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:14.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:14.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:14.434 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:15.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:15.572 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:36:15.573 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:36:15.573 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:36:15.573 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5980) proc(0x7f82b42a5440) pid(9133/9133) version 11:1:1:4 [ CSSD]2013-05-23 12:36:15.589 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:15.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:15.589 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:36:15.589 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:36:15.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d5980) skgpid 9133 ospid 9133 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:16.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:16.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:16.040 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:16.040 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:16.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0682002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:16.772 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:36:16.773 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:36:16.773 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:36:16.773 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(9142) version 11:1:1:4 [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:36:16.780 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:16.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:36:16.787 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:36:16.787 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:16.787 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:36:16.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:36:16.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 9142 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:17.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:18.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:18.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:19.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:19.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:36:19.643 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:36:19.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:36:19.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(9174) version 11:1:1:4 [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42d6fc0) [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d6fc0 with con 0x7f82b42d5980, requested num -1 [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:36:19.660 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:19.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d6fc0) [ CSSD]2013-05-23 12:36:19.666 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d6fc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:36:19.666 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:19.667 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:36:19.869 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:36:19.869 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 9174 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:19.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:36:19.963 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:36:19.963 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:36:19.963 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6e90 [ CSSD]2013-05-23 12:36:19.969 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6e90) con(0x7f82b42d6210) skgpid 3224 ospid 3224 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:20.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:20.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:20.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0683002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:20.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:20.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:20.802 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:36:20.802 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:20.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0684002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:20.808 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:20.808 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:21.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:21.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:21.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:22.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:22.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:23.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:24.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:24.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:24.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 12:36:24.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:36:24.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 12:36:24.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(9225/9225) version 11:1:1:4 [ CSSD]2013-05-23 12:36:24.339 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:36:24.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:36:24.339 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:36:24.339 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 12:36:24.457 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:25.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:25.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0685002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:25.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:25.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:25.691 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:36:25.691 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:25.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0686002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:25.697 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:25.697 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:26.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:26.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:26.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:26.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:26.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0687002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:27.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:28.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:28.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:29.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:30.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:30.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:31.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:31.051 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:31.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:32.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:32.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:33.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:34.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:34.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:34.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:34.902 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:36:34.903 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:36:34.904 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:36:34.904 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(9325) version 11:1:1:4 [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:36:34.909 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:34.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:36:34.916 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:36:34.916 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:34.916 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:36:35.118 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:36:35.118 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 9325 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:35.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:36.055 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:36.055 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:36.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:36.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:36.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0688002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:37.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:38.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:38.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:39.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:40.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:40.058 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:36:40.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:40.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:40.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0689002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:40.941 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:40.941 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:40.942 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:36:40.942 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:40.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068a002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:40.949 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:40.949 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:41.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:42.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:42.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:43.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:44.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:44.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:44.508 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:45.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:45.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:45.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:46.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:46.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:46.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(068b002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:47.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:48.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:48.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:49.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:50.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:50.065 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:50.160 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 12:36:50.161 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:36:50.162 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 12:36:50.162 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b3030) pid(9466) version 11:1:1:4 [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3030), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:36:50.168 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:50.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:36:50.175 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:36:50.175 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:36:50.175 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:36:50.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:50.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:50.377 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 12:36:50.377 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b42aee40) skgpid ospid 9466 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:36:51.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:52.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:52.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:53.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:54.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:54.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:54.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:36:55.068 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:55.068 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:36:55.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:56.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068c002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:56.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:36:56.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:36:56.191 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:36:56.191 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:36:56.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068d002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:56.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:36:56.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:36:56.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:56.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:56.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(068e002a) incarnation(174631051) [ CSSD]2013-05-23 12:36:57.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:36:58.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:36:58.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:36:59.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:36:59.070 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:36:59.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:00.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:00.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:01.128 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:37:01.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:37:01.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:37:01.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:37:01.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068f002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:01.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:01.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:01.213 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:37:01.213 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:37:01.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0690002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:01.221 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:01.221 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:01.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:02.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:02.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:03.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:04.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:04.073 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:04.300 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 12:37:04.301 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:04.302 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 12:37:04.302 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42af3a0) pid(9626) version 11:1:1:4 [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42af3a0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:04.319 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:04.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:37:04.325 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:04.325 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:04.325 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:04.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:04.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:04.528 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 12:37:04.528 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b4257120) skgpid ospid 9626 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:04.551 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:05.409 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 12:37:05.410 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:37:05.410 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 12:37:05.410 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42830a0) pid(9650) version 11:1:1:4 [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42830a0), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:05.416 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:05.422 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:37:05.422 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:05.422 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:05.422 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:05.624 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 12:37:05.624 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b4257120) skgpid ospid 9650 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:05.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:06.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:06.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:06.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0691002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:07.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:08.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:08.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:09.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:09.076 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:09.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:10.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:10.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:11.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0692002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:11.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:11.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:11.443 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:37:11.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:11.447 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:37:11.448 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:11.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:37:11.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5b40) pid(9766) version 11:1:1:4 [ CSSD]2013-05-23 12:37:11.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0693002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:11.451 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:11.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:12.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:12.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:12.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:13.926 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:37:13.926 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42b3350) skgpid ospid 9766 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:14.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:14.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:14.079 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:14.572 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:14.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:14.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:16.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:16.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:16.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:16.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0694002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:17.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 12:37:17.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:17.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 12:37:17.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b3030) pid(10147) version 11:1:1:4 [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3030), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:17.036 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:17.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:37:17.042 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:17.042 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:17.042 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:17.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 12:37:17.245 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b42b3350) skgpid ospid 10147 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:18.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:18.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:18.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:19.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:19.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:20.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:20.658 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 12:37:20.659 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:37:20.659 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 12:37:20.659 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42af3a0) pid(10196) version 11:1:1:4 [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42af3a0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:20.666 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:20.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:37:20.673 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:20.673 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:20.673 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:20.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:20.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:20.876 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 12:37:20.876 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b42b3350) skgpid ospid 10196 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:21.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0695002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:21.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:21.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:21.053 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:37:21.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:21.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0696002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:21.060 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:21.060 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:22.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:22.608 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 12:37:22.609 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:22.609 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 12:37:22.609 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42830a0) pid(9223/9223) version 11:1:1:4 [ CSSD]2013-05-23 12:37:22.624 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42830a0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:37:22.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:37:22.624 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:37:22.624 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 12:37:22.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:22.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:23.085 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:23.085 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:37:24.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:24.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:24.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:24.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:26.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:26.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0697002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:26.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:26.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:26.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:37:26.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:26.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0698002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:26.701 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:26.701 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:26.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:26.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:26.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0699002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:28.088 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:28.088 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:28.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:28.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:28.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:30.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:30.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:30.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:32.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:32.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:32.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:33.091 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:33.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:33.809 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:37:33.810 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:33.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:37:33.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ae300) pid(10343) version 11:1:1:4 [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:33.816 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:33.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:37:33.822 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:33.822 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:33.822 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:34.025 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:37:34.025 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42aee40) skgpid ospid 10343 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:34.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:34.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:34.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:34.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:35.909 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:37:35.910 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:37:35.911 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:37:35.911 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42ae300) pid(10364) version 11:1:1:4 [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:35.927 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:35.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:37:35.934 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:35.934 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:35.934 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:36.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:37:36.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42b3350) skgpid ospid 10364 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:36.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:36.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:36.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:36.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069a002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:38.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:38.095 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:38.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:38.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:38.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:40.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:40.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:40.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:41.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069b002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:41.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:41.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:41.942 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:37:41.942 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:41.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(069c002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:41.949 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:41.949 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:42.097 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:42.098 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:37:42.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:42.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:42.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:44.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:44.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:44.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:44.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:45.469 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:37:45.470 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:37:45.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:37:45.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ae300) pid(4382/4382) version 11:1:1:4 [ CSSD]2013-05-23 12:37:45.476 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:37:45.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:37:45.477 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:37:45.477 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:37:45.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:37:45.503 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:37:45.503 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:37:45.503 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:37:45.504 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:37:45.504 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42aee40) skgpid 4382 ospid 4382 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:46.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:46.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:46.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:46.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069d002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:47.101 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:47.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:48.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:48.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:48.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:50.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:50.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:50.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:51.169 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:37:51.170 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:37:51.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:37:51.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42ae300) pid(10511) version 11:1:1:4 [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:37:51.177 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:51.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:37:51.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:37:51.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:37:51.184 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:37:51.386 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:37:51.386 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42b3350) skgpid ospid 10511 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:37:52.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:52.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:52.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:52.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:52.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:54.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:54.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:37:54.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:54.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:56.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:56.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:56.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:37:57.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069e002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:57.109 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:37:57.109 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:37:57.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069f002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:57.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:37:57.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:37:57.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:37:57.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:37:57.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a0002a) incarnation(174631051) [ CSSD]2013-05-23 12:37:57.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:37:57.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:37:58.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:37:58.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:37:58.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:00.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:01.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:01.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:02.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:02.112 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:02.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:03.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:03.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:04.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:04.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:05.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:05.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:06.430 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:38:06.431 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:38:06.432 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:38:06.432 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42ae300) pid(10669) version 11:1:1:4 [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ae300), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:06.439 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:06.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:38:06.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:38:06.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:06.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:06.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:06.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 12:38:06.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b427c5d0) skgpid ospid 10669 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:07.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:07.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:07.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a1002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:07.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:07.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:08.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:09.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:09.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:09.896 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(2/0x7f82b4207960) [ CSSD]2013-05-23 12:38:09.896 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:38:09.896 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:38:09.896 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 12:38:10.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:11.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:11.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:12.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:12.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:12.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a2002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:12.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:38:12.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:38:12.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:38:12.441 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:12.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a3002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:12.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:38:12.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:38:12.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:13.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:13.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:14.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:14.709 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:15.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:15.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:16.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:17.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a4002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:17.122 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:17.122 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:17.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:17.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:17.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:38:17.282 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:17.283 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:38:17.283 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42573d0) pid(10793) version 11:1:1:4 [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:17.289 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:17.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:38:17.296 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:38:17.296 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:17.296 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:17.498 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:38:17.498 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b427c5d0) skgpid ospid 10793 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:18.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:19.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:19.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:20.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:21.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:21.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:21.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a5002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:21.322 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:38:21.322 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:38:21.322 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:38:21.322 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:21.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a6002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:21.329 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:38:21.329 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:38:21.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:38:21.692 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:38:21.692 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:38:21.692 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42573d0) pid(10858) version 11:1:1:4 [ CSSD]2013-05-23 12:38:21.697 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:21.698 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:21.704 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:38:21.704 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:38:21.704 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:21.705 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:21.907 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:38:21.907 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42b3350) skgpid ospid 10858 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:22.125 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:22.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:22.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:23.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:23.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:24.559 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:38:24.560 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:24.560 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:38:24.560 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42573d0) pid(10917) version 11:1:1:4 [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41c8ba0 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:24.568 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:24.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:38:24.574 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:38:24.574 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:38:24.574 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:24.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:24.681 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:38:24.682 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:24.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:38:24.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429e330) pid(10922) version 11:1:1:4 [ CSSD]2013-05-23 12:38:24.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:38:24.701 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:38:24.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:38:24.704 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:38:24.704 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42b35f0) skgpid ospid 10922 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:24.728 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:24.777 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:38:24.777 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42b3350) skgpid ospid 10917 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:25.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:25.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:26.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:27.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a7002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:27.129 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:27.129 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:27.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:27.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:27.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a8002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:27.702 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:38:27.702 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:38:27.702 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:38:27.702 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:27.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a9002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:27.709 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:38:27.709 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:38:28.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:29.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:29.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:30.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:31.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:31.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:32.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:32.132 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:32.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:33.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:33.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:34.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:34.748 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:35.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:35.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:36.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:36.135 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:38:36.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:36.941 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:38:36.942 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:38:36.942 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:38:36.942 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42573d0) pid(11013) version 11:1:1:4 [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b35e0, requested num -1 [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:36.949 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:36.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:38:36.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:38:36.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:36.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:37.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06aa002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:37.160 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:38:37.160 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42b3350) skgpid ospid 11013 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:37.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:37.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:38.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:39.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:39.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:40.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:40.840 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:38:40.841 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:40.841 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:38:40.841 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42573d0) pid(11083/11083) version 11:1:1:4 [ CSSD]2013-05-23 12:38:40.857 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:38:40.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:38:40.857 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:38:40.857 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:38:40.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:38:40.877 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:38:40.877 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:38:40.877 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:38:40.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:38:40.878 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b427c5d0) skgpid 11083 ospid 11083 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:41.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3460) allocated [ CSSD]2013-05-23 12:38:41.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:41.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3460 - 1,2,3 [ CSSD]2013-05-23 12:38:41.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b3460) pid(11133/11133) version 11:1:1:4 [ CSSD]2013-05-23 12:38:41.045 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3460), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:38:41.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:38:41.045 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:38:41.045 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:38:41.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:41.138 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:41.232 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:38:41.233 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:38:41.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:38:41.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cf950) proc(0x7f82b429e330) pid(11099) version 11:1:1:4 [ CSSD]2013-05-23 12:38:41.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:41.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:41.805 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:38:41.805 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42cf950) skgpid ospid 11099 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:42.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:42.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ab002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:42.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:38:42.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:38:42.952 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:38:42.952 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:42.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ac002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:42.959 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:38:42.959 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:38:43.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:43.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:44.767 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:44.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:45.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:45.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:46.140 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:46.141 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:46.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:47.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ad002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:47.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:47.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:48.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:49.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:49.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:50.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:51.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:51.144 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:51.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:51.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:52.193 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:38:52.193 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:38:52.194 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:38:52.194 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42b5910) pid(11348) version 11:1:1:4 [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b429e330, requested num -1 [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:38:52.210 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:52.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:38:52.217 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:38:52.217 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:38:52.217 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:38:52.420 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:38:52.420 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42c7c00) skgpid ospid 11348 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:38:52.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:53.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:53.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:54.791 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:38:54.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:55.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:55.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:56.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:38:56.146 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:38:56.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:57.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ae002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:57.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:57.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:38:58.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06af002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:58.201 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:38:58.201 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:38:58.201 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:38:58.202 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:38:58.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b0002a) incarnation(174631051) [ CSSD]2013-05-23 12:38:58.208 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:38:58.208 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:38:58.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:38:59.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:38:59.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:00.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:00.149 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:39:00.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:01.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:01.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:02.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:03.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:03.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:04.813 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:04.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:05.151 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:05.152 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:05.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:05.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:06.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:07.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b1002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:07.452 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:07.453 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:39:07.454 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:07.454 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5910) pid(11494) version 11:1:1:4 [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:07.470 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:07.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:39:07.477 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:39:07.477 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e6d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:07.477 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e6d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:07.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:07.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:07.679 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:07.679 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42b3350) skgpid ospid 11494 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:09.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:09.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:09.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:10.154 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:10.154 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:10.932 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:10.933 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:39:10.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:10.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5910) pid(11561) version 11:1:1:4 [ CSSD]2013-05-23 12:39:11.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:11.062 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1d0) allocated [ CSSD]2013-05-23 12:39:11.062 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:39:11.063 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1d0 - 1,2,3 [ CSSD]2013-05-23 12:39:11.063 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42cd1d0) pid(11571) version 11:1:1:4 [ CSSD]2013-05-23 12:39:11.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:39:11.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:39:11.084 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1d0 [ CSSD]2013-05-23 12:39:11.084 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1d0) con(0x7f82b42bad40) skgpid ospid 11571 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5300/0x7f82b42cd480) [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5300 (0x7f82b42cd480) [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cd480 with con 0x7f82b429e8e0, requested num -1 [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:11.164 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:39:11.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5300 (0x7f82b42cd480) [ CSSD]2013-05-23 12:39:11.170 [1199044928] >TRACE: clssgmExitGrock: client 5300 (0x7f82b42cd480), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:39:11.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:39:11.170 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:11.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:11.171 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42b3350) skgpid ospid 11561 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:11.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:11.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:13.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:13.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b2002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:13.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:39:13.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:39:13.450 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:39:13.450 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:13.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b3002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:13.457 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:39:13.457 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:39:13.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:13.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:14.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:15.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:15.157 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:15.157 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:15.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:15.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:17.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:17.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b4002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:17.533 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:17.534 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:39:17.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:17.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42b5910) pid(11649) version 11:1:1:4 [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:17.541 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:17.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:39:17.547 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:39:17.547 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:17.547 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:17.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:17.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:17.750 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:17.750 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42c7c00) skgpid ospid 11649 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:19.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:19.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:19.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:20.160 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:20.160 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:21.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:21.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b5002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:21.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:39:21.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:39:21.590 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:39:21.590 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:21.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b6002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:21.597 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:39:21.597 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:39:21.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:21.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:22.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:22.714 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:39:22.714 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:22.714 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5910) pid(11696) version 11:1:1:4 [ CSSD]2013-05-23 12:39:22.720 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:39:22.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:39:22.720 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b429e6d0, requested num -1 [ CSSD]2013-05-23 12:39:22.720 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:22.720 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:39:22.721 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:22.721 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:22.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:39:22.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:39:22.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:22.728 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:22.930 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:22.930 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42b3350) skgpid ospid 11696 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:23.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:23.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:23.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:24.162 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:24.163 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:39:24.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:25.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:25.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:25.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:27.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:27.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b7002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:27.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:27.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:28.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b8002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:28.710 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:39:28.710 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:39:28.711 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:39:28.711 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:28.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b9002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:28.717 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:39:28.717 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:39:29.166 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:29.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:29.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:29.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:29.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:31.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:31.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:31.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:33.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:33.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:33.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:34.170 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:34.170 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:34.877 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:35.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:35.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:35.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:37.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:37.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ba002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:37.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:37.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:37.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:37.964 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:39:37.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:37.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5910) pid(11845) version 11:1:1:4 [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:37.970 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:37.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:39:37.977 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:39:37.977 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e6d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:37.977 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e6d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:38.180 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:38.180 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42b3350) skgpid ospid 11845 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:39.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:39.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:39.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:39.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:39.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:41.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:41.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:41.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:43.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:43.177 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:39:43.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:43.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06bb002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:43.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:39:43.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:39:43.960 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:39:43.960 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:43.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:43.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:43.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06bc002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:43.966 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:39:43.967 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:39:44.900 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:45.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:46.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:46.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:47.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:47.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06bd002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:48.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:48.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:48.180 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:48.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:49.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:50.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:50.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:51.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:52.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:52.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:53.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:53.184 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:39:53.213 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:39:53.213 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:39:53.214 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:39:53.214 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42b5910) pid(11991) version 11:1:1:4 [ CSSD]2013-05-23 12:39:53.219 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5910), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:39:53.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:39:53.219 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b429e330, requested num -1 [ CSSD]2013-05-23 12:39:53.219 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:53.219 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:39:53.220 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:39:53.220 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:53.226 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:39:53.226 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:39:53.226 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:39:53.226 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:39:53.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:53.428 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:39:53.428 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42c7c00) skgpid ospid 11991 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:39:54.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:54.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:54.922 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:39:55.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:56.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:56.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:57.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:39:57.187 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:39:57.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:39:57.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06be002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:58.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:39:58.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:39:59.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06bf002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:59.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:39:59.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:39:59.209 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:39:59.209 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:39:59.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c0002a) incarnation(174631051) [ CSSD]2013-05-23 12:39:59.215 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:39:59.215 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:39:59.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:00.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:00.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:01.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:02.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:02.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:02.190 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:02.190 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:02.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:40:02.348 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:40:02.348 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:40:02.348 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:40:02.349 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3460 [ CSSD]2013-05-23 12:40:02.349 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3460) con(0x7f82b427c5d0) skgpid 11133 ospid 11133 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:03.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:04.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:04.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:04.945 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:05.030 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 12:40:05.031 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:40:05.032 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 12:40:05.032 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42573d0) pid(12313/12313) version 11:1:1:4 [ CSSD]2013-05-23 12:40:05.048 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42573d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:40:05.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:40:05.048 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:40:05.048 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 12:40:05.346 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42b3350) skgpid 12313 ospid 12313 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:05.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:06.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:06.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:07.193 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:07.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:07.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:07.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c1002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:08.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:08.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:08.461 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:40:08.462 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:40:08.462 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:40:08.462 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42a3ad0) pid(12333) version 11:1:1:4 [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ad0), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42b3350, requested num -1 [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:40:08.468 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:08.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:40:08.473 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:40:08.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:08.474 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:40:08.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:40:08.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42c7c00) skgpid ospid 12333 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:09.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:10.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:10.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:11.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:12.196 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:12.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:12.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:12.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:13.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:14.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:14.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:14.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c2002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:14.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:40:14.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:40:14.467 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:40:14.467 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:14.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c3002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:14.474 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:40:14.474 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:40:14.966 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:15.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:16.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:16.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:17.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:17.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:17.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:17.799 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:40:17.800 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:40:17.801 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:40:17.801 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a3ad0) pid(12447) version 11:1:1:4 [ CSSD]2013-05-23 12:40:17.806 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ad0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b35e0, requested num -1 [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:40:17.807 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:17.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:40:17.813 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:40:17.813 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:17.813 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:40:17.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c4002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:18.015 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:40:18.015 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b427c5d0) skgpid ospid 12447 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:18.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:18.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:19.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:20.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:20.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:20.545 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:40:20.546 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:40:20.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:40:20.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a3ad0) pid(12431/12431) version 11:1:1:4 [ CSSD]2013-05-23 12:40:20.563 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ad0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:40:20.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:40:20.563 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:40:20.563 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:40:21.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:21.854 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 12:40:21.855 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:40:21.855 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 12:40:21.855 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cf950) proc(0x7f82b429e6d0) pid(11331/11331) version 11:1:1:4 [ CSSD]2013-05-23 12:40:21.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c5002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:21.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:40:21.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:40:21.867 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:40:21.867 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:21.871 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e6d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:40:21.872 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:40:21.872 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:40:21.872 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:40:21.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c6002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:21.876 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:40:21.876 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:40:22.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:22.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:22.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:22.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:23.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:23.718 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d430) allocated [ CSSD]2013-05-23 12:40:23.719 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:40:23.719 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d430 - 1,2,3 [ CSSD]2013-05-23 12:40:23.719 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b427d430) pid(12503) version 11:1:1:4 [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b427d430), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd240, requested num -1 [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:40:23.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:23.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:23.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:40:23.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:23.729 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:40:23.844 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d7e30) allocated [ CSSD]2013-05-23 12:40:23.845 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:40:23.846 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d7e30 - 1,2,3 [ CSSD]2013-05-23 12:40:23.846 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429eee0) proc(0x7f82b42d7e30) pid(11329/11329) version 11:1:1:4 [ CSSD]2013-05-23 12:40:23.862 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d7e30), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:40:23.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:40:23.862 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:40:23.862 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:40:23.930 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d430 [ CSSD]2013-05-23 12:40:23.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d430) con(0x7f82b42bad40) skgpid ospid 12503 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:24.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:24.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:24.994 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:25.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:26.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:26.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:27.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:27.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:27.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:27.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c7002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:28.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:28.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:29.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:29.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c8002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:29.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:40:29.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:40:29.719 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:40:29.719 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:29.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c9002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:29.726 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:40:29.726 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:40:30.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:30.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:31.056 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e6d0), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 12:40:31.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:40:31.056 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:40:31.056 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:40:31.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:32.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:32.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:32.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:32.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:33.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:34.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:34.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:35.013 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:35.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:36.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:36.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:37.212 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:37.212 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:37.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:37.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ca002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:38.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:38.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:38.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:40:38.963 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:40:38.964 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:40:38.964 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(12658) version 11:1:1:4 [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429ec50), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3790/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:40:38.970 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:38.976 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:40:38.976 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:40:38.976 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:38.976 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:40:39.178 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:40:39.178 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 12658 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:39.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:40.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:40.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:41.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:41.214 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:40:41.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:42.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:42.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:43.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:44.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:44.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:44.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06cb002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:44.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:40:44.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:40:44.968 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:40:44.968 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:44.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cc002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:44.975 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:40:44.975 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:40:45.034 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:45.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00d380) [ CSSD]2013-05-23 12:40:45.474 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00d380), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:40:45.474 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00d380), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:40:45.474 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:40:45.475 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00ce70 [ CSSD]2013-05-23 12:40:45.475 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00ce70) con(0x7f82ac0031c0) skgpid 4282 ospid 4282 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:45.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:46.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:46.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:46.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:46.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:47.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:47.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06cd002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:48.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:48.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:49.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ce002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:49.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:40:49.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:40:49.128 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:40:49.128 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:49.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cf002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:49.135 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:40:49.135 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:40:49.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:50.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:50.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:51.221 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:51.221 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:51.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:52.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:52.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:53.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:54.210 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:40:54.211 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:40:54.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:40:54.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b429ec50) pid(12815) version 11:1:1:4 [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:40:54.217 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:40:54.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:40:54.223 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:40:54.223 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:40:54.223 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:40:54.425 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:40:54.425 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42c7c00) skgpid ospid 12815 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:40:54.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:54.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:55.059 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:40:55.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:56.224 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:40:56.224 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:40:56.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:56.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:57.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:40:58.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d0002a) incarnation(174631051) [ CSSD]2013-05-23 12:40:58.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:40:58.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:40:59.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:00.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d1002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:00.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:00.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:00.218 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:00.218 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:00.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d2002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:00.225 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:00.225 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:00.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:00.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:01.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:01.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:01.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:02.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:02.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:03.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:04.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d3002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:04.018 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:04.018 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:04.018 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:41:04.018 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:04.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d4002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:04.025 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:04.025 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:04.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:41:04.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:41:04.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:41:04.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:41:04.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:04.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:05.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:06.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:06.231 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:06.231 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:06.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:06.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:08.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d5002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:08.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:08.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:08.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:09.458 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:09.459 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:41:09.459 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:09.459 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(12962) version 11:1:1:4 [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:41:09.465 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:09.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:41:09.471 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:41:09.471 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:09.471 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:41:09.673 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:09.673 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 12962 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:10.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:10.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:10.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:11.234 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:11.234 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:12.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:12.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:12.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:14.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:14.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:14.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:15.100 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:15.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d6002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:15.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:15.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:15.467 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:15.467 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:15.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d7002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:15.474 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:15.474 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:16.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:16.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:41:16.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:16.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(13046/13046) version 11:1:1:4 [ CSSD]2013-05-23 12:41:16.022 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:41:16.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:41:16.022 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:41:16.022 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:41:16.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:41:16.039 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:41:16.039 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:41:16.039 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:41:16.040 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:16.040 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid 13046 ospid 13046 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:16.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:16.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:16.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:16.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:16.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:18.056 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:18.057 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:41:18.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:18.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(13061) version 11:1:1:4 [ CSSD]2013-05-23 12:41:18.062 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:41:18.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:41:18.062 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:41:18.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:18.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:41:18.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:41:18.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:18.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d8002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:18.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:41:18.069 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:41:18.069 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:18.069 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:41:18.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:18.272 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:18.272 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 13061 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:18.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:18.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:20.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:20.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:20.240 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:41:21.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:21.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:22.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d9002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:22.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:22.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:22.127 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:22.127 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:22.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06da002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:22.133 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:22.133 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:22.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:23.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:23.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:24.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:24.705 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:24.706 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:41:24.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:24.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd080) proc(0x7f82b429ec50) pid(13147) version 11:1:1:4 [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d8220, requested num -1 [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:41:24.712 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:24.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:41:24.719 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:41:24.719 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:24.719 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:41:24.922 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:24.922 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42cd080) skgpid ospid 13147 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:25.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:25.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:25.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:25.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:25.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:26.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:27.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:27.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:28.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06db002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:28.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:29.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:29.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:30.246 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:30.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:30.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:30.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06dc002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:30.716 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:30.716 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:30.716 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:30.716 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:30.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06dd002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:30.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:30.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:31.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:31.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:32.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:33.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:33.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:34.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:35.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:35.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:35.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:35.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:35.250 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:36.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:37.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:37.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:38.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06de002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:38.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:39.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:39.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:39.955 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:39.955 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:41:39.956 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:39.956 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(13285) version 11:1:1:4 [ CSSD]2013-05-23 12:41:39.962 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:41:39.962 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:41:39.962 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:41:39.962 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:39.962 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:41:39.963 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:41:39.963 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:39.969 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:41:39.969 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:41:39.969 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:39.969 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:41:40.172 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:40.172 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 13285 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:40.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:40.253 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:40.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:41.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:41.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:42.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:43.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:43.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:44.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:45.185 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:45.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:45.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:45.256 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:45.256 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:45.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06df002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:45.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:45.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:45.965 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:45.965 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:45.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e0002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:45.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:45.972 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:46.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:47.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:47.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:48.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e1002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:48.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:49.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:49.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:50.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:50.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:50.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:51.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:51.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:52.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:53.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:53.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:54.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:55.205 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:41:55.206 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:41:55.206 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:41:55.206 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd080) proc(0x7f82b429ec50) pid(13437) version 11:1:1:4 [ CSSD]2013-05-23 12:41:55.207 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42d8220, requested num -1 [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:41:55.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:55.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:41:55.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:41:55.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:41:55.219 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:41:55.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:41:55.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:41:55.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:55.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:55.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:41:55.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42cd080) skgpid ospid 13437 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:41:56.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:57.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:57.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:41:58.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e2002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:58.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:41:59.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e3002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:59.095 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:41:59.095 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:41:59.095 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:41:59.095 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:41:59.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e4002a) incarnation(174631051) [ CSSD]2013-05-23 12:41:59.102 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:41:59.102 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:41:59.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:41:59.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:00.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:00.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:00.413 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:01.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e5002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:01.216 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:01.216 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:01.216 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:42:01.216 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:01.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e6002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:01.222 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:01.222 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:01.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:01.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:01.442 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:42:01.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:42:01.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:42:01.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:42:01.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e7002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:01.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:01.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:01.519 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:42:01.519 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:42:01.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e8002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:01.525 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:01.525 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:02.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:03.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:03.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:04.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:04.267 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:42:04.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:05.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:05.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:05.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:06.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:07.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:07.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:08.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e9002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:08.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:09.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:09.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:09.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:09.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:10.465 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:10.465 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:42:10.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:10.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(13603) version 11:1:1:4 [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:42:10.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:10.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:42:10.477 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:42:10.477 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:10.477 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:42:10.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:10.680 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:10.680 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 13603 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:11.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:11.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:11.845 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:11.846 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:42:11.846 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:11.846 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(13671) version 11:1:1:4 [ CSSD]2013-05-23 12:42:12.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:13.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:13.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:14.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:14.273 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:14.530 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:14.530 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 13671 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:14.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:15.252 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:15.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:15.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:16.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ea002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:16.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:16.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:16.475 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:42:16.475 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:16.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06eb002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:16.482 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:16.482 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:16.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:17.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:17.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:18.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ec002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:18.313 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:18.314 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:42:18.315 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:18.315 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14013) version 11:1:1:4 [ CSSD]2013-05-23 12:42:18.320 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:42:18.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:42:18.320 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:42:18.320 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:18.320 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:42:18.321 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:42:18.321 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:18.326 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:42:18.326 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:42:18.326 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:18.326 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:42:18.529 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:18.529 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14013 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:18.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:19.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:19.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:19.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:19.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:20.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:21.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:21.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:22.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ed002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:22.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:22.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:22.385 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:42:22.385 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:22.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ee002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:22.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:22.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:22.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:23.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:23.280 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:42:23.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:23.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:24.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:25.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:25.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:25.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:25.711 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:25.712 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:42:25.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:25.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14081) version 11:1:1:4 [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:42:25.718 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:25.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:42:25.725 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:42:25.725 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:25.725 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:42:25.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:25.928 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14081 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:26.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:27.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:27.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:28.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ef002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:28.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:28.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:28.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:29.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:29.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:30.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:31.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:31.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:31.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f0002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:31.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:31.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:31.724 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:42:31.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:31.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f1002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:31.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:31.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:32.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:33.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:33.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:33.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:33.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:34.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:35.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:35.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:35.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:36.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:37.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:37.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:38.289 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:38.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f2002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:38.290 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:38.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:39.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:39.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:40.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:40.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:40.972 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:42:40.973 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:40.973 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd080) proc(0x7f82b429ec50) pid(14253) version 11:1:1:4 [ CSSD]2013-05-23 12:42:40.978 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 12:42:40.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:42:40.979 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42d8220, requested num -1 [ CSSD]2013-05-23 12:42:40.979 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:40.979 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:42:40.979 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:42:40.979 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:40.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 12:42:40.986 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:42:40.986 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:40.987 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:42:41.189 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:41.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42cd080) skgpid ospid 14253 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:41.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:41.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:42.292 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:42.293 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:42:42.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:43.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:43.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:44.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:45.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:45.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:45.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:46.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:46.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f3002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:46.984 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:42:46.984 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:42:46.984 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:42:46.984 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:46.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f4002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:46.990 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:42:46.991 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:42:47.295 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:47.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:47.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:47.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:48.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f5002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:48.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:49.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:49.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:50.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:51.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:51.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:52.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:52.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:52.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:53.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:53.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:54.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:55.337 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:42:55.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:55.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:56.225 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:42:56.225 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:42:56.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:42:56.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14412) version 11:1:1:4 [ CSSD]2013-05-23 12:42:56.242 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:42:56.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:42:56.242 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:42:56.243 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:56.243 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:42:56.243 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:42:56.243 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:42:56.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:42:56.250 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:42:56.250 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:42:56.250 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:42:56.452 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:42:56.452 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14412 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:42:56.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:57.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:42:57.303 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:42:57.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:57.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:42:58.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f6002a) incarnation(174631051) [ CSSD]2013-05-23 12:42:58.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:42:59.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:42:59.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:00.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:01.306 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:01.306 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:43:01.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:01.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:02.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f7002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:02.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:43:02.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:43:02.243 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:43:02.243 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:02.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f8002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:02.250 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:43:02.250 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:43:02.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:03.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:03.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:05.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:05.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:05.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:05.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:06.310 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:06.310 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:07.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:08.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:08.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:08.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f9002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:09.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:10.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:10.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:11.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:11.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:11.314 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:11.495 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:11.495 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:43:11.496 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:11.496 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd080) proc(0x7f82b429ec50) pid(14549) version 11:1:1:4 [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d8220, requested num -1 [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:11.512 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:11.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:11.520 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:43:11.520 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:11.521 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:11.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:11.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42cd080) skgpid ospid 14549 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:12.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:12.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:13.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:14.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:14.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:15.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:15.384 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:16.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:16.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:16.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:16.317 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:17.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:17.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06fa002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:17.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:43:17.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:43:17.492 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:43:17.492 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:17.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06fb002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:17.498 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:43:17.498 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:43:18.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:18.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:18.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fc002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:18.577 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:18.578 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:18.578 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:18.578 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14652) version 11:1:1:4 [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:18.584 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:18.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:43:18.590 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:43:18.590 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:18.591 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:18.793 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:18.793 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14652 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:19.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:20.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:20.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:20.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:20.320 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:43:21.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:22.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:22.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:22.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06fd002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:22.641 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:43:22.641 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:43:22.641 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:43:22.641 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:22.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06fe002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:22.647 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:43:22.647 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:43:23.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:24.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:24.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:24.856 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:24.857 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:24.858 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:24.858 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14708) version 11:1:1:4 [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4204870 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:24.865 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:24.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:43:24.871 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:43:24.871 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:43:24.872 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:24.980 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42045f0) allocated [ CSSD]2013-05-23 12:43:24.981 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:24.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42045f0 - 1,2,3 [ CSSD]2013-05-23 12:43:24.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d80a0) proc(0x7f82b42045f0) pid(14713) version 11:1:1:4 [ CSSD]2013-05-23 12:43:24.996 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:43:24.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:43:25.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:43:25.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42045f0 [ CSSD]2013-05-23 12:43:25.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42045f0) con(0x7f82b42d80a0) skgpid ospid 14713 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:25.074 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:25.074 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14708 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:25.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:25.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:25.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:25.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:26.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:26.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:26.766 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:26.767 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:43:26.768 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:26.768 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b429ec50) pid(14740) version 11:1:1:4 [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42b3a60, requested num -1 [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:26.774 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:26.780 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:43:26.780 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:43:26.780 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d80a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:26.781 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d80a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:26.983 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:26.983 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42bad40) skgpid ospid 14740 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:27.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:28.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:28.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:28.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ff002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:29.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:30.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:30.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:30.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:30.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:31.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:32.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:32.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:32.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0700002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:32.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:43:32.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:43:32.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:43:32.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:32.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0701002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:32.746 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:43:32.746 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:43:33.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:34.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:34.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:35.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:35.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:35.330 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:35.466 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:36.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:36.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:37.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:38.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:38.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:38.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0702002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:39.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:40.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:40.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:40.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:40.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:40.646 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:40.646 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:40.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:40.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b429ec50) pid(14899) version 11:1:1:4 [ CSSD]2013-05-23 12:43:41.250 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:41.250 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42c7c00) skgpid ospid 14899 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:41.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:42.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ec50) allocated [ CSSD]2013-05-23 12:43:42.016 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:43:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ec50 - 1,2,3 [ CSSD]2013-05-23 12:43:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd080) proc(0x7f82b429ec50) pid(15000) version 11:1:1:4 [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ec50), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d8220, requested num -1 [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:42.022 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:42.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:42.029 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:43:42.029 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:42.029 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:42.232 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ec50 [ CSSD]2013-05-23 12:43:42.232 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ec50) con(0x7f82b42cd080) skgpid ospid 15000 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:42.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:42.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:43.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:44.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:44.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:45.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:45.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:45.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:45.488 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:46.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:46.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:47.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:48.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0703002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:48.010 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:43:48.010 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:43:48.010 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:43:48.010 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:48.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0704002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:48.017 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:43:48.017 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:43:48.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:48.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:48.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0705002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:49.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:50.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:43:50.048 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:43:50.048 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:43:50.049 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:43:50.049 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 12:43:50.049 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b4257120) skgpid 9223 ospid 9223 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:50.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:43:50.051 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:43:50.051 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:43:50.051 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:43:50.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:43:50.062 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:43:50.062 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:43:50.062 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 12:43:50.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 12:43:50.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid 9225 ospid 9225 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:50.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:50.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:50.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:50.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:50.859 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 12:43:50.860 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:50.861 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 12:43:50.861 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42830a0) pid(15166/15166) version 11:1:1:4 [ CSSD]2013-05-23 12:43:50.866 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42830a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:43:50.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:43:50.866 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:43:50.866 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 12:43:51.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:52.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:52.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:53.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:54.242 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:43:54.242 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:43:54.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:43:54.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42b5b40) pid(15157/15157) version 11:1:1:4 [ CSSD]2013-05-23 12:43:54.248 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b5b40), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:54.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:43:54.248 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:43:54.248 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:43:54.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:54.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:55.342 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:55.342 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:43:55.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:55.507 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:43:56.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:56.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:57.264 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:43:57.265 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:43:57.265 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:43:57.265 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429ecb0) pid(15216) version 11:1:1:4 [ CSSD]2013-05-23 12:43:57.270 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:43:57.270 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:43:57.270 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 12:43:57.270 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:57.270 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:43:57.271 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:43:57.271 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:43:57.276 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:43:57.276 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:43:57.276 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:43:57.276 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:43:57.479 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:43:57.479 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4207f10) skgpid ospid 15216 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:43:57.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:43:58.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:43:58.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:43:58.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0706002a) incarnation(174631051) [ CSSD]2013-05-23 12:43:59.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:43:59.344 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:43:59.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:00.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:00.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:01.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:02.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:02.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:03.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0707002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:03.259 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:44:03.259 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:44:03.259 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:44:03.259 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:03.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0708002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:03.266 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:44:03.266 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:44:03.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:04.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:04.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:04.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:04.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:05.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:05.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:06.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:06.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:07.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:08.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0709002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:08.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:08.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:09.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:09.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:09.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:10.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:10.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:11.248 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:44:11.249 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:44:11.250 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:44:11.250 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b429ecb0) pid(15360) version 11:1:1:4 [ CSSD]2013-05-23 12:44:11.367 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4203a80) allocated [ CSSD]2013-05-23 12:44:11.368 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:44:11.369 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4203a80 - 1,2,3 [ CSSD]2013-05-23 12:44:11.369 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b4203a80) pid(15378) version 11:1:1:4 [ CSSD]2013-05-23 12:44:11.385 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:44:11.386 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:44:11.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4203a80 [ CSSD]2013-05-23 12:44:11.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4203a80) con(0x7f82b4207f10) skgpid ospid 15378 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5301/0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5301 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cbf40 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d3540/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:11.470 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:44:11.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5301 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:11.475 [1199044928] >TRACE: clssgmExitGrock: client 5301 (0x7f82b42cbf40), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:44:11.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8470) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:44:11.476 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42d8470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:11.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:44:11.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b42c7c00) skgpid ospid 15360 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:11.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:12.509 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 12:44:12.510 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:44:12.510 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 12:44:12.510 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42b3800) pid(15394) version 11:1:1:4 [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3800), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d80a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:12.516 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:12.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:12.523 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:44:12.523 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3a20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:12.523 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3a20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:12.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:12.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:12.725 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 12:44:12.725 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b42c7c00) skgpid ospid 15394 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:13.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:14.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:14.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:14.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:14.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:15.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:15.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:16.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:16.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:17.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:18.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(070a002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:18.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:44:18.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:44:18.511 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:44:18.511 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:18.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(070b002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:18.518 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:44:18.518 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:44:18.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:18.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:18.829 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:44:18.830 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:44:18.831 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:44:18.831 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429ecb0) pid(15480) version 11:1:1:4 [ CSSD]2013-05-23 12:44:18.837 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:18.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:18.837 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 12:44:18.837 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:18.837 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:44:18.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:18.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:18.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:18.845 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:44:18.845 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:18.845 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:19.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:44:19.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4207f10) skgpid ospid 15480 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:19.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:19.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:19.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:20.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070c002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:20.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:20.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:21.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:22.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:22.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:22.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(070d002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:22.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:44:22.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:44:22.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:44:22.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:22.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(070e002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:22.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:44:22.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:44:23.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:23.359 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:44:23.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:24.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:24.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:25.584 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:25.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:26.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:26.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:27.760 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:44:27.761 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:44:27.762 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:44:27.762 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429ecb0) pid(15554) version 11:1:1:4 [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:27.768 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:27.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:44:27.774 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:44:27.774 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:27.774 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:27.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:27.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:44:27.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4257120) skgpid ospid 15554 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:28.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:28.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:28.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:28.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:29.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:30.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070f002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:30.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:30.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:31.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:32.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:32.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:33.365 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:33.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:33.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0710002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:33.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:44:33.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:44:33.760 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:44:33.760 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:33.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0711002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:33.767 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:44:33.767 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:44:33.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:34.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:34.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:35.604 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:35.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:36.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:36.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:37.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:38.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:38.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:38.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:38.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:39.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:40.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0712002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:40.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:40.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:42.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:42.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:42.371 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:44:42.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:42.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:43.011 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:44:43.012 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:44:43.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:44:43.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b429ecb0) pid(15689) version 11:1:1:4 [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:43.019 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:43.026 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:44:43.026 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:44:43.026 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:43.026 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:43.229 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:44:43.229 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b42c7c00) skgpid ospid 15689 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:44.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:44.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:44.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:45.625 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:46.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:46.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:46.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:47.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:47.374 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:48.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:48.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:48.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:49.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0713002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:49.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:44:49.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:44:49.019 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:44:49.019 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:49.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0714002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:49.026 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:44:49.026 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:44:50.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:50.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0715002a) incarnation(174631051) [ CSSD]2013-05-23 12:44:50.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:50.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:52.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:52.377 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:52.377 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:52.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:52.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:54.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:54.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:54.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:55.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:44:56.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:56.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:56.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:44:57.381 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:44:57.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:44:58.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:44:58.262 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:44:58.263 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:44:58.263 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:44:58.263 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429ecb0) pid(15841) version 11:1:1:4 [ CSSD]2013-05-23 12:44:58.269 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:58.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:58.269 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 12:44:58.269 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:58.269 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:44:58.270 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:44:58.270 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:44:58.276 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:44:58.276 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:44:58.276 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:44:58.276 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:44:58.479 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:44:58.479 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4257120) skgpid ospid 15841 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:44:58.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:44:58.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:00.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:00.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0716002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:01.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:01.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:01.383 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:01.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:45:02.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:03.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:03.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:04.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:04.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0717002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:04.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:45:04.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:45:04.267 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:45:04.267 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:04.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0718002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:04.274 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:45:04.274 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:45:04.491 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:45:04.492 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:45:04.493 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:45:04.493 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429ecb0) pid(15931/15931) version 11:1:1:4 [ CSSD]2013-05-23 12:45:04.498 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:04.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:04.498 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:45:04.498 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:45:04.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:04.796 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:45:04.796 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:45:04.797 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:45:04.797 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:45:04.797 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4257120) skgpid 15931 ospid 15931 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:05.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:05.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:05.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:06.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:06.387 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:06.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:07.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:07.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:08.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:09.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:09.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:10.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:10.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0719002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:11.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:11.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:11.390 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:11.391 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:12.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:13.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:13.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:13.511 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:45:13.512 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:45:13.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:45:13.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429ecb0) pid(16002) version 11:1:1:4 [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:45:13.519 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:13.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:13.526 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:45:13.526 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8540) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:13.526 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8540) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:45:13.729 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:45:13.729 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4207f10) skgpid ospid 16002 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:14.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:15.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:15.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:15.694 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:16.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:16.394 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:16.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:17.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:17.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:18.061 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ecb0) allocated [ CSSD]2013-05-23 12:45:18.061 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:45:18.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ecb0 - 1,2,3 [ CSSD]2013-05-23 12:45:18.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429ecb0) pid(16069/16069) version 11:1:1:4 [ CSSD]2013-05-23 12:45:18.078 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:45:18.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:45:18.078 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:45:18.078 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:45:18.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:19.098 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:45:19.099 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:45:19.100 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:45:19.100 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4204520) pid(16095) version 11:1:1:4 [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4204520), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d82f0, requested num -1 [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:45:19.106 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:19.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:19.113 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:45:19.113 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:19.113 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:45:19.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:19.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:19.316 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:45:19.316 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b4257120) skgpid ospid 16095 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:19.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(071a002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:19.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:45:19.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:45:19.516 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:45:19.516 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:19.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(071b002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:19.522 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:45:19.522 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:45:20.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:20.397 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:20.398 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:45:20.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071c002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:21.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:21.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:22.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:23.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(071d002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:23.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:45:23.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:45:23.165 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:45:23.165 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:23.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(071e002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:23.171 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:45:23.171 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:45:23.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:23.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:24.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:25.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:25.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:25.401 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:25.401 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:25.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:26.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:27.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:27.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:28.413 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:28.758 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:45:28.759 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:45:28.759 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:45:28.759 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4204520) pid(16192) version 11:1:1:4 [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4204520), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42d82f0, requested num -1 [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:45:28.766 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:28.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:28.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:45:28.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:28.773 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:45:28.976 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:45:28.976 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b42c6340) skgpid ospid 16192 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:29.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:29.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:30.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:30.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:30.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:30.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071f002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:31.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:31.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:32.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:33.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:33.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:34.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:34.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0720002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:34.773 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:45:34.773 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:45:34.773 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:45:34.773 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:34.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0721002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:34.780 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:45:34.780 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:45:35.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:35.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:35.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:35.409 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:35.745 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:36.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:37.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:37.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:38.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:39.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:39.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:39.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:39.411 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:45:40.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0722002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:40.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:40.992 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204520) allocated [ CSSD]2013-05-23 12:45:40.993 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:45:40.994 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204520 - 1,2,3 [ CSSD]2013-05-23 12:45:40.994 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4204520) pid(16059/16059) version 11:1:1:4 [ CSSD]2013-05-23 12:45:41.000 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4204520), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:45:41.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:45:41.000 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:45:41.000 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:45:41.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:41.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:42.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:42.893 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8950) allocated [ CSSD]2013-05-23 12:45:42.893 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:45:42.894 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8950 - 1,2,3 [ CSSD]2013-05-23 12:45:42.894 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd860) proc(0x7f82b42c8950) pid(16057/16057) version 11:1:1:4 [ CSSD]2013-05-23 12:45:42.910 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c8950), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:45:42.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:45:42.910 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:45:42.910 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:45:43.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:43.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:43.800 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4204520), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:43.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:45:43.801 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:45:43.801 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:45:44.018 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caec0) allocated [ CSSD]2013-05-23 12:45:44.019 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:45:44.019 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caec0 - 1,2,3 [ CSSD]2013-05-23 12:45:44.019 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c97a0) proc(0x7f82b42caec0) pid(16339) version 11:1:1:4 [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42caec0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42caff0, requested num -1 [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:45:44.026 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:44.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:44.033 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:45:44.033 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:44.033 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:45:44.236 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caec0 [ CSSD]2013-05-23 12:45:44.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caec0) con(0x7f82b42c97a0) skgpid ospid 16339 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:44.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:44.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:44.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:45.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:45.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:45.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:46.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:47.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:47.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:48.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:49.417 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:49.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:49.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:49.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:50.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0723002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:50.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:45:50.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:45:50.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:45:50.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:50.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0724002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:50.031 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:45:50.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:45:50.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0725002a) incarnation(174631051) [ CSSD]2013-05-23 12:45:50.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:51.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:51.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:52.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:53.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:53.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:54.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:54.421 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:45:54.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:55.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:55.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:55.793 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:45:56.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:57.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:57.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:45:58.424 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:45:58.424 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:45:58.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:45:59.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf70) allocated [ CSSD]2013-05-23 12:45:59.283 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:45:59.283 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf70 - 1,2,3 [ CSSD]2013-05-23 12:45:59.283 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9850) proc(0x7f82b42caf70) pid(16486) version 11:1:1:4 [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42caf70), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42dc6a0, requested num -1 [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcdd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:45:59.289 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:45:59.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:45:59.295 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:45:59.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd0d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:45:59.295 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd0d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:45:59.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf70 [ CSSD]2013-05-23 12:45:59.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf70) con(0x7f82b42c9850) skgpid ospid 16486 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:45:59.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:45:59.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:00.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0726002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:00.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:01.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:01.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:02.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:03.427 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:03.427 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:03.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:03.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:04.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0727002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:04.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:04.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:04.315 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:46:04.315 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:04.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0728002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:04.322 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:04.322 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:04.451 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:46:04.452 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:46:04.453 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:46:04.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:46:04.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:05.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0729002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:05.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:05.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:05.275 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:46:05.275 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:05.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072a002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:05.281 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:05.281 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:05.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:05.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:05.826 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:06.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:07.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:07.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:08.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:08.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:08.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:09.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:09.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:10.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072b002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:10.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:11.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:11.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:12.434 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:12.434 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:46:12.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:13.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:13.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:14.530 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc780) allocated [ CSSD]2013-05-23 12:46:14.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:46:14.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc780 - 1,2,3 [ CSSD]2013-05-23 12:46:14.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8fb0) proc(0x7f82b42dc780) pid(16620) version 11:1:1:4 [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc780), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42c9150, requested num -1 [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:46:14.549 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:14.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:14.556 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:46:14.556 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:14.556 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:46:14.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc780 [ CSSD]2013-05-23 12:46:14.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc780) con(0x7f82b42c8fb0) skgpid ospid 16620 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:14.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:15.464 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd050) allocated [ CSSD]2013-05-23 12:46:15.465 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:46:15.465 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd050 - 1,2,3 [ CSSD]2013-05-23 12:46:15.465 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc170) proc(0x7f82b42dd050) pid(16672/16672) version 11:1:1:4 [ CSSD]2013-05-23 12:46:15.471 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dd050), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:15.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:15.472 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:46:15.472 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd050 [ CSSD]2013-05-23 12:46:15.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd050) con(0x7f82b42dc170) skgpid 16672 ospid 16672 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:15.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:15.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:15.848 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:17.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:17.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:17.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:17.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:17.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:19.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:19.363 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf70) allocated [ CSSD]2013-05-23 12:46:19.364 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:46:19.364 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf70 - 1,2,3 [ CSSD]2013-05-23 12:46:19.364 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9850) proc(0x7f82b42caf70) pid(16723) version 11:1:1:4 [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42caf70), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42c92d0, requested num -1 [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:46:19.381 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:19.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:19.388 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:46:19.388 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:19.388 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:46:19.591 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf70 [ CSSD]2013-05-23 12:46:19.591 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf70) con(0x7f82b42c9850) skgpid ospid 16723 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:19.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:19.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:20.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:46:20.080 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:46:20.080 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:46:20.080 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42cf950) skgpid 11331 ospid 11331 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d7e30 [ CSSD]2013-05-23 12:46:20.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d7e30) con(0x7f82b429eee0) skgpid 11329 ospid 11329 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:20.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072c002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:20.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:20.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:20.535 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:46:20.535 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:20.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072d002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:20.541 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:20.541 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:20.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072e002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:21.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:21.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:21.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:22.144 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 12:46:22.144 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:46:22.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 12:46:22.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429dac0) pid(16747/16747) version 11:1:1:4 [ CSSD]2013-05-23 12:46:22.151 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429dac0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:22.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:46:22.151 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:46:22.151 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:46:22.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:22.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:23.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:23.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072f002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:23.425 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:23.425 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:23.425 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:46:23.425 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:23.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0730002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:23.431 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:23.431 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:23.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:23.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:25.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:25.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:25.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:25.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:27.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:27.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:27.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:27.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:27.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:29.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:29.796 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d1f0) allocated [ CSSD]2013-05-23 12:46:29.797 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:46:29.797 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d1f0 - 1,2,3 [ CSSD]2013-05-23 12:46:29.797 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b427d1f0) pid(16822) version 11:1:1:4 [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b427d1f0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:46:29.804 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:29.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:29.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:29.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:46:29.811 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:46:29.811 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:29.811 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:46:30.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d1f0 [ CSSD]2013-05-23 12:46:30.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d1f0) con(0x7f82b42a1b40) skgpid ospid 16822 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:30.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0731002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:31.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:31.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:31.448 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:46:31.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:31.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:33.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:33.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:33.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:35.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:35.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0732002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:35.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:35.783 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:35.783 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:46:35.783 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:35.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0733002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:35.791 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:35.791 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:35.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:35.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:35.891 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:36.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:36.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:37.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:37.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:37.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:39.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:39.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:39.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:40.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0734002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:41.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:41.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:41.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:41.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:41.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:43.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:43.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:43.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:45.057 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d1f0) allocated [ CSSD]2013-05-23 12:46:45.058 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:46:45.058 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d1f0 - 1,2,3 [ CSSD]2013-05-23 12:46:45.058 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b427d1f0) pid(16971) version 11:1:1:4 [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b427d1f0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a1b40, requested num -1 [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:46:45.075 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:45.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:46:45.082 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:46:45.082 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:46:45.082 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:46:45.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:45.284 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d1f0 [ CSSD]2013-05-23 12:46:45.284 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d1f0) con(0x7f82b42b59d0) skgpid ospid 16971 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:46:45.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:45.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:45.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:46.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:46.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:47.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:48.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:48.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:49.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:50.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:50.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:50.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:50.460 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:46:50.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0735002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:51.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0736002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:51.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:46:51.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:46:51.033 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:46:51.033 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:46:51.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0737002a) incarnation(174631051) [ CSSD]2013-05-23 12:46:51.039 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:46:51.039 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:46:51.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:52.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:52.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:53.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d1f0) allocated [ CSSD]2013-05-23 12:46:53.043 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:46:53.043 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d1f0 - 1,2,3 [ CSSD]2013-05-23 12:46:53.043 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b427d1f0) pid(17068/17068) version 11:1:1:4 [ CSSD]2013-05-23 12:46:53.060 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b427d1f0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:46:53.060 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:46:53.060 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:46:53.060 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:46:53.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:54.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:54.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:55.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:55.464 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:46:55.464 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:46:55.945 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:46:56.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:56.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:57.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:46:58.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:46:58.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:46:59.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:00.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:00.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:00.329 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 12:47:00.329 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:47:00.330 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 12:47:00.330 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42dc520) pid(17116) version 11:1:1:4 [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc520), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42caea0, requested num -1 [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:00.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:00.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:00.344 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:00.344 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dced0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:00.344 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dced0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:00.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:00.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:00.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 12:47:00.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42b59d0) skgpid ospid 17116 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:00.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0738002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:01.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:01.759 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:47:01.759 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:47:01.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:47:01.762 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:47:01.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0739002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:01.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:01.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:01.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:47:01.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:47:01.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073a002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:01.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:01.846 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:02.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:02.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:03.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:04.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:04.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:04.661 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 12:47:04.662 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:47:04.662 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 12:47:04.662 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8050) proc(0x7f82b42dc520) pid(17202) version 11:1:1:4 [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc520), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42c8100, requested num -1 [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcb00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:04.669 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:04.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:47:04.676 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:04.676 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dce00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:04.676 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dce00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:04.878 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 12:47:04.878 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42c8050) skgpid ospid 17202 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:05.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:05.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:05.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:05.967 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:06.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:06.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:06.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(073b002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:06.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:06.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:06.294 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:47:06.294 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:06.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073c002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:06.301 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:06.301 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:07.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:08.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:08.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:09.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:09.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:09.474 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:47:10.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:10.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:10.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073d002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:11.263 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 12:47:11.264 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:47:11.264 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 12:47:11.264 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8370) proc(0x7f82b42dc520) pid(17296) version 11:1:1:4 [ CSSD]2013-05-23 12:47:11.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:12.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:12.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:13.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:13.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 12:47:13.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42c8370) skgpid ospid 17296 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:14.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:14.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:14.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:14.476 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:14.869 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429ecb0), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 12:47:14.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:47:14.869 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:47:14.869 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:47:15.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:15.575 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc850) allocated [ CSSD]2013-05-23 12:47:15.576 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:47:15.576 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc850 - 1,2,3 [ CSSD]2013-05-23 12:47:15.577 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c99f0) proc(0x7f82b42dc850) pid(17629) version 11:1:1:4 [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc850), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42dc770, requested num -1 [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:15.582 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:15.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:15.587 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:15.587 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:15.587 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:15.790 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc850 [ CSSD]2013-05-23 12:47:15.790 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc850) con(0x7f82b42c99f0) skgpid ospid 17629 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:15.986 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:16.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:16.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:17.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:18.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:18.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:19.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:19.479 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:19.479 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:19.631 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc850) allocated [ CSSD]2013-05-23 12:47:19.632 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:47:19.633 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc850 - 1,2,3 [ CSSD]2013-05-23 12:47:19.633 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c99f0) proc(0x7f82b42dc850) pid(17704) version 11:1:1:4 [ CSSD]2013-05-23 12:47:19.649 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc850), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:47:19.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:19.649 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42dc770, requested num -1 [ CSSD]2013-05-23 12:47:19.649 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:19.649 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:19.650 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:19.650 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:19.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:19.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:19.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:19.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:19.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc850 [ CSSD]2013-05-23 12:47:19.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc850) con(0x7f82b42c99f0) skgpid ospid 17704 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:20.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:20.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:20.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073e002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:21.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:21.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(073f002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:21.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:21.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:21.544 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:47:21.544 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:21.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0740002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:21.550 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:21.550 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:22.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:22.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:23.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:23.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0741002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:23.684 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:23.684 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:23.684 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:47:23.684 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:23.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0742002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:23.690 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:23.690 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d1f0 [ CSSD]2013-05-23 12:47:24.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d1f0) con(0x7f82b4257120) skgpid 17068 ospid 17068 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:24.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:24.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:24.482 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:24.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:25.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:26.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:26.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:26.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:27.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:28.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:28.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:29.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:29.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:29.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:30.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:30.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:30.823 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:47:30.824 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:47:30.825 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:47:30.825 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429e330) pid(17805) version 11:1:1:4 [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b429e330), client(1/0x7f82b4207960) [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a1b40, requested num -1 [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9520/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:30.831 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:30.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 12:47:30.838 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:30.838 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:30.838 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:30.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0743002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:31.040 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:47:31.040 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b4257120) skgpid ospid 17805 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:31.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:32.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:32.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:33.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:34.153 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 12:47:34.154 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:47:34.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 12:47:34.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b429e6d0) pid(17866) version 11:1:1:4 [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b429e6d0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42d7fb0, requested num -1 [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c95f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:34.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:34.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:47:34.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:34.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c98f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:34.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c98f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:34.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 12:47:34.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42a1b40) skgpid ospid 17866 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:34.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:34.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:34.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:34.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:35.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:36.027 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:36.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:36.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:36.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0744002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:36.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:36.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:36.803 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:47:36.803 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:36.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0745002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:36.810 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:36.810 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:37.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:38.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:38.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:39.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:39.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:39.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:40.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:40.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:41.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0746002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:41.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:42.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:42.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:43.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:44.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:44.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:44.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:44.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:45.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:47:45.650 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:47:45.650 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:47:45.650 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:47:45.650 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:47:45.650 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b427c5d0) skgpid 12431 ospid 12431 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:45.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:46.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:46.076 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:47:46.077 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:47:46.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:47:46.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42583a0) pid(17952) version 11:1:1:4 [ CSSD]2013-05-23 12:47:46.082 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42583a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:47:46.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:47:46.082 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a3ad0, requested num -1 [ CSSD]2013-05-23 12:47:46.082 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:46.082 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:47:46.083 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:47:46.083 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:46.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:47:46.089 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:47:46.089 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:47:46.089 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:47:46.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:47:46.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427c5d0) skgpid ospid 17952 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:47:46.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:46.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:47.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:48.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:48.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:49.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:49.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:49.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:50.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:50.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:51.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0747002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:51.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:52.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0748002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:52.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:47:52.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:47:52.053 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:47:52.053 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:47:52.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0749002a) incarnation(174631051) [ CSSD]2013-05-23 12:47:52.060 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:47:52.060 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:47:52.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:52.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:53.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:54.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:54.502 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:54.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:54.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:55.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:56.072 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:47:56.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:56.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:57.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:47:58.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:47:58.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:47:59.504 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:47:59.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:47:59.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:00.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:00.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:01.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074a002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:01.332 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:48:01.333 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:48:01.334 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:48:01.334 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42583a0) pid(18105) version 11:1:1:4 [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42583a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:01.351 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:01.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:01.358 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:48:01.358 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:01.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:01.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:48:01.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42b3350) skgpid ospid 18105 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:01.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:02.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:02.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:03.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:04.508 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:04.508 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:04.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:04.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:05.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:06.093 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:06.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:06.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:07.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(074b002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:07.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:48:07.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:48:07.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:48:07.303 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:07.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(074c002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:07.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:48:07.310 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:48:07.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:08.011 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b429dac0), client(2/0x7f82b4207960) [ CSSD]2013-05-23 12:48:08.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:48:08.012 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:48:08.012 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:48:08.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:08.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:09.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:09.512 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:09.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:10.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:10.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:11.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074d002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:11.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:12.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:12.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:13.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:13.514 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:48:13.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:14.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:14.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:15.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:16.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:16.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:16.595 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:48:16.596 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:16.596 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3cd0) proc(0x7f82b42a3ad0) pid(18262) version 11:1:1:4 [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:16.613 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:16.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:48:16.620 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:48:16.620 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:16.620 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:16.822 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:16.822 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42b3cd0) skgpid ospid 18262 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:16.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:16.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:17.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:18.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:18.517 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:18.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:18.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:19.896 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:19.896 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:19.897 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:19.897 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a3ad0) pid(18323) version 11:1:1:4 [ CSSD]2013-05-23 12:48:19.914 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:48:19.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:19.914 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:48:19.914 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:19.914 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:48:19.915 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:19.915 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:19.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:19.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:48:19.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:19.922 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:19.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:20.124 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:20.124 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b427c5d0) skgpid ospid 18323 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:21.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:21.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:21.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074e002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:21.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:22.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(074f002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:22.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:48:22.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:48:22.553 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:48:22.553 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:22.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0750002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:22.559 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:48:22.559 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:48:23.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:23.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:23.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:23.520 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:23.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0751002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:23.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:48:23.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:48:23.943 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:48:23.943 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:23.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0752002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:23.950 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:48:23.951 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:48:23.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:25.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:25.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:25.148 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:25.149 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:25.150 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:25.150 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a3ad0) pid(18372) version 11:1:1:4 [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42adc50 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:25.157 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:25.164 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:25.164 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:48:25.164 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:48:25.164 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:25.272 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 12:48:25.273 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:25.274 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 12:48:25.274 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b427d340) pid(18377) version 11:1:1:4 [ CSSD]2013-05-23 12:48:25.289 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:48:25.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:48:25.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:48:25.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 12:48:25.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b42a1b40) skgpid ospid 18377 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:25.367 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:25.367 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b4257120) skgpid ospid 18372 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:25.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:26.134 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:27.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:27.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:28.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:28.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:28.524 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:28.728 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:28.729 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:28.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:28.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42583a0) proc(0x7f82b42a3ad0) pid(18435/18435) version 11:1:1:4 [ CSSD]2013-05-23 12:48:28.734 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:48:28.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:28.734 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:48:28.734 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:28.774 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42583a0) skgpid 18435 ospid 18435 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:28.958 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ba0) allocated [ CSSD]2013-05-23 12:48:28.959 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:28.959 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ba0 - 1,2,3 [ CSSD]2013-05-23 12:48:28.959 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3da0) proc(0x7f82b42a3ba0) pid(18438/18438) version 11:1:1:4 [ CSSD]2013-05-23 12:48:28.975 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ba0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:48:28.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:48:28.975 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:48:28.975 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ba0 [ CSSD]2013-05-23 12:48:29.021 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ba0) con(0x7f82b42b3da0) skgpid 18438 ospid 18438 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:29.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:29.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:30.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:31.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:31.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:31.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0753002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:31.860 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:31.861 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:48:31.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:31.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a3ad0) pid(18464) version 11:1:1:4 [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:31.868 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:31.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:31.874 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:48:31.874 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:31.874 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:32.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:32.077 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:32.077 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b427c5d0) skgpid ospid 18464 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:32.526 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:32.526 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:48:33.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:33.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:34.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:35.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:35.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:36.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:36.154 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:37.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:37.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:37.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:37.529 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:37.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0754002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:37.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:48:37.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:48:37.813 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:48:37.813 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:37.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0755002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:37.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:48:37.820 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:48:38.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:39.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:39.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:40.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:41.112 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:41.112 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:41.113 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:41.113 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42583a0) proc(0x7f82b42a3ad0) pid(18578) version 11:1:1:4 [ CSSD]2013-05-23 12:48:41.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:41.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:41.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0756002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:41.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:41.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42583a0) skgpid ospid 18578 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:42.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:42.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:42.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:43.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:43.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:44.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:45.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:45.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:46.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:46.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:47.109 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:47.110 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:48:47.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:47.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3cd0) proc(0x7f82b42a3ad0) pid(18769) version 11:1:1:4 [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:48:47.117 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:47.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:48:47.123 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:48:47.123 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:48:47.123 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:48:47.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:47.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:47.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:48:47.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42b3cd0) skgpid ospid 18769 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:48:47.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:47.537 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:48.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:49.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:49.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:50.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:51.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0757002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:51.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:51.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:51.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:51.540 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:48:52.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:52.737 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 12:48:52.737 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:52.738 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 12:48:52.738 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3cd0) proc(0x7f82b42a3ad0) pid(18845/18845) version 11:1:1:4 [ CSSD]2013-05-23 12:48:52.753 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:48:52.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:48:52.753 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:48:52.753 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:48:53.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0758002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:53.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:48:53.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:48:53.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:48:53.063 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:48:53.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0759002a) incarnation(174631051) [ CSSD]2013-05-23 12:48:53.070 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:48:53.070 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:48:53.187 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92d0) allocated [ CSSD]2013-05-23 12:48:53.188 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:48:53.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92d0 - 1,2,3 [ CSSD]2013-05-23 12:48:53.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c92d0) pid(18051/18051) version 11:1:1:4 [ CSSD]2013-05-23 12:48:53.204 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92d0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:48:53.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:48:53.204 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:48:53.204 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:48:53.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:53.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:54.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:55.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:55.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:56.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:48:56.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:56.543 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:48:56.543 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:48:57.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:57.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:48:58.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:48:59.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:48:59.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:00.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:01.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075a002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:01.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:01.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:01.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:01.546 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:02.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:02.369 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcb00) allocated [ CSSD]2013-05-23 12:49:02.370 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:49:02.370 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcb00 - 1,2,3 [ CSSD]2013-05-23 12:49:02.370 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ca0) proc(0x7f82b42dcb00) pid(18929) version 11:1:1:4 [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcb00), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dca20, requested num -1 [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:02.376 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:02.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:02.382 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:49:02.382 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:02.382 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:02.585 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcb00 [ CSSD]2013-05-23 12:49:02.585 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcb00) con(0x7f82b42c9ca0) skgpid ospid 18929 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:03.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:03.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:04.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:05.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:05.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:06.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:06.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:06.550 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:06.550 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:07.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:07.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:08.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(075b002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:08.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:49:08.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:49:08.313 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:49:08.313 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:08.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(075c002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:08.320 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:49:08.320 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:49:08.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:09.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:09.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:10.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:10.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:10.553 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:49:11.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075d002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:11.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:11.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:11.558 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dca30) allocated [ CSSD]2013-05-23 12:49:11.559 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:49:11.559 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dca30 - 1,2,3 [ CSSD]2013-05-23 12:49:11.559 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b42dca30) pid(19033) version 11:1:1:4 [ CSSD]2013-05-23 12:49:11.680 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df3a0) allocated [ CSSD]2013-05-23 12:49:11.681 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:49:11.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df3a0 - 1,2,3 [ CSSD]2013-05-23 12:49:11.682 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd0d0) proc(0x7f82b42df3a0) pid(19043) version 11:1:1:4 [ CSSD]2013-05-23 12:49:11.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:49:11.701 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:49:11.704 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df3a0 [ CSSD]2013-05-23 12:49:11.704 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df3a0) con(0x7f82b42dd0d0) skgpid ospid 19043 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5302/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5302 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cd480 with con 0x7f82b42dc950, requested num -1 [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42dd1b0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:11.781 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:49:11.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5302 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:11.787 [1199044928] >TRACE: clssgmExitGrock: client 5302 (0x7f82b42cd480), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:49:11.787 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd4b0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:49:11.787 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42dd4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:11.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dca30 [ CSSD]2013-05-23 12:49:11.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dca30) con(0x7f82b42a1b40) skgpid ospid 19033 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:12.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:13.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:13.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:14.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:15.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:15.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:15.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:15.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:16.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:16.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:17.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:17.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:17.620 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcb00) allocated [ CSSD]2013-05-23 12:49:17.621 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:49:17.622 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcb00 - 1,2,3 [ CSSD]2013-05-23 12:49:17.622 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42dcb00) pid(19092) version 11:1:1:4 [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcb00), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42caff0, requested num -1 [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd1b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:17.628 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:17.635 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:17.635 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:49:17.635 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:17.635 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:17.837 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcb00 [ CSSD]2013-05-23 12:49:17.837 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcb00) con(0x7f82b427c5d0) skgpid ospid 19092 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:18.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:19.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:19.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:20.171 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dca30) allocated [ CSSD]2013-05-23 12:49:20.171 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:49:20.172 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dca30 - 1,2,3 [ CSSD]2013-05-23 12:49:20.172 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42dca30) pid(19152) version 11:1:1:4 [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dca30), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dc950, requested num -1 [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd1b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:20.177 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:20.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:20.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:49:20.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:20.184 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:20.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dca30 [ CSSD]2013-05-23 12:49:20.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dca30) con(0x7f82b427c5d0) skgpid ospid 19152 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:20.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:20.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:20.560 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:21.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075e002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:21.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:21.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:22.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:23.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:23.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:23.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(075f002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:23.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:49:23.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:49:23.564 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:49:23.564 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:23.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0760002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:23.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:49:23.571 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:49:24.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0761002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:24.194 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:49:24.194 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:49:24.194 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:49:24.194 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:24.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0762002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:24.201 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:49:24.201 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:49:24.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:25.563 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:25.563 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:25.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:25.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:26.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:26.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:27.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:27.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:28.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:29.566 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:29.566 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:49:29.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:29.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:30.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:31.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0763002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:31.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:31.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:32.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:32.869 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcb00) allocated [ CSSD]2013-05-23 12:49:32.870 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:49:32.871 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcb00 - 1,2,3 [ CSSD]2013-05-23 12:49:32.871 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ca0) proc(0x7f82b42dcb00) pid(19284) version 11:1:1:4 [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcb00), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dca20, requested num -1 [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:32.877 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:32.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:32.884 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:49:32.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:32.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:33.087 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcb00 [ CSSD]2013-05-23 12:49:33.087 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcb00) con(0x7f82b42c9ca0) skgpid ospid 19284 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:33.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:33.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:34.569 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:34.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:34.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:35.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:35.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:36.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:36.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:37.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:37.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:38.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:38.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0764002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:38.823 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:49:38.823 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:49:38.823 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:49:38.823 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:38.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0765002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:38.830 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:49:38.830 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:49:39.572 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:39.573 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:39.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:39.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:40.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:41.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0766002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:41.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:41.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:42.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:43.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:43.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:44.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:44.576 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:44.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:45.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:45.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:46.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:46.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:47.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:47.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:48.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dca30) allocated [ CSSD]2013-05-23 12:49:48.121 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:49:48.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dca30 - 1,2,3 [ CSSD]2013-05-23 12:49:48.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42dca30) pid(19424) version 11:1:1:4 [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dca30), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dc950, requested num -1 [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd1b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:49:48.128 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:48.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:49:48.136 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:49:48.136 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:49:48.136 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:49:48.338 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dca30 [ CSSD]2013-05-23 12:49:48.338 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dca30) con(0x7f82b427c5d0) skgpid ospid 19424 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:49:48.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:48.579 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:49:48.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:49.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:49.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:50.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:51.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0767002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:51.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:51.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:52.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:53.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:53.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:53.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:53.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:54.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0768002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:54.074 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:49:54.074 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:49:54.074 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:49:54.074 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:49:54.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0769002a) incarnation(174631051) [ CSSD]2013-05-23 12:49:54.083 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:49:54.083 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:49:54.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:55.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:55.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:56.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:49:56.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:57.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:57.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:49:58.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:49:58.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:49:58.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:49:59.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:49:59.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:00.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:01.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076a002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:01.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:01.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:02.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:02.589 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:50:02.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:03.372 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcb00) allocated [ CSSD]2013-05-23 12:50:03.373 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:50:03.373 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcb00 - 1,2,3 [ CSSD]2013-05-23 12:50:03.373 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ca0) proc(0x7f82b42dcb00) pid(19756) version 11:1:1:4 [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcb00), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dca20, requested num -1 [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:50:03.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:03.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:50:03.386 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:50:03.386 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:03.386 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:50:03.589 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcb00 [ CSSD]2013-05-23 12:50:03.589 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcb00) con(0x7f82b42c9ca0) skgpid ospid 19756 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:03.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:03.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:04.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcb00) allocated [ CSSD]2013-05-23 12:50:04.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:04.945 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:50:04.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcb00 - 1,2,3 [ CSSD]2013-05-23 12:50:04.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b42dcb00) pid(19816/19816) version 11:1:1:4 [ CSSD]2013-05-23 12:50:04.962 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcb00), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:50:04.962 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:50:04.962 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:50:04.962 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcb00 [ CSSD]2013-05-23 12:50:05.241 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcb00) con(0x7f82b42a1b40) skgpid 19816 ospid 19816 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:05.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:05.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:06.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:06.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:07.592 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:07.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:07.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:07.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:08.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:09.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(076b002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:09.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:09.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:09.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:09.336 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:09.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(076c002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:09.344 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:09.344 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:09.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:09.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:10.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:11.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076d002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:12.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:12.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:12.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:12.596 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:12.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:13.953 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ad0), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 12:50:13.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:50:13.953 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:50:13.953 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:50:14.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:14.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:15.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:16.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:16.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:16.352 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:17.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:17.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:17.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:18.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:18.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:18.622 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf60) allocated [ CSSD]2013-05-23 12:50:18.623 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:50:18.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf60 - 1,2,3 [ CSSD]2013-05-23 12:50:18.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b42caf60) pid(19924) version 11:1:1:4 [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42caf60), client(1/0x7f82b42dd540) [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dd540) [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42dd540 with con 0x7f82b42cae80, requested num -1 [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd6b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:50:18.640 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:18.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dd540) [ CSSD]2013-05-23 12:50:18.646 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dd540), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:50:18.646 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:18.647 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:50:18.849 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf60 [ CSSD]2013-05-23 12:50:18.849 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf60) con(0x7f82b42a1b40) skgpid ospid 19924 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:19.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:20.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:20.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:20.423 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caea0) allocated [ CSSD]2013-05-23 12:50:20.424 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:50:20.425 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caea0 - 1,2,3 [ CSSD]2013-05-23 12:50:20.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b42caea0) pid(19978) version 11:1:1:4 [ CSSD]2013-05-23 12:50:20.430 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42caea0), client(1/0x7f82b42dd470) [ CSSD]2013-05-23 12:50:20.430 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42dd470) [ CSSD]2013-05-23 12:50:20.430 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42dd470 with con 0x7f82b42cadc0, requested num -1 [ CSSD]2013-05-23 12:50:20.430 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:20.430 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd5e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:50:20.431 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:50:20.431 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:20.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42dd470) [ CSSD]2013-05-23 12:50:20.437 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42dd470), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:50:20.437 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd8e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:20.437 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd8e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:50:20.640 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caea0 [ CSSD]2013-05-23 12:50:20.640 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caea0) con(0x7f82b42a1b40) skgpid ospid 19978 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:21.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:21.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcfc0) allocated [ CSSD]2013-05-23 12:50:21.220 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:50:21.221 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcfc0 - 1,2,3 [ CSSD]2013-05-23 12:50:21.221 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca130) proc(0x7f82b42dcfc0) pid(19902/19902) version 11:1:1:4 [ CSSD]2013-05-23 12:50:21.236 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dcfc0), client(1/0x7f82b42caff0) [ CSSD]2013-05-23 12:50:21.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42caff0) [ CSSD]2013-05-23 12:50:21.236 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:50:21.236 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:50:21.300 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e01a0) allocated [ CSSD]2013-05-23 12:50:21.301 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:50:21.301 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e01a0 - 1,2,3 [ CSSD]2013-05-23 12:50:21.301 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dded0) proc(0x7f82b42e01a0) pid(19900/19900) version 11:1:1:4 [ CSSD]2013-05-23 12:50:21.317 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e01a0), client(1/0x7f82b42e06c0) [ CSSD]2013-05-23 12:50:21.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42e06c0) [ CSSD]2013-05-23 12:50:21.317 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:50:21.317 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:50:21.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076e002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:22.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:22.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:22.602 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:22.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:23.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:24.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:24.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:24.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(076f002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:24.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:24.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:24.464 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:24.464 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:24.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0770002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:24.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:24.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:24.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0771002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:24.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:24.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:24.587 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:24.587 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:24.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0772002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:24.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:24.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:25.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:26.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:26.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:26.373 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:27.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:27.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:27.606 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:28.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:28.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:29.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:30.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:30.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:31.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:31.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0773002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:32.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:32.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:32.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:32.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:33.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:33.883 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e2cb0) allocated [ CSSD]2013-05-23 12:50:33.884 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:50:33.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e2cb0 - 1,2,3 [ CSSD]2013-05-23 12:50:33.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb80) proc(0x7f82b42e2cb0) pid(20073) version 11:1:1:4 [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e2cb0), client(1/0x7f82b42e3370) [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e3370) [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e3370 with con 0x7f82b42e2bc0, requested num -1 [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e34e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:50:33.900 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:33.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e3370) [ CSSD]2013-05-23 12:50:33.907 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e3370), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:50:33.907 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e37e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:33.907 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e37e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:50:34.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e2cb0 [ CSSD]2013-05-23 12:50:34.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e2cb0) con(0x7f82b42ddb80) skgpid ospid 20073 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:34.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:34.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:35.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:36.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:36.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:36.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:37.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:37.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:37.613 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:38.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:38.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:39.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:39.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0774002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:39.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:39.835 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:39.835 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:39.835 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:39.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0775002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:39.841 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:39.841 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:40.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:40.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:41.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:41.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0776002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:41.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:41.615 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:50:42.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:42.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:43.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:44.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:44.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:45.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:46.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:46.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:46.425 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:46.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:46.619 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:47.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:48.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:48.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:49.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e2bf0) allocated [ CSSD]2013-05-23 12:50:49.142 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:50:49.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e2bf0 - 1,2,3 [ CSSD]2013-05-23 12:50:49.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42e2bf0) pid(20225) version 11:1:1:4 [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e2bf0), client(1/0x7f82b42e32b0) [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e32b0) [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e32b0 with con 0x7f82b42e2b00, requested num -1 [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3420/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:50:49.149 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:49.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e32b0) [ CSSD]2013-05-23 12:50:49.156 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e32b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:50:49.156 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3720) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:50:49.156 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3720) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:50:49.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:49.359 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e2bf0 [ CSSD]2013-05-23 12:50:49.359 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e2bf0) con(0x7f82b427c5d0) skgpid ospid 20225 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:50:49.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0777002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:49.473 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:49.473 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:49.473 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:49.473 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:49.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0778002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:49.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:49.481 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:50.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:50.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:51.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:51.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0779002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:51.622 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:51.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:52.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:52.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:53.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:54.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:54.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:55.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077a002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:55.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:50:55.100 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:50:55.100 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:50:55.100 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:50:55.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077b002a) incarnation(174631051) [ CSSD]2013-05-23 12:50:55.106 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:50:55.106 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:50:55.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:56.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:56.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:56.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:50:56.625 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:50:56.626 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:50:57.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:50:58.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:50:58.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:50:59.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:00.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:00.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:00.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:00.629 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:51:01.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:01.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(077c002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:02.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:02.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:03.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:04.391 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e2cb0) allocated [ CSSD]2013-05-23 12:51:04.392 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:51:04.392 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e2cb0 - 1,2,3 [ CSSD]2013-05-23 12:51:04.392 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb80) proc(0x7f82b42e2cb0) pid(20388) version 11:1:1:4 [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e2cb0), client(1/0x7f82b42e3370) [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e3370) [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e3370 with con 0x7f82b42e2bc0, requested num -1 [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e34e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:51:04.398 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:04.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e3370) [ CSSD]2013-05-23 12:51:04.405 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e3370), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:51:04.405 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e37e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:04.405 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e37e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:51:04.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:04.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:04.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e2cb0 [ CSSD]2013-05-23 12:51:04.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e2cb0) con(0x7f82b42ddb80) skgpid ospid 20388 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:04.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077d002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:04.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:04.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:04.609 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:51:04.609 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:04.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077e002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:04.616 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:04.616 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:04.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:51:04.744 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:51:04.745 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:51:04.746 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:51:05.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:05.632 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:05.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:06.485 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:06.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:06.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:07.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:08.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:08.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:09.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:10.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077f002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:10.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:10.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:10.347 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:10.347 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:10.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0780002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:10.354 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:10.354 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:10.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:10.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:10.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:10.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:11.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:11.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0781002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:12.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:12.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:13.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:14.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:14.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:15.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:15.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:15.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:15.923 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e2cb0) allocated [ CSSD]2013-05-23 12:51:15.923 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:51:15.924 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e2cb0 - 1,2,3 [ CSSD]2013-05-23 12:51:15.924 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb80) proc(0x7f82b42e2cb0) pid(20512/20512) version 11:1:1:4 [ CSSD]2013-05-23 12:51:15.940 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e2cb0), client(1/0x7f82b42e31e0) [ CSSD]2013-05-23 12:51:15.940 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42e31e0) [ CSSD]2013-05-23 12:51:15.940 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:51:15.940 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 12:51:15.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42e31e0) [ CSSD]2013-05-23 12:51:15.963 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42e31e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:51:15.963 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42e31e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:51:15.963 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 12:51:15.964 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e2cb0 [ CSSD]2013-05-23 12:51:15.964 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e2cb0) con(0x7f82b42ddb80) skgpid 20512 ospid 20512 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:16.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:16.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:16.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:17.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:18.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:18.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:19.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:19.640 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e2bf0) allocated [ CSSD]2013-05-23 12:51:19.641 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:51:19.641 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e2bf0 - 1,2,3 [ CSSD]2013-05-23 12:51:19.641 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42e2bf0) pid(20541) version 11:1:1:4 [ CSSD]2013-05-23 12:51:19.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:19.642 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e2bf0), client(1/0x7f82b42e3360) [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e3360) [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e3360 with con 0x7f82b42e2df0, requested num -1 [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e34d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:51:19.647 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:19.653 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e3360) [ CSSD]2013-05-23 12:51:19.653 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e3360), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:51:19.653 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e37d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:19.653 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e37d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:51:19.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e2bf0 [ CSSD]2013-05-23 12:51:19.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e2bf0) con(0x7f82b427c5d0) skgpid ospid 20541 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:51:20.132 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b4285e90) skgpid 15157 ospid 15157 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 12:51:20.135 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b42aee40) skgpid 15166 ospid 15166 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:20.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:20.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:20.689 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:51:20.690 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:51:20.690 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:51:20.690 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b5b40) pid(20589) version 11:1:1:4 [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:51:20.697 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:20.704 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:20.704 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:51:20.704 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:20.704 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:51:20.907 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:51:20.907 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b427d8a0) skgpid ospid 20589 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:21.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:21.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0782002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:22.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:22.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:23.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:24.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:24.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:24.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:24.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:24.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0783002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:24.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:24.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:24.727 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:24.727 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:24.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0784002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:24.733 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:24.733 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:25.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:25.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0785002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:25.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:25.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:25.595 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:25.596 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:25.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0786002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:25.602 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:25.602 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:26.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:26.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:26.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:27.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:28.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:28.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:29.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:29.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:29.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:30.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:30.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:31.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0787002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:31.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:32.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:32.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:33.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:34.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:34.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:34.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:34.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:34.890 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:51:34.890 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:51:34.891 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:51:34.891 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42b5b40) pid(20722) version 11:1:1:4 [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:51:34.908 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:34.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:34.915 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:51:34.915 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:34.915 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:51:35.117 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:51:35.117 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b4285e90) skgpid ospid 20722 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:35.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:36.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:36.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:36.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:37.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:38.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:38.655 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:51:38.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:38.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:39.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:40.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:40.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:40.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0788002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:40.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:40.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:40.844 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:40.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:40.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0789002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:40.851 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:40.851 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:41.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(078a002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:41.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:42.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:42.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:43.658 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:43.658 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:43.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:44.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:44.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:45.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:46.575 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:46.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:46.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:47.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:48.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:48.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:48.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:48.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:49.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:50.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:51:50.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:51:50.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:51:50.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b5b40) pid(20885) version 11:1:1:4 [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a1b40, requested num -1 [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:51:50.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:50.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:51:50.169 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:51:50.169 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:51:50.169 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:51:50.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:51:50.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b427d8a0) skgpid ospid 20885 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:51:50.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:50.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:51.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(078b002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:51.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:52.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:52.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:53.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:53.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:51:53.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:54.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:54.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:55.072 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92d0), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:51:55.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:51:55.072 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:51:55.072 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 12:51:55.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:56.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078c002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:56.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:56.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:56.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:56.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:56.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078d002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:56.111 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:56.111 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:56.597 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:51:56.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:56.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:57.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:51:57.668 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:51:57.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:51:58.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:51:58.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:51:59.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078e002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:59.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:51:59.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:51:59.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:51:59.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:51:59.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078f002a) incarnation(174631051) [ CSSD]2013-05-23 12:51:59.450 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:51:59.450 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:51:59.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:01.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:01.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:01.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0790002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:01.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:02.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:52:02.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:52:02.084 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:52:02.084 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:52:02.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0791002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:02.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:02.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:02.162 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:52:02.162 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:52:02.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0792002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:02.168 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:02.168 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:02.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:02.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:03.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:03.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:03.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:05.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:05.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:05.404 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:05.405 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:52:05.406 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:05.406 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b40) proc(0x7f82b42b5b40) pid(21037) version 11:1:1:4 [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:52:05.412 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:05.419 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:05.419 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:52:05.419 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:05.419 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:52:05.621 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:52:05.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42a1b40) skgpid ospid 21037 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:05.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:06.617 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:07.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:07.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:07.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:07.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:07.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:09.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:09.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:10.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:11.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:11.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:11.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0793002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:11.349 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:11.349 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:11.349 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:52:11.349 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:11.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0794002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:11.357 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:11.357 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:11.729 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:11.730 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:52:11.731 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:11.731 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(21155) version 11:1:1:4 [ CSSD]2013-05-23 12:52:11.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0795002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:12.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:12.678 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:12.679 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:13.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:13.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:14.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:14.284 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:52:14.284 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 21155 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:15.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:15.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:16.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:16.636 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:16.681 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:16.681 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:52:17.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:17.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:18.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:19.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:19.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:20.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:20.655 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:20.655 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:52:20.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:20.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(21537) version 11:1:1:4 [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a1b40, requested num -1 [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:52:20.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:20.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.668 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:52:20.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:20.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:52:20.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:52:20.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 21537 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:20.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:20.944 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:52:20.945 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:20.945 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(21584) version 11:1:1:4 [ CSSD]2013-05-23 12:52:20.960 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.960 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42be640, requested num -1 [ CSSD]2013-05-23 12:52:20.960 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:20.960 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:52:20.961 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:52:20.961 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:20.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:20.967 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:52:20.967 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:20.967 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:52:21.170 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:52:21.170 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 21584 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:21.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:21.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:21.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:21.685 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:21.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0796002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:22.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:23.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:23.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:24.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:24.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0797002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:24.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:24.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:24.980 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:52:24.980 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:24.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0798002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:24.987 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:24.987 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:25.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:25.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:26.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:26.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0799002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:26.600 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:26.600 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:26.600 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:52:26.600 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:26.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079a002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:26.606 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:26.606 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:26.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:26.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:26.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:27.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:27.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:28.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:29.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:29.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:30.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:31.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:31.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:31.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:31.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:31.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079b002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:32.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:33.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:33.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:34.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:35.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:35.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:35.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:35.694 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:52:35.904 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:35.905 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:52:35.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:35.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(21730) version 11:1:1:4 [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a1b40, requested num -1 [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:52:35.912 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:35.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:52:35.920 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:52:35.920 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:35.920 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:52:36.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 12:52:36.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 21730 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:36.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:36.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:37.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:37.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:38.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:39.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:39.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:40.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:40.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:40.697 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:41.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:41.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:41.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079c002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:41.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(079d002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:41.849 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:52:41.849 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:41.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079e002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:41.856 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:41.856 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:42.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:43.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:43.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:44.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:45.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:45.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:45.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:45.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:45.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:52:45.724 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:52:45.724 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:52:45.724 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204520 [ CSSD]2013-05-23 12:52:45.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204520) con(0x7f82b42c6340) skgpid 16059 ospid 16059 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:45.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 12:52:45.733 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:52:45.733 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:52:45.733 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8950 [ CSSD]2013-05-23 12:52:45.734 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8950) con(0x7f82b42cd860) skgpid 16057 ospid 16057 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ecb0 [ CSSD]2013-05-23 12:52:45.744 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ecb0) con(0x7f82b4207f10) skgpid 16069 ospid 16069 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:45.949 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 12:52:45.950 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:52:45.950 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 12:52:45.950 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(21841/21841) version 11:1:1:4 [ CSSD]2013-05-23 12:52:45.957 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 12:52:45.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 12:52:45.957 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:52:45.957 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:52:46.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:46.707 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:47.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:47.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:48.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:49.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:49.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:50.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:50.704 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:50.704 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:52:51.159 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 12:52:51.160 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:52:51.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 12:52:51.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42af3a0) pid(21876) version 11:1:1:4 [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42af3a0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:52:51.167 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:51.174 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:52:51.174 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:52:51.174 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0460) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:52:51.174 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0460) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:52:51.377 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 12:52:51.377 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b42a29f0) skgpid ospid 21876 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:51.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:51.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:51.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079f002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:52.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:53.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:52:53.201 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:52:53.201 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:52:53.201 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92d0 [ CSSD]2013-05-23 12:52:53.206 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92d0) con(0x7f82b42d9340) skgpid 18051 ospid 18051 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:52:53.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:53.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:54.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:54.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:54.707 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:52:55.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:55.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:56.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:56.727 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:52:57.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a0002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:57.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:52:57.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:52:57.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:52:57.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:52:57.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a1002a) incarnation(174631051) [ CSSD]2013-05-23 12:52:57.110 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:52:57.110 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:52:57.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:57.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:58.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:52:59.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:52:59.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:52:59.710 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:52:59.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:00.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:01.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:01.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:01.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a2002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:02.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:03.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:03.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:04.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:04.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:04.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:05.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:05.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:06.411 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:53:06.412 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:53:06.412 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:53:06.412 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c7b30) pid(22025) version 11:1:1:4 [ CSSD]2013-05-23 12:53:06.418 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:53:06.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:53:06.418 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:53:06.418 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:06.418 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:53:06.419 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:06.419 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:06.425 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:53:06.425 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:53:06.425 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:06.425 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:06.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:06.628 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:53:06.628 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42d9340) skgpid ospid 22025 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:06.747 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:07.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:07.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:08.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:09.717 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:09.717 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:09.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:09.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:10.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:11.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:11.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:11.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a3002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:12.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a4002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:12.364 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:53:12.364 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:53:12.364 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:53:12.364 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:12.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a5002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:12.371 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:53:12.371 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:53:12.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:13.719 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:13.720 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:53:13.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:13.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:14.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:15.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:15.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:16.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:16.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:17.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:17.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:18.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:18.723 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:18.723 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:19.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:19.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:20.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:21.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:53:21.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:53:21.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:53:21.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42c7b30) pid(22175) version 11:1:1:4 [ CSSD]2013-05-23 12:53:21.218 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:53:21.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:53:21.218 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:53:21.218 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:21.218 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:53:21.219 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:21.219 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:21.225 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:53:21.225 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:53:21.225 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:21.225 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:21.428 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:53:21.428 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4285e90) skgpid ospid 22175 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:21.660 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 12:53:21.661 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:53:21.662 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 12:53:21.662 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a2930) pid(22184) version 11:1:1:4 [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a2930), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4285e90, requested num -1 [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:21.668 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:21.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:53:21.674 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:53:21.674 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:21.674 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:21.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:21.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:21.876 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 12:53:21.876 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42d9340) skgpid ospid 22184 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:21.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a6002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:22.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:23.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:23.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:23.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:23.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:24.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:25.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a7002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:25.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:53:25.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:53:25.244 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:53:25.244 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:25.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a8002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:25.250 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:53:25.250 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:53:25.439 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:53:25.440 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:53:25.440 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:53:25.440 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42c7b30) pid(22259) version 11:1:1:4 [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4204870 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:25.447 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:25.453 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:53:25.453 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:53:25.453 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:53:25.453 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:25.560 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 12:53:25.560 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:53:25.561 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 12:53:25.561 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e330) pid(22264) version 11:1:1:4 [ CSSD]2013-05-23 12:53:25.577 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:53:25.579 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:53:25.581 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:53:25.582 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 12:53:25.582 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b427d8a0) skgpid ospid 22264 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:25.656 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:53:25.656 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4285e90) skgpid ospid 22259 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:25.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:25.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:26.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:26.788 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:27.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a9002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:27.614 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:53:27.614 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:53:27.614 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:53:27.614 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:27.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07aa002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:27.620 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:53:27.621 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:53:27.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:27.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:28.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:28.730 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:28.731 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:29.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:29.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:30.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:32.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:32.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:32.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ab002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:32.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:32.733 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:32.734 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:53:34.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:34.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:34.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:36.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:36.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:36.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:36.829 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:36.927 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:53:36.928 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:53:36.929 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:53:36.929 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c7b30) pid(22341) version 11:1:1:4 [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c7b30), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:36.935 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:36.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:53:36.942 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:53:36.942 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:36.942 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:37.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:53:37.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42d9340) skgpid ospid 22341 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:37.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:37.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:38.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:38.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:38.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:40.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:40.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:40.535 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 12:53:40.536 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:53:40.536 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 12:53:40.536 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c7b30) pid(22419) version 11:1:1:4 [ CSSD]2013-05-23 12:53:40.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:41.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 12:53:41.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b4257120) skgpid ospid 22419 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:42.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:42.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:42.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ac002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:42.740 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:42.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:42.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:42.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ad002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:42.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:53:42.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:53:42.863 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:53:42.863 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:42.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ae002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:42.869 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:53:42.869 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:53:44.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:44.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:44.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:46.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:46.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:46.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:46.744 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:53:46.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:46.848 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:48.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:48.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:48.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:50.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:53:50.153 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:53:50.154 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:53:50.154 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 12:53:50.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42b35f0) skgpid 16747 ospid 16747 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:50.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:50.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:50.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:51.747 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:51.748 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:52.179 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 12:53:52.180 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:53:52.180 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 12:53:52.180 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b427c510) pid(22667) version 11:1:1:4 [ CSSD]2013-05-23 12:53:52.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:52.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:53:52.196 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:53:52.197 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:52.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:53:52.203 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:53:52.203 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:53:52.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:53:52.406 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 12:53:52.406 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b35f0) skgpid ospid 22667 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:53:52.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07af002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:52.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:53.343 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 12:53:53.343 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:53:53.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 12:53:53.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42a2930) pid(22589/22589) version 11:1:1:4 [ CSSD]2013-05-23 12:53:53.360 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:53:53.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:53:53.360 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:53:53.360 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:53:54.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:54.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:54.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:56.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:56.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:56.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:53:56.751 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:53:56.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:53:56.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:53:58.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b0002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:58.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:53:58.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:53:58.127 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:53:58.127 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:53:58.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b1002a) incarnation(174631051) [ CSSD]2013-05-23 12:53:58.134 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:53:58.134 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:53:58.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:53:58.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:53:58.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:00.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:00.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:00.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:01.755 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:01.755 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:02.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:02.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:02.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b2002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:02.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:04.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:04.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:04.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:05.758 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:05.758 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:54:06.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:06.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:07.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:07.439 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 12:54:07.440 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:54:07.441 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 12:54:07.441 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42574a0) pid(22829) version 11:1:1:4 [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42574a0), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:07.447 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:07.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:54:07.454 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:54:07.454 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:07.454 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:07.657 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 12:54:07.657 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b42c7c00) skgpid ospid 22829 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:08.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:08.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:08.695 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:09.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:10.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:10.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:10.761 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:10.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:11.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:11.860 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0460) allocated [ CSSD]2013-05-23 12:54:11.861 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:54:11.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0460 - 1,2,3 [ CSSD]2013-05-23 12:54:11.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42e0460) pid(22902) version 11:1:1:4 [ CSSD]2013-05-23 12:54:11.979 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 12:54:11.980 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:54:11.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 12:54:11.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42cbb70) pid(22912) version 11:1:1:4 [ CSSD]2013-05-23 12:54:11.997 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:54:11.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:54:12.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 12:54:12.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b427d8a0) skgpid ospid 22912 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5303/0x7f82b42cbf40) [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5303 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cbf40 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d3b40/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:12.082 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:54:12.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5303 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:54:12.088 [1199044928] >TRACE: clssgmExitGrock: client 5303 (0x7f82b42cbf40), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:54:12.088 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dac0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:54:12.088 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429dac0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:12.089 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0460 [ CSSD]2013-05-23 12:54:12.089 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0460) con(0x7f82b42b3350) skgpid ospid 22902 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:12.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:12.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:12.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b3002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:13.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:13.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b4002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:13.377 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:54:13.377 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:54:13.377 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:54:13.377 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:13.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b5002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:13.383 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:54:13.383 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:54:14.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:14.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:15.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:15.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:15.765 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:16.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:16.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:17.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:18.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:18.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:18.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:19.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:19.768 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:19.768 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:54:20.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:20.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:21.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:21.472 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:54:21.472 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:54:21.473 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:54:21.473 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42b5910) pid(22987) version 11:1:1:4 [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b5910), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:21.480 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:21.486 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:54:21.486 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:54:21.486 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:21.487 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:21.689 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:54:21.689 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42c7c00) skgpid ospid 22987 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:22.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:22.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:22.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5910) allocated [ CSSD]2013-05-23 12:54:22.692 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:54:22.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5910 - 1,2,3 [ CSSD]2013-05-23 12:54:22.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42b5910) pid(23008) version 11:1:1:4 [ CSSD]2013-05-23 12:54:22.699 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b5910), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 12:54:22.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:54:22.699 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 12:54:22.699 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:22.699 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:54:22.700 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:22.700 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:22.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 12:54:22.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:54:22.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:22.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:22.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b6002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:22.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5910 [ CSSD]2013-05-23 12:54:22.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5910) con(0x7f82b42b3350) skgpid ospid 23008 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:23.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 12:54:23.434 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42d9340) skgpid 22589 ospid 22589 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:24.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:24.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:24.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:24.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:25.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:25.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b7002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:25.507 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:54:25.507 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:54:25.507 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:54:25.507 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:25.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b8002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:25.514 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:54:25.514 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:54:26.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:26.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:27.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:28.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:28.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:28.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b9002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:28.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:54:28.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:54:28.635 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:54:28.635 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:28.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ba002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:28.642 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:54:28.642 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:54:28.737 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:29.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:29.775 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:29.775 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:30.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:30.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:31.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:32.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:32.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:32.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bb002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:33.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:34.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:34.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:34.778 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:34.779 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:35.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:36.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:36.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:37.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:37.940 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 12:54:37.941 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:54:37.942 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 12:54:37.942 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b427c510) pid(23177) version 11:1:1:4 [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:37.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:37.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:54:37.955 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:54:37.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:37.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:38.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 12:54:38.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b35f0) skgpid ospid 23177 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:38.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:38.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:38.758 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:38.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:38.781 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:54:39.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:40.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:40.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:41.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:42.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:42.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:42.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bc002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:43.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:43.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:43.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:43.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07bd002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:43.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:54:43.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:54:43.887 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:54:43.887 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:43.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07be002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:43.893 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:54:43.893 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:54:44.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:44.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:45.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:46.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:46.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:47.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:48.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:48.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:48.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:48.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:48.786 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:49.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:50.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:50.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:51.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:52.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:52.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:52.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bf002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:53.190 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 12:54:53.191 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:54:53.191 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 12:54:53.191 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(23316) version 11:1:1:4 [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:54:53.197 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:53.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:54:53.204 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:54:53.204 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:54:53.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:54:53.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:53.407 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 12:54:53.407 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 23316 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:54:53.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:53.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:54.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:54.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:55.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:56.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:56.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:57.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:54:58.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:54:58.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:54:58.793 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:54:58.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:54:58.803 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:54:59.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c0002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:59.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:54:59.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:54:59.137 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:54:59.137 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:54:59.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c1002a) incarnation(174631051) [ CSSD]2013-05-23 12:54:59.144 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:54:59.144 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:54:59.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:00.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:00.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:01.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:02.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:02.797 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:55:02.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:02.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:02.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c2002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:03.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:04.409 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 12:55:04.410 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:04.410 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 12:55:04.410 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b427c510) pid(23460/23460) version 11:1:1:4 [ CSSD]2013-05-23 12:55:04.416 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:04.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:04.416 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:04.416 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 12:55:04.769 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b35f0) skgpid 23460 ospid 23460 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:04.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:04.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:04.954 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b5b40), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 12:55:04.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 12:55:04.954 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:55:04.954 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 12:55:04.976 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 12:55:04.976 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:04.977 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 12:55:04.977 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b3030) pid(23462/23462) version 11:1:1:4 [ CSSD]2013-05-23 12:55:04.993 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3030), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 12:55:04.993 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 12:55:04.993 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:04.993 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 12:55:05.470 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0530) allocated [ CSSD]2013-05-23 12:55:05.470 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:05.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0530 - 1,2,3 [ CSSD]2013-05-23 12:55:05.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42e0530) pid(22650/22650) version 11:1:1:4 [ CSSD]2013-05-23 12:55:05.477 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42e0530), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 12:55:05.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 12:55:05.477 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:05.477 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 12:55:05.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:05.549 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbd00) allocated [ CSSD]2013-05-23 12:55:05.549 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:05.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbd00 - 1,2,3 [ CSSD]2013-05-23 12:55:05.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e330) proc(0x7f82b42cbd00) pid(22648/22648) version 11:1:1:4 [ CSSD]2013-05-23 12:55:05.566 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cbd00), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 12:55:05.566 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 12:55:05.566 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:05.566 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 12:55:06.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:06.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:07.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:07.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:07.800 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:08.441 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a19b0) allocated [ CSSD]2013-05-23 12:55:08.442 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:55:08.442 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a19b0 - 1,2,3 [ CSSD]2013-05-23 12:55:08.443 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a19b0) pid(23490) version 11:1:1:4 [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a19b0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42ddd50, requested num -1 [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:55:08.449 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:08.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:08.455 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:55:08.455 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:08.455 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:55:08.657 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a19b0 [ CSSD]2013-05-23 12:55:08.657 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a19b0) con(0x7f82b42bad40) skgpid ospid 23490 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:08.823 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:08.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:08.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:09.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:10.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:10.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:11.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:12.803 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:12.803 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:12.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:12.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:12.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c3002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:13.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:14.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c4002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:14.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:55:14.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:55:14.388 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:55:14.388 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:14.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c5002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:14.395 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:55:14.396 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:55:14.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:14.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:15.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:16.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:16.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:17.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:17.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:17.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:18.845 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:18.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:18.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:19.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:21.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:21.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:21.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:21.730 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a19b0) allocated [ CSSD]2013-05-23 12:55:21.731 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:21.732 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a19b0 - 1,2,3 [ CSSD]2013-05-23 12:55:21.732 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a19b0) pid(23636) version 11:1:1:4 [ CSSD]2013-05-23 12:55:21.748 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a19b0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:55:21.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:21.748 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 12:55:21.748 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:21.748 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d7e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:55:21.749 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:55:21.749 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:21.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:21.756 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:55:21.756 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ee50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:21.756 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ee50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:55:21.959 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a19b0 [ CSSD]2013-05-23 12:55:21.959 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a19b0) con(0x7f82b427c5d0) skgpid ospid 23636 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:22.102 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8570) allocated [ CSSD]2013-05-23 12:55:22.102 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:22.103 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8570 - 1,2,3 [ CSSD]2013-05-23 12:55:22.103 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d8570) pid(23581/23581) version 11:1:1:4 [ CSSD]2013-05-23 12:55:22.109 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d8570), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 12:55:22.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 12:55:22.109 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:22.109 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 12:55:22.607 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d8570), client(2/0x7f82b4207960) [ CSSD]2013-05-23 12:55:22.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 12:55:22.607 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:55:22.607 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 12:55:22.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:22.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:22.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c6002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:23.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:23.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:23.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:23.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4202ee0) allocated [ CSSD]2013-05-23 12:55:23.693 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:55:23.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4202ee0 - 1,2,3 [ CSSD]2013-05-23 12:55:23.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8290) proc(0x7f82b4202ee0) pid(23659) version 11:1:1:4 [ CSSD]2013-05-23 12:55:23.700 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4202ee0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d6ef0, requested num -1 [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4203690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:55:23.701 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:23.708 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:55:23.708 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:55:23.708 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4203990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:23.708 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4203990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:55:23.910 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4202ee0 [ CSSD]2013-05-23 12:55:23.910 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4202ee0) con(0x7f82b42d8290) skgpid ospid 23659 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:25.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:25.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:25.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:25.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c7002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:25.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:55:25.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:55:25.760 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:55:25.760 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:25.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c8002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:25.767 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:55:25.768 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:55:27.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:27.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:27.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:27.814 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:27.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:28.870 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:29.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:29.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:29.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c9002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:29.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:55:29.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:55:29.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:55:29.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:29.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ca002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:29.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:55:29.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:55:29.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:31.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:31.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:31.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:32.617 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4202ee0) allocated [ CSSD]2013-05-23 12:55:32.618 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:55:32.619 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4202ee0 - 1,2,3 [ CSSD]2013-05-23 12:55:32.619 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8290) proc(0x7f82b4202ee0) pid(23579/23579) version 11:1:1:4 [ CSSD]2013-05-23 12:55:32.625 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4202ee0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 12:55:32.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 12:55:32.625 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:55:32.625 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:55:32.664 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4202ee0), client(2/0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:32.664 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cbf40) [ CSSD]2013-05-23 12:55:32.664 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:55:32.664 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 12:55:32.817 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:32.817 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:32.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cb002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:33.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:33.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:33.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:35.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:35.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:35.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:36.820 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:36.820 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:55:37.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:37.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:37.470 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42e0530), client(2/0x7f82b42a2a00) [ CSSD]2013-05-23 12:55:37.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 12:55:37.470 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:55:37.470 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 12:55:37.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:38.891 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:38.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf490) allocated [ CSSD]2013-05-23 12:55:38.944 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:55:38.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf490 - 1,2,3 [ CSSD]2013-05-23 12:55:38.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204190) proc(0x7f82b42cf490) pid(23822) version 11:1:1:4 [ CSSD]2013-05-23 12:55:38.951 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf490), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:55:38.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:38.951 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42cf230, requested num -1 [ CSSD]2013-05-23 12:55:38.951 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:38.951 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:55:38.952 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:55:38.952 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:38.959 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:38.959 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:55:38.959 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf7e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:38.959 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf7e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:55:39.161 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf490 [ CSSD]2013-05-23 12:55:39.161 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf490) con(0x7f82b4204190) skgpid ospid 23822 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:39.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:39.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:39.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:41.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:41.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:41.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:41.824 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:41.824 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:42.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cc002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:43.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:43.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:43.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:44.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07cd002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:44.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:55:44.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:55:44.897 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:55:44.897 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:44.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ce002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:44.904 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:55:44.904 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:55:45.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:45.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:45.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:46.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:46.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:47.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:47.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:47.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:48.913 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:49.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:49.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:49.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:51.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:51.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:51.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:51.832 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:51.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:53.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cf002a) incarnation(174631051) [ CSSD]2013-05-23 12:55:53.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:53.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:53.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:54.201 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf490) allocated [ CSSD]2013-05-23 12:55:54.202 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:55:54.202 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf490 - 1,2,3 [ CSSD]2013-05-23 12:55:54.202 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204190) proc(0x7f82b42cf490) pid(23966) version 11:1:1:4 [ CSSD]2013-05-23 12:55:54.209 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf490), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:55:54.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:54.209 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42cf230, requested num -1 [ CSSD]2013-05-23 12:55:54.209 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:54.209 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:55:54.210 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:55:54.210 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:55:54.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:55:54.217 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:55:54.217 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf7e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:55:54.217 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf7e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:55:54.419 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf490 [ CSSD]2013-05-23 12:55:54.420 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf490) con(0x7f82b4204190) skgpid ospid 23966 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:55:55.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:55.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:55.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:56.835 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:55:56.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:55:57.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:57.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:57.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:55:58.942 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:55:59.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:55:59.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:55:59.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:00.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d0002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:00.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:00.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:00.147 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:56:00.147 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:00.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d1002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:00.154 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:00.154 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:01.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:01.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:01.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:01.839 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:01.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:03.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d2002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:03.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:03.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:03.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:04.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d3002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:04.908 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:04.908 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:04.908 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 12:56:04.908 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:04.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d4002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:04.916 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:04.916 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:05.045 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:56:05.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:56:05.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:56:05.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:56:05.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:05.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:05.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:06.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:06.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:07.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:07.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:08.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:08.965 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:09.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:09.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:09.463 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf3c0) allocated [ CSSD]2013-05-23 12:56:09.464 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:56:09.464 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf3c0 - 1,2,3 [ CSSD]2013-05-23 12:56:09.464 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42cf3c0) pid(24117) version 11:1:1:4 [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf3c0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42cf2e0, requested num -1 [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:56:09.482 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:09.489 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:09.489 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:56:09.489 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0e60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:09.489 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:56:09.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf3c0 [ CSSD]2013-05-23 12:56:09.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf3c0) con(0x7f82b42b3350) skgpid ospid 24117 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:10.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:10.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:10.846 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:56:11.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:11.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:12.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:13.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d5002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:13.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:13.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:14.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:15.364 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf490) allocated [ CSSD]2013-05-23 12:56:15.365 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:56:15.365 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf490 - 1,2,3 [ CSSD]2013-05-23 12:56:15.365 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42041b0) proc(0x7f82b42cf490) pid(24200/24200) version 11:1:1:4 [ CSSD]2013-05-23 12:56:15.381 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf490), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:56:15.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:15.381 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:56:15.382 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf490 [ CSSD]2013-05-23 12:56:15.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf490) con(0x7f82b42041b0) skgpid 24200 ospid 24200 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:15.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d6002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:15.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:15.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:15.399 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:56:15.399 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:15.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d7002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:15.406 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:15.406 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:15.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:15.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:15.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:15.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:16.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:17.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:17.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:18.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:18.986 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:19.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:19.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:20.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:20.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 12:56:20.203 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 12:56:20.203 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 12:56:20.203 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 12:56:20.213 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42b3cd0) skgpid 18845 ospid 18845 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:20.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:20.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:21.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:21.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:22.005 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 12:56:22.006 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:56:22.006 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 12:56:22.006 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42583a0) pid(24258) version 11:1:1:4 [ CSSD]2013-05-23 12:56:22.013 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42583a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:56:22.013 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:56:22.013 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42038f0, requested num -1 [ CSSD]2013-05-23 12:56:22.013 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:22.013 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4203c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:56:22.014 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:56:22.014 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:22.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:56:22.021 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:56:22.021 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8dc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:22.021 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8dc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:56:22.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:22.224 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 12:56:22.224 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42d9290) skgpid ospid 24258 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:23.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d8002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:23.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:23.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:24.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:24.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 12:56:24.728 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:56:24.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 12:56:24.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3460) proc(0x7f82b42b3cd0) pid(24288) version 11:1:1:4 [ CSSD]2013-05-23 12:56:24.735 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b3cd0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 12:56:24.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:24.735 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4203a70, requested num -1 [ CSSD]2013-05-23 12:56:24.736 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:24.736 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4203c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:56:24.736 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:56:24.736 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:24.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:24.742 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:56:24.742 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4203f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:24.742 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4203f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:56:24.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:24.857 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:56:24.945 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 12:56:24.945 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42b3460) skgpid ospid 24288 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:25.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:25.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:26.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d9002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:26.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:26.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:26.019 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:56:26.020 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:26.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07da002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:26.026 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:26.027 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:26.110 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 12:56:26.111 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:56:26.112 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 12:56:26.112 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3350) proc(0x7f82b42ae300) pid(24248/24248) version 11:1:1:4 [ CSSD]2013-05-23 12:56:26.118 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ae300), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 12:56:26.118 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 12:56:26.118 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:56:26.118 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:56:26.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:26.343 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ae300), client(2/0x7f82b42d9760) [ CSSD]2013-05-23 12:56:26.343 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 12:56:26.343 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:56:26.343 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 12:56:27.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:27.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:28.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:29.005 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:29.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:29.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:29.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:29.861 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:30.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:30.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07db002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:30.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:30.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:30.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:56:30.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:30.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07dc002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:30.657 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:30.657 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:31.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:31.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:32.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:33.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07dd002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:33.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:33.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:34.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:34.864 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:34.864 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:35.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:35.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:36.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:37.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:37.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:38.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:39.026 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:39.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:39.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:39.867 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:39.867 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:39.988 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf490) allocated [ CSSD]2013-05-23 12:56:39.989 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:56:39.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf490 - 1,2,3 [ CSSD]2013-05-23 12:56:39.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ad0) proc(0x7f82b42cf490) pid(24430) version 11:1:1:4 [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf490), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cf3b0, requested num -1 [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:56:39.996 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:40.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:56:40.003 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:56:40.003 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0e60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:40.003 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:56:40.205 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf490 [ CSSD]2013-05-23 12:56:40.205 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf490) con(0x7f82b42c9ad0) skgpid ospid 24430 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:40.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:41.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:41.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:42.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:43.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07de002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:43.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:43.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:43.870 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:43.870 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:56:44.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:45.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:45.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:45.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07df002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:45.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:56:45.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:56:45.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:56:45.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:45.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e0002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:45.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:56:45.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:56:46.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:47.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:47.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:48.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:48.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:48.874 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:49.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:49.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:49.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:50.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:51.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:51.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:52.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:53.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e1002a) incarnation(174631051) [ CSSD]2013-05-23 12:56:53.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:53.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:53.877 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:53.877 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:54.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:55.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf5a0) allocated [ CSSD]2013-05-23 12:56:55.240 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:56:55.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf5a0 - 1,2,3 [ CSSD]2013-05-23 12:56:55.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204270) proc(0x7f82b42cf5a0) pid(24577) version 11:1:1:4 [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf5a0), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42cf4c0, requested num -1 [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0ce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:56:55.246 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:56:55.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:56:55.253 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:56:55.253 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:56:55.253 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:56:55.455 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf5a0 [ CSSD]2013-05-23 12:56:55.455 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf5a0) con(0x7f82b4204270) skgpid ospid 24577 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:56:55.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:55.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:56.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:57.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:57.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:56:58.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:56:58.880 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:56:58.880 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:56:59.067 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:56:59.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:56:59.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:00.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:01.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e2002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:01.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:01.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:01.160 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:57:01.160 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:01.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e3002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:01.166 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:01.166 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:01.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:01.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:02.411 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:57:02.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:57:02.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:57:02.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:57:02.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:02.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e4002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:02.582 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:02.582 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:02.582 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 12:57:02.582 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 12:57:02.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e5002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:02.588 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:02.588 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:02.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:02.883 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:57:03.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e6002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:03.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:03.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:04.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:05.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf5a0) allocated [ CSSD]2013-05-23 12:57:05.009 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:05.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf5a0 - 1,2,3 [ CSSD]2013-05-23 12:57:05.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204270) proc(0x7f82b42cf5a0) pid(24694) version 11:1:1:4 [ CSSD]2013-05-23 12:57:05.015 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf5a0), client(1/0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:05.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:05.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d8f40 with con 0x7f82b42cf4c0, requested num -1 [ CSSD]2013-05-23 12:57:05.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:05.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0ce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:05.016 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:05.016 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:05.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:05.023 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d8f40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:05.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:05.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:05.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf5a0 [ CSSD]2013-05-23 12:57:05.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf5a0) con(0x7f82b4204270) skgpid ospid 24694 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:05.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:05.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:06.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:07.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:07.887 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:07.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:07.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:08.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:09.089 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:09.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:09.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:10.489 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf490) allocated [ CSSD]2013-05-23 12:57:10.490 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:57:10.490 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf490 - 1,2,3 [ CSSD]2013-05-23 12:57:10.490 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c97d0) proc(0x7f82b42cf490) pid(24770) version 11:1:1:4 [ CSSD]2013-05-23 12:57:10.497 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf490), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:57:10.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:57:10.497 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cf3b0, requested num -1 [ CSSD]2013-05-23 12:57:10.497 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:10.497 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:10.498 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:10.498 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:10.504 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:57:10.504 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:10.504 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0e60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:10.504 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:10.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:10.707 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf490 [ CSSD]2013-05-23 12:57:10.707 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf490) con(0x7f82b42c97d0) skgpid ospid 24770 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:11.177 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ceb60) allocated [ CSSD]2013-05-23 12:57:11.178 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:11.178 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ceb60 - 1,2,3 [ CSSD]2013-05-23 12:57:11.179 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ad0) proc(0x7f82b42ceb60) pid(24835) version 11:1:1:4 [ CSSD]2013-05-23 12:57:11.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:11.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:12.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:12.890 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:12.890 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:13.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e7002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:13.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ceb60 [ CSSD]2013-05-23 12:57:13.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ceb60) con(0x7f82b42c9ad0) skgpid ospid 24835 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:14.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:14.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:14.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:16.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:16.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:16.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e8002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:16.409 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:16.409 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:16.409 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:57:16.409 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:16.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e9002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:16.415 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:16.415 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:16.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:17.893 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:17.893 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:18.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:18.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:18.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:19.112 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:19.328 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf5a0) allocated [ CSSD]2013-05-23 12:57:19.329 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:19.329 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf5a0 - 1,2,3 [ CSSD]2013-05-23 12:57:19.329 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4204270) proc(0x7f82b42cf5a0) pid(23577/23577) version 11:1:1:4 [ CSSD]2013-05-23 12:57:19.334 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42cf5a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 12:57:19.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 12:57:19.334 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:57:19.334 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:57:20.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:20.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:20.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:21.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:21.896 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:57:22.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:22.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:22.270 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3230) allocated [ CSSD]2013-05-23 12:57:22.271 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:22.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3230 - 1,2,3 [ CSSD]2013-05-23 12:57:22.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9ad0) proc(0x7f82b42e3230) pid(25206) version 11:1:1:4 [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3230), client(1/0x7f82b4204710) [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204710 with con 0x7f82b42e3140, requested num -1 [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e39c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:22.279 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:22.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 12:57:22.286 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204710), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:22.286 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:22.286 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:22.488 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3230 [ CSSD]2013-05-23 12:57:22.488 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3230) con(0x7f82b42c9ad0) skgpid ospid 25206 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:22.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:23.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ea002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:24.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:24.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:24.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:25.742 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e33b0) allocated [ CSSD]2013-05-23 12:57:25.743 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:57:25.743 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e33b0 - 1,2,3 [ CSSD]2013-05-23 12:57:25.743 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e10d0) proc(0x7f82b42e33b0) pid(25233) version 11:1:1:4 [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e33b0), client(1/0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d8f40 with con 0x7f82b42e32c0, requested num -1 [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:25.749 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:25.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:25.756 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d8f40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:25.756 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3e40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:25.756 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3e40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:25.959 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e33b0 [ CSSD]2013-05-23 12:57:25.959 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e33b0) con(0x7f82b42e10d0) skgpid ospid 25233 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:26.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:26.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:26.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07eb002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:26.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:26.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:26.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:57:26.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:26.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ec002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:26.333 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:26.333 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:26.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:26.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:26.900 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:28.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:28.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:28.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:29.133 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:30.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:30.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:30.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:31.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ed002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:31.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:31.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:31.656 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:57:31.656 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:31.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ee002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:31.663 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:31.664 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:31.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:31.903 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:32.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:32.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:32.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:33.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ef002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:34.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:34.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:34.492 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3300) allocated [ CSSD]2013-05-23 12:57:34.493 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:34.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3300 - 1,2,3 [ CSSD]2013-05-23 12:57:34.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c97d0) proc(0x7f82b42e3300) pid(25366) version 11:1:1:4 [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3300), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42e3210, requested num -1 [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3a90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:34.511 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:34.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:57:34.518 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:34.518 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:34.518 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:34.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3300 [ CSSD]2013-05-23 12:57:34.721 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3300) con(0x7f82b42c97d0) skgpid ospid 25366 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:34.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:36.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:36.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:36.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:36.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:36.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:38.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:38.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:38.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:39.153 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:40.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:40.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:40.909 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:40.909 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:57:40.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:40.993 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e32e0) allocated [ CSSD]2013-05-23 12:57:40.994 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:57:40.994 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e32e0 - 1,2,3 [ CSSD]2013-05-23 12:57:40.994 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1000) proc(0x7f82b42e32e0) pid(25427) version 11:1:1:4 [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e32e0), client(1/0x7f82b4204710) [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204710 with con 0x7f82b42e31f0, requested num -1 [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3a70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:41.000 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:41.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 12:57:41.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204710), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:41.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:41.007 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:41.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e32e0 [ CSSD]2013-05-23 12:57:41.209 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e32e0) con(0x7f82b42e1000) skgpid ospid 25427 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:42.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:42.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:42.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:43.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f0002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:44.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:44.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:44.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42e06c0) [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42e06c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42e06c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e01a0 [ CSSD]2013-05-23 12:57:45.800 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e01a0) con(0x7f82b42dded0) skgpid 19900 ospid 19900 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42caff0) [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42caff0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42caff0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcfc0 [ CSSD]2013-05-23 12:57:45.804 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcfc0) con(0x7f82b42ca130) skgpid 19902 ospid 19902 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:45.912 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:45.912 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:46.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:46.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:46.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f1002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:46.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:57:46.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:57:46.916 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:57:46.916 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:46.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f2002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:46.923 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:57:46.923 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:57:47.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:48.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:48.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:49.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:49.174 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:50.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:50.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:50.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:50.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:51.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:52.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:52.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:53.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:53.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f3002a) incarnation(174631051) [ CSSD]2013-05-23 12:57:53.504 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc960) allocated [ CSSD]2013-05-23 12:57:53.505 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:57:53.505 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc960 - 1,2,3 [ CSSD]2013-05-23 12:57:53.505 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9960) proc(0x7f82b42dc960) pid(25562/25562) version 11:1:1:4 [ CSSD]2013-05-23 12:57:53.511 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc960), client(1/0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:53.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 12:57:53.511 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:57:53.511 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 12:57:54.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:54.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:55.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:55.919 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:55.919 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:57:56.242 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dfc40) allocated [ CSSD]2013-05-23 12:57:56.243 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:57:56.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dfc40 - 1,2,3 [ CSSD]2013-05-23 12:57:56.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd580) proc(0x7f82b42dfc40) pid(25584) version 11:1:1:4 [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dfc40), client(1/0x7f82b42c9ae0) [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c9ae0 with con 0x7f82b42dfb60, requested num -1 [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0e90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:57:56.261 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:57:56.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:57:56.268 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c9ae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:57:56.268 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1190) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:57:56.268 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1190) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:57:56.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:56.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:56.471 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dfc40 [ CSSD]2013-05-23 12:57:56.471 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dfc40) con(0x7f82b42dd580) skgpid ospid 25584 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:57:57.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:58.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:57:58.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:57:59.194 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:57:59.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:57:59.922 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:57:59.922 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:58:00.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:00.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:01.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:02.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f4002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:02.166 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:58:02.166 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:58:02.166 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:58:02.166 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:02.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f5002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:02.174 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:58:02.174 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:58:02.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:02.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:03.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:03.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f6002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:04.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:04.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:04.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:04.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:05.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:06.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:06.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:07.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:08.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:08.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:08.638 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dfa60) allocated [ CSSD]2013-05-23 12:58:08.639 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:08.639 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dfa60 - 1,2,3 [ CSSD]2013-05-23 12:58:08.639 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcf40) proc(0x7f82b42dfa60) pid(25512/25512) version 11:1:1:4 [ CSSD]2013-05-23 12:58:08.645 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dfa60), client(1/0x7f82b4204710) [ CSSD]2013-05-23 12:58:08.645 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 12:58:08.645 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:58:08.645 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 12:58:09.215 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:09.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:09.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:09.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:10.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:10.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:11.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:11.506 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3460) allocated [ CSSD]2013-05-23 12:58:11.507 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:58:11.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3460 - 1,2,3 [ CSSD]2013-05-23 12:58:11.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1180) proc(0x7f82b42e3460) pid(25729) version 11:1:1:4 [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3460), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42e3370, requested num -1 [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:11.514 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:11.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:11.521 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:58:11.521 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:11.521 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:11.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3460 [ CSSD]2013-05-23 12:58:11.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3460) con(0x7f82b42e1180) skgpid ospid 25729 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:12.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:12.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:13.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f7002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:13.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:14.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:14.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:14.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:14.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:15.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:16.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:16.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:17.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f8002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:17.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:58:17.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:58:17.416 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:58:17.416 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:17.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f9002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:17.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:58:17.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:58:17.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:18.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:18.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:18.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:18.936 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:58:19.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:19.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:20.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:20.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:21.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:22.527 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3460) allocated [ CSSD]2013-05-23 12:58:22.527 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:22.528 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3460 - 1,2,3 [ CSSD]2013-05-23 12:58:22.528 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1180) proc(0x7f82b42e3460) pid(25840) version 11:1:1:4 [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3460), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42e3370, requested num -1 [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:22.535 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:22.542 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:22.542 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:58:22.542 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:22.542 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:22.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:22.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:22.745 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3460 [ CSSD]2013-05-23 12:58:22.745 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3460) con(0x7f82b42e1180) skgpid ospid 25840 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:23.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07fa002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:23.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:23.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:23.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:24.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:24.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:25.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:25.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3460) allocated [ CSSD]2013-05-23 12:58:25.728 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:25.728 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3460 - 1,2,3 [ CSSD]2013-05-23 12:58:25.728 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1180) proc(0x7f82b42e3460) pid(25893) version 11:1:1:4 [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3460), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b3550 with con 0x7f82b42e3370, requested num -1 [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3bf0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:25.736 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:25.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:25.743 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 12:58:25.743 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3ef0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 12:58:25.743 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42e3ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:25.851 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e6150) allocated [ CSSD]2013-05-23 12:58:25.852 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:25.853 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e6150 - 1,2,3 [ CSSD]2013-05-23 12:58:25.853 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e01a0) proc(0x7f82b42e6150) pid(25901) version 11:1:1:4 [ CSSD]2013-05-23 12:58:25.868 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:58:25.870 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:58:25.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:58:25.873 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e6150 [ CSSD]2013-05-23 12:58:25.873 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e6150) con(0x7f82b42e01a0) skgpid ospid 25901 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:25.946 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3460 [ CSSD]2013-05-23 12:58:25.946 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3460) con(0x7f82b42e1180) skgpid ospid 25893 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:26.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07fb002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:26.586 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:58:26.586 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:58:26.586 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:58:26.586 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:26.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07fc002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:26.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:58:26.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:58:26.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:26.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:26.759 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e32e0) allocated [ CSSD]2013-05-23 12:58:26.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:58:26.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e32e0 - 1,2,3 [ CSSD]2013-05-23 12:58:26.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1000) proc(0x7f82b42e32e0) pid(25917) version 11:1:1:4 [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e32e0), client(1/0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c9ae0 with con 0x7f82b42e31f0, requested num -1 [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3a70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:26.777 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:26.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:26.785 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c9ae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:58:26.785 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:26.786 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:26.988 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e32e0 [ CSSD]2013-05-23 12:58:26.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e32e0) con(0x7f82b42e1000) skgpid ospid 25917 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:27.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:28.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:28.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:28.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:28.944 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:29.262 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:29.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:30.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:30.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:31.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:32.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07fd002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:32.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:58:32.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:58:32.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:58:32.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:32.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07fe002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:32.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:58:32.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:58:32.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:32.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:32.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:32.947 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:58:33.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ff002a) incarnation(174631051) [ CSSD]2013-05-23 12:58:33.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:34.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:34.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:35.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:36.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:36.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:37.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:37.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:37.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:38.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:38.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:39.283 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:39.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:40.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:40.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:41.050 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e33b0) allocated [ CSSD]2013-05-23 12:58:41.051 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:41.051 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e33b0 - 1,2,3 [ CSSD]2013-05-23 12:58:41.051 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e10d0) proc(0x7f82b42e33b0) pid(26082) version 11:1:1:4 [ CSSD]2013-05-23 12:58:41.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:41.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e33b0 [ CSSD]2013-05-23 12:58:41.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e33b0) con(0x7f82b42e10d0) skgpid ospid 26082 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:42.023 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e33b0) allocated [ CSSD]2013-05-23 12:58:42.024 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:58:42.025 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e33b0 - 1,2,3 [ CSSD]2013-05-23 12:58:42.025 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e10d0) proc(0x7f82b42e33b0) pid(26183) version 11:1:1:4 [ CSSD]2013-05-23 12:58:42.030 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e33b0), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:58:42.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:42.030 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42e32c0, requested num -1 [ CSSD]2013-05-23 12:58:42.030 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:42.030 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:58:42.031 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:42.031 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:42.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:42.037 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:58:42.037 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:42.038 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:42.240 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e33b0 [ CSSD]2013-05-23 12:58:42.240 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e33b0) con(0x7f82b42e10d0) skgpid ospid 26183 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:42.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:42.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:42.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:42.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:43.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0000002b) incarnation(174631051) [ CSSD]2013-05-23 12:58:43.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:44.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:44.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:45.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:47.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:47.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:47.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:47.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0001002b) incarnation(174631051) [ CSSD]2013-05-23 12:58:47.917 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:58:47.917 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:58:47.917 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:58:47.917 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:47.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0002002b) incarnation(174631051) [ CSSD]2013-05-23 12:58:47.924 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:58:47.924 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:58:47.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:47.956 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:49.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:49.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:49.303 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:49.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:51.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:51.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:51.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:51.669 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3460) allocated [ CSSD]2013-05-23 12:58:51.670 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:58:51.670 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3460 - 1,2,3 [ CSSD]2013-05-23 12:58:51.670 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1180) proc(0x7f82b42e3460) pid(26334/26334) version 11:1:1:4 [ CSSD]2013-05-23 12:58:51.677 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3460), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 12:58:51.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 12:58:51.677 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 12:58:51.677 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 12:58:52.959 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:52.959 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:58:53.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:53.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:53.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0003002b) incarnation(174631051) [ CSSD]2013-05-23 12:58:53.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:55.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:55.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:55.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:56.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:58:56.962 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:58:57.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:57.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:57.277 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e6130) allocated [ CSSD]2013-05-23 12:58:57.278 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:58:57.278 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e6130 - 1,2,3 [ CSSD]2013-05-23 12:58:57.278 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0b60) proc(0x7f82b42e6130) pid(26387) version 11:1:1:4 [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e6130), client(1/0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c9ae0 with con 0x7f82b42e6040, requested num -1 [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e68c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:58:57.285 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:58:57.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:58:57.292 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c9ae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:58:57.292 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e6bc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:58:57.292 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e6bc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:58:57.494 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e6130 [ CSSD]2013-05-23 12:58:57.494 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e6130) con(0x7f82b42e0b60) skgpid ospid 26387 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:58:57.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:58:59.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:58:59.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:58:59.324 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:58:59.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:00.846 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e3460), client(2/0x7f82b42c9ae0) [ CSSD]2013-05-23 12:59:00.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42c9ae0) [ CSSD]2013-05-23 12:59:00.846 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 12:59:00.847 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 12:59:01.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:01.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:01.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:01.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:01.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:03.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0004002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:03.188 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:59:03.188 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:59:03.188 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:59:03.188 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:03.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:03.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:03.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0005002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:03.195 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:59:03.195 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:59:03.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0006002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:03.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:05.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:05.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:05.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:06.969 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:06.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:07.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:07.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:07.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:09.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:09.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:09.345 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:09.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:11.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:11.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:11.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:11.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:11.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:12.168 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 12:59:12.169 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:59:12.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 12:59:12.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(26535) version 11:1:1:4 [ CSSD]2013-05-23 12:59:12.289 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9110) allocated [ CSSD]2013-05-23 12:59:12.290 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:59:12.290 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9110 - 1,2,3 [ CSSD]2013-05-23 12:59:12.290 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e6e20) proc(0x7f82b42e9110) pid(26545) version 11:1:1:4 [ CSSD]2013-05-23 12:59:12.307 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:59:12.309 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 12:59:12.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9110 [ CSSD]2013-05-23 12:59:12.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9110) con(0x7f82b42e6e20) skgpid ospid 26545 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5304/0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5304 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42e6ee0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:12.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 12:59:12.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5304 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:12.397 [1199044928] >TRACE: clssgmExitGrock: client 5304 (0x7f82b42e6d70), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 12:59:12.397 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 12:59:12.397 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:12.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 12:59:12.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 26535 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:12.531 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 12:59:12.532 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:59:12.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 12:59:12.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(26555) version 11:1:1:4 [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6e20) [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6e20) [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6e20 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6f90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:12.539 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:12.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6e20) [ CSSD]2013-05-23 12:59:12.546 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6e20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:59:12.546 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e6440) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:12.546 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e6440) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:12.749 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 12:59:12.749 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 26555 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:13.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:13.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:13.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0007002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:13.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:15.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:15.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:15.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:15.974 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:15.974 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:59:17.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:17.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:17.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:18.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0008002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:18.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:59:18.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:59:18.439 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:59:18.439 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:18.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0009002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:18.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:59:18.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:59:19.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:19.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:19.369 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:19.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:20.977 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:20.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:21.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:21.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:21.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:22.791 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 12:59:22.792 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 12:59:22.792 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 12:59:22.792 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(26682) version 11:1:1:4 [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:22.799 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:22.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:22.806 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6d70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:59:22.806 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:22.806 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:23.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 12:59:23.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 26682 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:23.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:23.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:23.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000a002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:23.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:25.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:25.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:25.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:25.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:25.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:26.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000b002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:26.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:59:26.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:59:26.850 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:59:26.850 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:26.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000c002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:26.857 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:59:26.857 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:59:27.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:27.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:27.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e6600) allocated [ CSSD]2013-05-23 12:59:27.782 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:59:27.783 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e6600 - 1,2,3 [ CSSD]2013-05-23 12:59:27.783 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0b60) proc(0x7f82b42e6600) pid(26725) version 11:1:1:4 [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e6600), client(1/0x7f82b42e6cc0) [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6cc0) [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6cc0 with con 0x7f82b42e6510, requested num -1 [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:27.789 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:27.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6cc0) [ CSSD]2013-05-23 12:59:27.796 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6cc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:59:27.796 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e7130) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:27.796 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e7130) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:27.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:27.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e6600 [ CSSD]2013-05-23 12:59:27.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e6600) con(0x7f82b42e0b60) skgpid ospid 26725 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:29.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:29.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:29.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:29.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:30.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:30.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:31.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:31.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:31.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:33.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:33.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:33.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000d002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:33.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000e002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:33.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:59:33.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:59:33.696 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:59:33.696 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:33.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000f002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:33.703 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:59:33.703 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:59:33.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:34.987 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:34.987 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:59:35.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:35.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:35.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:37.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:37.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:38.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:39.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:39.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:39.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:39.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:39.990 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:40.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:41.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:41.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:42.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:43.032 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 12:59:43.033 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:59:43.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 12:59:43.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(26864) version 11:1:1:4 [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:43.040 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:43.047 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:43.047 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6d70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:59:43.047 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:43.047 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:43.249 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 12:59:43.249 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 26864 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:43.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:43.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:43.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0010002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:44.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:44.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:44.994 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:45.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:45.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:46.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:47.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:47.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:48.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:48.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0011002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:48.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 12:59:48.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 12:59:48.972 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 12:59:48.972 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:48.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0012002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:48.978 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 12:59:48.979 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 12:59:49.433 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:49.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:49.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:49.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:49.997 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:50.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:51.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:51.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:52.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:53.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:53.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:53.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0013002b) incarnation(174631051) [ CSSD]2013-05-23 12:59:53.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:53.999 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 12:59:54.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:55.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:55.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:56.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:57.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:57.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 12:59:58.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 12:59:58.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 12:59:58.282 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 12:59:58.283 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 12:59:58.283 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(27019) version 11:1:1:4 [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 12:59:58.290 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 12:59:58.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 12:59:58.297 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6d70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 12:59:58.297 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 12:59:58.297 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 12:59:58.500 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 12:59:58.500 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 27019 with 0 clients, refcount 0 [ CSSD]2013-05-23 12:59:59.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 12:59:59.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 12:59:59.456 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 12:59:59.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 12:59:59.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:00.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:01.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:01.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:02.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:03.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:03.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:03.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0014002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:04.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:04.007 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:04.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0015002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:04.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:04.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:04.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:04.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:04.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0016002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:04.233 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:04.233 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:04.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:04.883 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 13:00:04.884 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:00:04.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 13:00:04.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(27295/27295) version 11:1:1:4 [ CSSD]2013-05-23 13:00:04.891 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6be0) [ CSSD]2013-05-23 13:00:04.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42e6be0) [ CSSD]2013-05-23 13:00:04.891 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:00:04.891 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42e6be0) [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42e6be0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42e6be0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 13:00:05.188 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid 27295 ospid 27295 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:05.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:05.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:06.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:07.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:07.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:08.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:09.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:09.010 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:09.479 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:00:09.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:09.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:10.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:11.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:11.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:12.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:13.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:13.012 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:00:13.532 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 13:00:13.533 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:00:13.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 13:00:13.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(27366) version 11:1:1:4 [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:00:13.540 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:13.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:13.547 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6d70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:00:13.547 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:13.547 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:00:13.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0017002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:13.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:13.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:13.750 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 13:00:13.750 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 27366 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:14.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:15.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:15.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:15.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:15.834 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:00:15.834 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:00:15.834 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:00:15.843 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid 21841 ospid 21841 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:16.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:17.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:17.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:18.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:18.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:18.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:19.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0018002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:19.479 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:19.479 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:19.479 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:19.479 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:19.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0019002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:19.487 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:19.487 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:19.501 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:00:19.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:19.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:19.985 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:00:19.986 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:00:19.986 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:00:19.986 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b5b40) pid(27453/27453) version 11:1:1:4 [ CSSD]2013-05-23 13:00:19.991 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:19.991 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:19.991 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:00:19.991 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 13:00:20.176 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:20.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:20.176 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:00:20.176 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 13:00:20.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:21.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:21.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:22.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:23.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:23.018 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:23.053 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66b0) allocated [ CSSD]2013-05-23 13:00:23.056 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:00:23.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66b0 - 1,2,3 [ CSSD]2013-05-23 13:00:23.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e43d0) proc(0x7f82b42e66b0) pid(27477) version 11:1:1:4 [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e66b0), client(1/0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e6d70 with con 0x7f82b42e65c0, requested num -1 [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e6ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:00:23.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:23.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e6d70) [ CSSD]2013-05-23 13:00:23.070 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e6d70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:00:23.070 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e71e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:23.070 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e71e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:00:23.272 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66b0 [ CSSD]2013-05-23 13:00:23.272 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66b0) con(0x7f82b42e43d0) skgpid ospid 27477 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:23.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001a002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:23.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:23.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:24.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:25.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:25.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:26.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:27.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001b002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:27.116 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:27.116 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:27.116 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:27.116 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:27.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001c002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:27.124 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:27.124 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:27.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:27.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:28.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:28.000 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:00:28.000 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:00:28.000 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:00:28.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42c6340) skgpid 27453 ospid 27453 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:28.022 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:28.022 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:28.026 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:00:28.027 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:00:28.027 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:00:28.027 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42b5b40) pid(27520/27520) version 11:1:1:4 [ CSSD]2013-05-23 13:00:28.044 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:28.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:28.044 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:00:28.044 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 13:00:28.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:28.790 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e6220) allocated [ CSSD]2013-05-23 13:00:28.791 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:00:28.791 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e6220 - 1,2,3 [ CSSD]2013-05-23 13:00:28.791 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6000) proc(0x7f82b42e6220) pid(27529) version 11:1:1:4 [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e6220), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42e6130, requested num -1 [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e69b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:00:28.808 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:28.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:00:28.815 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:00:28.815 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e6cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:28.815 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e6cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:00:29.018 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e6220 [ CSSD]2013-05-23 13:00:29.018 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e6220) con(0x7f82b42c6000) skgpid ospid 27529 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:29.530 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:00:29.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:29.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:30.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:00:30.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42d9340) skgpid 27520 ospid 27520 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:31.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:31.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:32.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:32.025 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:00:32.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:33.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001d002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:33.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:33.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:34.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:34.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001e002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:34.729 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:34.729 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:34.729 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:34.729 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:34.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001f002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:34.736 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:34.736 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:36.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:36.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:36.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:37.027 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:37.028 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:38.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:38.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:38.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:39.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:00:40.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:40.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:40.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:42.030 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:42.030 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:42.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:42.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:42.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:43.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0020002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:44.060 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:00:44.061 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:00:44.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:00:44.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b5b40) pid(27701) version 11:1:1:4 [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:00:44.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:44.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:44.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:00:44.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0100) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:44.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0100) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:00:44.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:44.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:44.277 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:00:44.277 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42c6340) skgpid ospid 27701 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:44.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:46.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:46.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:46.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:47.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:47.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:48.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:48.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:48.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:49.579 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:00:49.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0021002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:49.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:49.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:49.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:49.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:49.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0022002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:49.819 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:49.819 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:49.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0023002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:49.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:00:49.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:00:49.979 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:00:49.979 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:49.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0024002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:49.987 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:00:49.987 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:00:50.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:50.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:50.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:52.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:52.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:52.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:52.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:52.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:53.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0025002b) incarnation(174631051) [ CSSD]2013-05-23 13:00:54.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:54.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:54.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:56.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:56.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:56.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:57.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:00:57.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:00:58.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:00:58.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:00:58.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:00:59.310 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:00:59.311 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:00:59.311 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:00:59.311 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0b60) proc(0x7f82b42b5b40) pid(27841) version 11:1:1:4 [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:00:59.318 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:00:59.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:00:59.325 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:00:59.325 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0100) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:00:59.325 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0100) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:00:59.527 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:00:59.527 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42e0b60) skgpid ospid 27841 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:00:59.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:00.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:00.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:00.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:01.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:01.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:01:02.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:02.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:02.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:03.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0026002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:04.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:04.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:04.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:05.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0027002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:05.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:05.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:05.204 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:01:05.204 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:05.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0028002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:05.212 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:05.212 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:05.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0029002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:05.230 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:05.230 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:05.230 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:05.230 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:05.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002a002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:05.238 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:05.238 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:05.356 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:01:05.357 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:01:05.359 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:01:05.359 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:01:06.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:06.045 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:06.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:06.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:06.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:08.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:08.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:08.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:09.664 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:10.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:10.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:10.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:11.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:11.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:12.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:12.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:12.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:13.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002b002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:14.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:14.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:14.570 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:14.571 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:01:14.571 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:14.571 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42b5b40) pid(27992) version 11:1:1:4 [ CSSD]2013-05-23 13:01:14.587 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:14.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:14.587 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42e0b60, requested num -1 [ CSSD]2013-05-23 13:01:14.587 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:14.587 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3e60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:01:14.588 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:01:14.588 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:14.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:14.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:01:14.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0100) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:14.595 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0100) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:01:14.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:14.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:14.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42d9340) skgpid ospid 27992 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:15.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:15.051 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:01:15.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:15.807 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:01:15.808 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:15.808 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42b5b40) pid(28041/28041) version 11:1:1:4 [ CSSD]2013-05-23 13:01:15.815 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:15.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:15.815 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:01:15.815 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 13:01:15.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:15.838 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:01:15.838 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:01:15.838 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 13:01:15.838 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:15.839 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42d9340) skgpid 28041 ospid 28041 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:16.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:16.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:16.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:18.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:18.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:18.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:19.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:20.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:20.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:20.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:01:20.272 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:01:20.272 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:01:20.272 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 13:01:20.273 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbd00 [ CSSD]2013-05-23 13:01:20.273 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbd00) con(0x7f82b429e330) skgpid 22648 ospid 22648 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:20.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:01:20.302 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:01:20.302 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:01:20.302 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0530 [ CSSD]2013-05-23 13:01:20.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0530) con(0x7f82b4257120) skgpid 22650 ospid 22650 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:20.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:20.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:20.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002c002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:20.486 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:20.486 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:20.486 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:20.486 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:20.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002d002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:20.494 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:20.494 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:20.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:22.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:22.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:22.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:23.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:23.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:01:23.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:23.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b5b40) pid(28093) version 11:1:1:4 [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:01:23.329 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:23.336 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:01:23.336 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:01:23.336 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:23.336 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:01:23.539 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:23.539 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42aee40) skgpid ospid 28093 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:23.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002e002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:24.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:24.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:24.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:25.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:25.058 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:26.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:26.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:26.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:27.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002f002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:27.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:27.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:27.388 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:27.388 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:27.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0030002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:27.396 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:27.396 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:28.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:28.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:28.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:29.722 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:29.832 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:29.832 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:01:29.833 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:29.833 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b5b40) pid(28175) version 11:1:1:4 [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:01:29.839 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:29.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:01:29.846 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:01:29.846 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:29.846 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:01:30.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:30.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42c6340) skgpid ospid 28175 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:30.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:30.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:30.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:30.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:30.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:32.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:32.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:32.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:33.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0031002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:34.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:34.064 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:01:34.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:34.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:34.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:35.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0032002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:35.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:35.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:35.742 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:35.742 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:35.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0033002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:35.750 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:35.750 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:36.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:36.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:36.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:38.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:38.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:38.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:39.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:39.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:39.751 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:40.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:40.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:41.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:42.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:42.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:43.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:43.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0034002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:44.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:44.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:44.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:44.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:45.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:45.094 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:45.095 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:01:45.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:45.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42b5b40) pid(28330) version 11:1:1:4 [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:01:45.102 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:45.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:01:45.109 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:01:45.109 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:01:45.110 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:01:45.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:45.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b4207f10) skgpid ospid 28330 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:46.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:46.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:47.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:48.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:48.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:49.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:49.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:49.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:49.777 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:01:50.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:50.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:51.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0035002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:51.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:51.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:51.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:51.014 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:51.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0036002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:51.023 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:51.023 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:51.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:52.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:52.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:53.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:53.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0037002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:54.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:54.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:54.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:54.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:55.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:56.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:56.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:57.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:58.181 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:01:58.181 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:01:58.182 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:01:58.182 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b5b40) pid(28463/28463) version 11:1:1:4 [ CSSD]2013-05-23 13:01:58.198 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:01:58.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:01:58.198 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:01:58.198 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 13:01:58.214 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:01:58.215 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:01:58.215 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:01:58.215 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 13:01:58.215 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:01:58.215 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42bad40) skgpid 28463 ospid 28463 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:01:58.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:01:58.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:01:59.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:01:59.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:01:59.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:01:59.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0038002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:59.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:01:59.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:01:59.775 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:01:59.775 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:01:59.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0039002b) incarnation(174631051) [ CSSD]2013-05-23 13:01:59.782 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:01:59.782 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:01:59.798 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:00.355 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:02:00.356 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:02:00.356 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:02:00.356 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42b5b40) pid(28479) version 11:1:1:4 [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:02:00.363 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:00.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:00.370 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:02:00.370 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:00.370 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:02:00.572 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:02:00.572 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b4257120) skgpid ospid 28479 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:00.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:00.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:01.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:02.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:02.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:02.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:02:02.832 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:02:02.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:02:02.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:02:02.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003a002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:02.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:02.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:02.899 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:02:02.899 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:02:02.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003b002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:02.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:02.907 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:03.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:03.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(003c002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:04.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:04.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:04.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:04.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:05.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:06.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003d002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:06.330 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:06.330 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:06.330 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:02:06.330 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:06.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003e002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:06.338 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:06.338 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:06.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:06.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:07.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:08.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:08.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:09.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:09.087 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:09.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:09.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:10.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:10.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:11.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:11.647 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:02:11.648 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:02:11.648 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:02:11.648 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42b5b40) pid(28637) version 11:1:1:4 [ CSSD]2013-05-23 13:02:12.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:12.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:13.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:13.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(003f002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:14.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:14.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:14.185 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:02:14.185 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42bad40) skgpid ospid 28637 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:14.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:14.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:15.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:15.605 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:02:15.606 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:02:15.607 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:02:15.607 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b5b40) pid(28963) version 11:1:1:4 [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:02:15.613 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:15.621 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:02:15.621 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:02:15.621 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:15.622 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:02:15.824 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:02:15.824 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42c6340) skgpid ospid 28963 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:16.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:16.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:17.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:18.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:18.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:19.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:19.093 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:19.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:19.845 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:20.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:20.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:21.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:21.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0040002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:21.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:21.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:21.584 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:02:21.584 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:21.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0041002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:21.592 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:21.592 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:22.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:22.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:23.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:23.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:02:23.579 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:02:23.580 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:02:23.580 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42b5b40) pid(29074) version 11:1:1:4 [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42e0b60, requested num -1 [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:02:23.587 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:23.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:02:23.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:02:23.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:23.596 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:02:23.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:02:23.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42d9340) skgpid ospid 29074 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:23.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0042002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:24.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:24.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:24.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:24.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:25.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:26.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:26.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:27.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:27.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0043002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:27.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:27.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:27.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:02:27.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:27.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0044002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:27.652 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:27.652 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:28.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:28.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:29.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:29.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:29.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:29.864 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:30.860 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:02:30.861 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:02:30.862 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:02:30.862 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0b60) proc(0x7f82b42b5b40) pid(29155) version 11:1:1:4 [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b5b40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:02:30.868 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:30.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:02:30.875 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:02:30.875 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0650) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:30.875 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0650) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:02:30.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:30.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:31.078 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:02:31.078 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42e0b60) skgpid ospid 29155 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:31.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:32.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:32.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:33.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:34.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0045002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:34.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:34.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:34.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:34.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:35.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:36.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0046002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:36.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:36.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:36.836 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:02:36.836 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:36.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0047002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:36.843 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:36.844 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:37.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:37.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:37.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:38.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:38.104 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:02:39.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:39.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:39.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:39.884 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:41.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:41.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:41.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:43.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:43.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:43.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:43.107 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:43.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:44.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0048002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:45.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:45.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:45.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:45.853 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:02:45.853 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:02:45.853 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:02:45.854 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 13:02:45.854 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf5a0 [ CSSD]2013-05-23 13:02:45.854 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf5a0) con(0x7f82b4204270) skgpid 23577 ospid 23577 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:45.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:02:45.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cbf40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:02:45.855 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cbf40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:02:45.855 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4202ee0 [ CSSD]2013-05-23 13:02:45.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4202ee0) con(0x7f82b42d8290) skgpid 23579 ospid 23579 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:46.113 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0100) allocated [ CSSD]2013-05-23 13:02:46.113 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:02:46.114 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0100 - 1,2,3 [ CSSD]2013-05-23 13:02:46.114 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42e0100) pid(29307) version 11:1:1:4 [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42e0100), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d80e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:02:46.120 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:46.127 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:02:46.127 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:02:46.127 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:02:46.127 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:02:46.330 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0100 [ CSSD]2013-05-23 13:02:46.330 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0100) con(0x7f82b42bad40) skgpid ospid 29307 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:47.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:47.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:47.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:48.109 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:48.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:49.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:49.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:49.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:49.906 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:02:51.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:51.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:51.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:52.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0049002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:52.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:02:52.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:02:52.087 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:02:52.087 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:02:52.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004a002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:52.095 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:02:52.095 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:02:53.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:53.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:53.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:53.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:53.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 13:02:53.545 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d8f40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:02:53.545 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d8f40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:02:53.545 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:02:53.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc960 [ CSSD]2013-05-23 13:02:53.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc960) con(0x7f82b42c9960) skgpid 25562 ospid 25562 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:02:53.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:54.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004b002b) incarnation(174631051) [ CSSD]2013-05-23 13:02:55.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:55.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:55.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:57.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:57.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:57.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:58.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:02:58.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:02:59.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:02:59.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:02:59.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:02:59.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:00.452 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:03:00.452 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:00.453 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:03:00.453 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42cbe70) pid(29299/29299) version 11:1:1:4 [ CSSD]2013-05-23 13:03:00.459 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cbe70), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:03:00.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:03:00.459 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:03:00.459 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:03:01.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:01.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:01.362 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:01.363 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:03:01.364 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:01.364 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c5f40) pid(29457) version 11:1:1:4 [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:01.369 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:01.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:03:01.376 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:03:01.376 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:01.376 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:01.578 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:01.579 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207f10) skgpid ospid 29457 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:01.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:02.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:02.119 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:03:03.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:03.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:03.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:04.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004c002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:05.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:05.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:05.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:07.122 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:07.122 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:07.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:07.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:07.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004d002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:07.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:03:07.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:03:07.340 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:03:07.340 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:07.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004e002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:07.347 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:03:07.347 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:03:07.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:09.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:09.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:09.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:09.948 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:11.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:11.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:11.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:12.125 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:12.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:13.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:13.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:13.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:14.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004f002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:15.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:15.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:15.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:16.611 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:16.612 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:03:16.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:16.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42c5f40) pid(29608) version 11:1:1:4 [ CSSD]2013-05-23 13:03:16.619 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:03:16.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:16.619 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:03:16.619 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:16.619 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:03:16.620 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:16.620 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:16.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:16.626 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:03:16.626 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42574a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:16.626 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42574a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:16.829 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:16.829 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42c6340) skgpid ospid 29608 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:17.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:17.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:17.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:17.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:17.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:19.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:19.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:19.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:19.968 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:21.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:21.131 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:03:21.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:21.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:21.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:22.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0050002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:22.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:03:22.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:03:22.591 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:03:22.591 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:22.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0051002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:22.599 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:03:22.599 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:03:23.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:23.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:23.832 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:23.833 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:23.834 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:23.834 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42c5f40) pid(29695) version 11:1:1:4 [ CSSD]2013-05-23 13:03:23.850 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:23.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:23.850 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d8f40 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:03:23.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:23.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:03:23.851 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:23.851 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:23.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:23.858 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d8f40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:03:23.858 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:23.859 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:24.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:24.061 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:24.061 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42c6340) skgpid ospid 29695 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:24.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0052002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:25.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:25.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:26.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:26.024 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:26.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:26.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:26.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c5f40) pid(29718) version 11:1:1:4 [ CSSD]2013-05-23 13:03:26.036 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:26.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:26.036 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b00d0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:03:26.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:03:26.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:03:26.037 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:26.037 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:26.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:26.043 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:03:26.043 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42574a0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:03:26.043 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42574a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:26.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:26.135 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:26.149 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 13:03:26.150 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:26.151 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 13:03:26.151 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b429e6d0) pid(29723) version 11:1:1:4 [ CSSD]2013-05-23 13:03:26.166 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:03:26.168 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:03:26.170 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:03:26.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 13:03:26.171 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42aee40) skgpid ospid 29723 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:26.246 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:26.246 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9340) skgpid ospid 29718 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:27.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:27.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:27.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0053002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:27.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:03:27.912 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:03:27.912 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:03:27.912 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:27.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0054002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:27.920 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:03:27.920 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:03:28.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:29.113 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:29.114 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:29.115 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:29.115 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42c5f40) pid(29755/29755) version 11:1:1:4 [ CSSD]2013-05-23 13:03:29.131 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:03:29.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:29.131 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:03:29.131 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 13:03:29.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:29.169 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:03:29.170 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:03:29.170 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:03:29.170 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:29.170 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42c6340) skgpid 29755 ospid 29755 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:29.361 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:29.361 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:29.362 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:29.362 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(29758/29758) version 11:1:1:4 [ CSSD]2013-05-23 13:03:29.378 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:29.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:29.378 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:03:29.378 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 13:03:29.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d8f40) [ CSSD]2013-05-23 13:03:29.432 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d8f40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:03:29.432 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d8f40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:03:29.432 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:03:29.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:29.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid 29758 ospid 29758 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:29.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:29.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:29.989 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:30.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:31.137 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:31.137 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:31.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:31.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:31.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:31.869 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:03:31.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:31.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42c5f40) pid(29785) version 11:1:1:4 [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:31.887 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:31.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:03:31.894 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:03:31.894 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42574a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:31.894 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42574a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:32.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:32.096 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:32.096 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207f10) skgpid ospid 29785 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:33.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:33.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:34.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:34.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0055002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:35.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:35.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:36.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:36.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:36.141 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:37.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:37.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:37.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0056002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:37.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:03:37.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:03:37.843 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:03:37.843 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:37.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0057002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:37.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:03:37.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:03:38.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:39.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:39.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:40.010 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:40.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:40.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:40.144 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:03:41.546 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:41.547 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:03:41.548 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:41.548 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c5f40) pid(29926) version 11:1:1:4 [ CSSD]2013-05-23 13:03:41.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:41.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:42.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:42.172 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9340) skgpid ospid 29926 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:42.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:43.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:43.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:44.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:44.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0058002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:45.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:45.147 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:45.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:45.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:46.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:47.129 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:03:47.130 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:03:47.131 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:03:47.131 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42c5f40) pid(30119) version 11:1:1:4 [ CSSD]2013-05-23 13:03:47.137 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:03:47.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:47.137 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:03:47.137 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:47.137 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:03:47.138 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:03:47.138 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:47.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:03:47.145 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:03:47.145 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:03:47.145 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:03:47.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:03:47.347 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9340) skgpid ospid 30119 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:47.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:47.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:48.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:49.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:49.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:50.031 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:03:50.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:50.150 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:50.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:50.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 13:03:50.373 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9760), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:03:50.373 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9760), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:03:50.373 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 13:03:50.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 13:03:50.381 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41edd50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:03:50.381 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41edd50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:03:50.381 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 13:03:50.383 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42b3350) skgpid 24248 ospid 24248 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:50.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:03:50.392 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:03:50.392 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:03:50.392 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:03:50.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:03:50.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4286800) skgpid 32008 ospid 32008 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:03:51.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:51.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:52.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:53.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0059002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:53.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:03:53.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:03:53.094 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:03:53.094 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:03:53.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005a002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:53.103 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:03:53.103 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:03:53.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:53.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:54.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005b002b) incarnation(174631051) [ CSSD]2013-05-23 13:03:54.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:55.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:55.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:03:55.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:55.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:56.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:57.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:57.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:03:58.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:03:59.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:03:59.156 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:03:59.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:03:59.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:00.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:00.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:01.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:01.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:02.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:02.380 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:02.381 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:04:02.382 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:02.382 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42833d0) pid(30282) version 11:1:1:4 [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:02.388 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:02.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:04:02.395 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:04:02.395 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:02.395 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:02.598 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:02.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4286800) skgpid ospid 30282 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:03.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:03.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:04.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:04.159 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:04.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005c002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:04.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:05.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:05.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:06.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:07.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:07.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:08.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:08.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005d002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:08.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:04:08.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:04:08.347 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:04:08.347 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:08.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005e002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:08.355 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:04:08.355 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:04:09.162 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:09.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:09.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:09.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:10.071 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:10.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:11.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:11.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:12.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:12.471 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:12.471 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:04:12.472 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:12.472 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(30392) version 11:1:1:4 [ CSSD]2013-05-23 13:04:12.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 13:04:12.594 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:04:12.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 13:04:12.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42583a0) pid(30402) version 11:1:1:4 [ CSSD]2013-05-23 13:04:12.622 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:04:12.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:04:12.627 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 13:04:12.627 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42c6340) skgpid ospid 30402 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5305/0x7f82b41bf650) [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5305 (0x7f82b41bf650) [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42e0100/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:12.794 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:04:12.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5305 (0x7f82b41bf650) [ CSSD]2013-05-23 13:04:12.800 [1199044928] >TRACE: clssgmExitGrock: client 5305 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:04:12.800 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:04:12.800 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:12.801 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:12.801 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 30392 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:13.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:13.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:14.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:14.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:14.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005f002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:14.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:15.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:15.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:16.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:17.633 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:17.634 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:04:17.635 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:17.635 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(30443) version 11:1:1:4 [ CSSD]2013-05-23 13:04:17.641 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:04:17.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:04:17.641 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:04:17.641 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:17.641 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:04:17.642 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:17.642 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:17.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:04:17.648 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:04:17.648 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:17.648 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:17.851 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:17.851 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 30443 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:17.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:17.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:18.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:19.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:19.168 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:19.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:19.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:20.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:20.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:21.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:21.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:22.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:23.170 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:23.171 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:04:23.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0060002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:23.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:04:23.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:04:23.598 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:04:23.598 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:23.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0061002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:23.605 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:04:23.605 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:04:23.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:23.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:24.104 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:24.105 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:04:24.106 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:24.106 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42833d0) pid(30535) version 11:1:1:4 [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:24.112 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:24.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:04:24.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:04:24.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:24.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:24.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0062002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:24.322 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:24.322 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42ccc30) skgpid ospid 30535 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:24.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:25.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:25.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:26.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:27.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:27.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:28.173 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:28.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:28.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0063002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:28.179 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:04:28.179 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:04:28.179 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:04:28.179 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:28.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0064002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:28.186 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:04:28.186 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:04:28.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:29.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:29.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:30.112 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:30.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:31.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:31.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:32.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:32.885 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:32.886 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:04:32.886 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:32.886 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42833d0) pid(30634) version 11:1:1:4 [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:32.893 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:32.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:04:32.900 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:04:32.900 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:32.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:33.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:33.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42ccc30) skgpid ospid 30634 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:33.176 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:33.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:33.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:33.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:34.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0065002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:34.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:35.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:35.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:36.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:38.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:38.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:38.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:38.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:38.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:38.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0066002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:38.859 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:04:38.859 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:04:38.859 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:04:38.859 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:38.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0067002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:38.866 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:04:38.866 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:04:40.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:40.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:40.134 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:40.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:42.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:42.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:42.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:43.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:43.182 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:44.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:44.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:44.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0068002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:44.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:46.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:46.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:46.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:47.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:47.185 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:04:48.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:48.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:48.135 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:48.136 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:04:48.137 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:48.137 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42833d0) pid(30784) version 11:1:1:4 [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:04:48.154 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:48.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:04:48.161 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:04:48.161 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:04:48.161 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:04:48.364 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:04:48.364 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42c6340) skgpid ospid 30784 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:04:48.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:48.843 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:04:48.844 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:04:48.845 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:04:48.845 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42833d0) pid(29297/29297) version 11:1:1:4 [ CSSD]2013-05-23 13:04:48.850 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42833d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:04:48.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:04:48.850 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:04:48.851 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:04:49.540 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cbe70), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:04:49.540 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:04:49.540 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:04:49.540 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:04:50.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:50.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:50.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:04:50.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:52.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:52.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:52.188 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:52.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:52.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:54.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0069002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:54.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:04:54.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:04:54.120 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:04:54.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:04:54.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006a002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:54.127 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:04:54.127 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:04:54.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:54.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:54.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006b002b) incarnation(174631051) [ CSSD]2013-05-23 13:04:54.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:56.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:56.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:56.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:04:57.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:04:57.191 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:04:58.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:04:58.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:04:58.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:00.176 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:00.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:00.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:00.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:02.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:02.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:02.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:02.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:02.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:03.401 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:05:03.402 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:05:03.402 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:05:03.402 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258460) proc(0x7f82b42b3cd0) pid(30936) version 11:1:1:4 [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42b3cd0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0100/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:05:03.409 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:03.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:05:03.417 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:05:03.417 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:03.417 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:05:03.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:05:03.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b4258460) skgpid ospid 30936 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:04.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:04.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:04.349 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 13:05:04.350 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:05:04.351 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 13:05:04.351 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b429e0b0) pid(30985/30985) version 11:1:1:4 [ CSSD]2013-05-23 13:05:04.357 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e0b0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:05:04.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:05:04.357 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:05:04.357 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:05:04.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006c002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 13:05:04.638 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42ccc30) skgpid 30985 ospid 30985 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:04.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:06.196 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:06.197 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:05:06.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:06.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:06.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:08.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:08.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:08.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:09.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006d002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:09.370 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:05:09.370 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:05:09.370 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:05:09.370 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:09.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006e002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:09.380 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:05:09.380 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:05:10.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:10.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:10.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:10.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:11.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:11.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:12.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:12.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:12.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:14.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:14.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:14.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006f002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:14.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:15.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 13:05:15.897 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:05:15.897 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:05:15.897 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8570 [ CSSD]2013-05-23 13:05:15.903 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8570) con(0x7f82b427c5d0) skgpid 23581 ospid 23581 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:15.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204710) [ CSSD]2013-05-23 13:05:15.908 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204710), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:05:15.908 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204710), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:05:15.908 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:05:15.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dfa60 [ CSSD]2013-05-23 13:05:15.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dfa60) con(0x7f82b42dcf40) skgpid 25512 ospid 25512 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:16.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:16.203 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:16.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:16.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:16.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:18.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:18.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:18.653 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:05:18.654 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:05:18.654 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:05:18.654 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(31085) version 11:1:1:4 [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:05:18.660 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:18.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:05:18.667 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:05:18.667 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:18.667 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:05:18.869 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:05:18.869 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 31085 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:18.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:20.219 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:20.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:20.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:20.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:21.205 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:21.205 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:22.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:22.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:23.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:24.371 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:05:24.372 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:05:24.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:05:24.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(31168) version 11:1:1:4 [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:05:24.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:24.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:05:24.385 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:05:24.385 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:24.386 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:05:24.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:24.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:24.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0070002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:24.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:05:24.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 31168 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:24.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0071002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:24.624 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:05:24.624 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:05:24.624 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:05:24.624 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:24.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0072002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:24.632 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:05:24.633 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:05:25.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:26.208 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:26.208 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:26.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:26.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:27.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:28.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:28.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:28.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0073002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:28.457 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:05:28.457 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:05:28.457 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:05:28.457 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:28.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0074002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:28.464 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:05:28.464 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:05:29.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:30.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:30.210 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:05:30.245 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:30.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:30.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:31.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:32.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:32.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:33.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:33.905 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:05:33.906 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:05:33.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:05:33.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b3cd0) pid(31239) version 11:1:1:4 [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:05:33.913 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:33.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:05:33.920 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:05:33.920 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:33.920 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:05:34.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:05:34.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b427c5d0) skgpid ospid 31239 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:34.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0075002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:34.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:34.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:35.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:35.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:35.213 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:36.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:36.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:37.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:38.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:38.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:39.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:39.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0076002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:39.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:05:39.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:05:39.884 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:05:39.884 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:39.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0077002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:39.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:05:39.892 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:05:40.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:40.216 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:40.271 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:40.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:40.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:41.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:42.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:42.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:43.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:44.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0078002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:44.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:44.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:45.218 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:45.219 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:45.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:46.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:46.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:47.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:48.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:48.597 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:49.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:05:49.155 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:05:49.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:05:49.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b3cd0) pid(31380) version 11:1:1:4 [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:05:49.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:49.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:05:49.169 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:05:49.169 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:05:49.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:05:49.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:49.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:05:49.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b427c5d0) skgpid ospid 31380 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:05:50.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:50.222 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:50.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:05:50.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:50.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:51.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:52.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:52.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:53.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:54.224 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:54.225 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:05:54.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0079002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:54.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:54.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:55.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007a002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:55.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:05:55.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:05:55.136 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:05:55.136 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:05:55.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007b002b) incarnation(174631051) [ CSSD]2013-05-23 13:05:55.143 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:05:55.143 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:05:55.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:56.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:56.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:57.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:05:58.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:05:58.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:05:59.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:05:59.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:05:59.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:00.360 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:00.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:00.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:01.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:02.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:02.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:03.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:04.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:04.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:04.415 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:06:04.416 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:06:04.416 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:06:04.416 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(31530) version 11:1:1:4 [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:06:04.423 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:04.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:06:04.431 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:06:04.431 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:04.431 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:06:04.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007c002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:04.633 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:06:04.633 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 31530 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:04.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:04.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:05.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:05.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007d002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:05.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:05.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:05.609 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:06:05.609 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:05.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007e002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:05.617 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:05.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:05.747 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:06:05.748 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:06:05.749 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:06:05.750 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:06:06.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:06.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:07.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:08.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:08.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:09.233 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:09.233 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:09.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:10.384 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:10.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007f002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:10.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:10.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:10.397 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:06:10.397 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:10.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0080002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:10.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:10.404 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:10.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:10.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:11.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:12.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:12.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:13.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:14.236 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:14.236 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:14.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0081002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:14.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:14.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:15.316 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:06:15.317 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:06:15.318 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:06:15.318 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b3cd0) pid(31658/31658) version 11:1:1:4 [ CSSD]2013-05-23 13:06:15.334 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:15.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:15.334 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:06:15.334 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:06:15.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:15.375 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:06:15.375 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:06:15.375 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:06:15.376 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:06:15.376 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42ccc30) skgpid 31658 ospid 31658 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:15.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:16.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:16.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:17.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:18.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:18.238 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:06:18.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:18.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:19.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:19.668 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 13:06:19.669 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:06:19.670 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 13:06:19.670 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b3cd0) pid(31691) version 11:1:1:4 [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:06:19.676 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:19.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:06:19.683 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:06:19.683 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:19.683 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:06:19.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 13:06:19.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42ccc30) skgpid ospid 31691 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:20.407 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:20.423 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42c9ae0) [ CSSD]2013-05-23 13:06:20.423 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42c9ae0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:06:20.423 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42c9ae0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:06:20.423 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 13:06:20.427 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:06:20.427 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:06:20.427 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:06:20.427 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:06:20.428 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3460 [ CSSD]2013-05-23 13:06:20.428 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3460) con(0x7f82b42e1180) skgpid 26334 ospid 26334 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:20.799 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 13:06:20.800 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:06:20.801 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 13:06:20.801 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b429e0b0) pid(31740/31740) version 11:1:1:4 [ CSSD]2013-05-23 13:06:20.807 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e0b0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:06:20.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:06:20.807 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:06:20.807 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:06:20.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:20.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:21.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:22.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:22.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:23.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:23.241 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:23.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:24.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0082002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:24.629 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 13:06:24.630 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:06:24.631 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 13:06:24.631 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b429db90) pid(31770) version 11:1:1:4 [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429db90), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:06:24.638 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:24.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:06:24.646 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:06:24.646 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:24.646 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:06:24.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:24.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:24.849 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 13:06:24.849 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42d9340) skgpid ospid 31770 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:25.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0083002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:25.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:25.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:25.658 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:06:25.659 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:25.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0084002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:25.667 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:25.667 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:25.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:26.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:26.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:27.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:28.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:28.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:28.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0085002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:28.711 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:28.711 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:28.711 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:06:28.711 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:28.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0086002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:28.718 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:28.718 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:28.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:28.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:29.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:30.430 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:30.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:30.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:31.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:32.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:32.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:33.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:33.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:33.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:34.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0087002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:34.922 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 13:06:34.923 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:06:34.923 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 13:06:34.923 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b429db90) pid(31873) version 11:1:1:4 [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429db90), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:06:34.930 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:34.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:06:34.936 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:06:34.936 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:34.936 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:06:34.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:34.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:35.139 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 13:06:35.139 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b427c5d0) skgpid ospid 31873 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:35.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:37.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:37.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:37.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:38.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:38.250 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:39.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:39.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:39.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:40.460 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:40.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0088002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:40.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:40.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:40.914 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:06:40.915 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:40.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0089002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:40.920 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:40.920 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:41.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:41.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:41.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:42.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:42.253 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:06:43.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:43.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:43.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:44.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008a002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:45.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:45.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:45.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:46.307 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e0b0), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 13:06:46.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:06:46.308 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:06:46.308 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 13:06:47.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:47.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:47.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:47.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:47.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:49.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:49.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:49.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:50.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:06:50.173 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:06:50.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:06:50.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5b40) pid(32023) version 11:1:1:4 [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:06:50.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:50.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:06:50.186 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:06:50.186 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:06:50.187 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:06:50.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:06:50.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42ccc30) skgpid ospid 32023 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:06:50.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:06:51.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:51.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:51.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:52.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:52.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:53.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:53.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:53.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:54.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008b002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:55.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:55.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:55.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:56.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008c002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:56.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:06:56.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:06:56.163 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:06:56.163 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:06:56.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008d002b) incarnation(174631051) [ CSSD]2013-05-23 13:06:56.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:06:56.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:06:57.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:57.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:57.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:06:57.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:06:57.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:06:59.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:06:59.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:06:59.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:00.521 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:01.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:01.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:01.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:01.264 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:07:01.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:03.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:03.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:03.148 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:07:03.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:07:03.150 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:07:03.151 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:07:03.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008e002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:03.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:03.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:03.218 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:07:03.218 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:07:03.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008f002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:03.226 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:03.226 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:03.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:04.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0090002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:05.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:05.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:05.352 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:07:05.353 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:07:05.353 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:07:05.353 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42b5b40) pid(32176) version 11:1:1:4 [ CSSD]2013-05-23 13:07:05.360 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:07:05.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:07:05.360 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:07:05.360 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:05.360 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:05.361 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:05.361 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:05.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:07:05.367 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:05.367 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:05.367 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:05.431 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 13:07:05.432 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:07:05.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 13:07:05.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b42cbb70) pid(32187) version 11:1:1:4 [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cbb70), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9050/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:05.439 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:05.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:07:05.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:05.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:05.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:05.570 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:07:05.570 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42a3c70) skgpid ospid 32176 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:05.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 13:07:05.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b42b46c0) skgpid ospid 32187 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:05.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:06.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:06.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:07.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:07.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:08.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:09.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:09.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:10.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:10.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:11.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:11.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:11.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:11.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:11.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0091002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:11.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:11.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:11.418 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:07:11.418 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:11.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0092002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:11.426 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:11.426 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:11.629 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:07:11.630 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:07:11.630 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:07:11.630 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42b5840) pid(32305) version 11:1:1:4 [ CSSD]2013-05-23 13:07:12.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:13.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:13.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:14.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:14.273 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:07:14.273 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b42a3c70) skgpid ospid 32305 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:14.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0093002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:15.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:15.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:16.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:16.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:16.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:17.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:17.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:18.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:19.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:19.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:20.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:20.574 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:20.681 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:07:20.682 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:07:20.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:07:20.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b5840) pid(32670) version 11:1:1:4 [ CSSD]2013-05-23 13:07:20.688 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b46c0, requested num -1 [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:20.689 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:20.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:07:20.695 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:20.695 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:20.695 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:20.898 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:07:20.898 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b427c5d0) skgpid ospid 32670 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:21.276 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:21.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:21.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:21.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:22.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:23.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:23.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:24.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:24.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0094002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:24.890 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:07:24.891 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:07:24.891 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:07:24.891 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b5840) pid(32739) version 11:1:1:4 [ CSSD]2013-05-23 13:07:24.897 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:07:24.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:07:24.897 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:07:24.898 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:24.898 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:24.898 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:24.898 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:24.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:07:24.904 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:24.904 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:24.904 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:25.107 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:07:25.107 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b427c5d0) skgpid ospid 32739 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:25.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:25.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:26.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:26.279 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:26.280 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:26.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0095002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:26.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:26.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:26.669 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:07:26.669 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:26.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0096002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:26.676 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:26.676 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:27.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:27.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:28.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:28.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0097002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:28.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:28.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:28.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:07:28.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:28.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0098002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:28.981 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:28.981 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:29.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:29.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:30.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:30.600 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:31.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:31.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:31.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:31.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:32.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:33.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:33.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:34.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:34.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0099002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:34.839 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:07:34.840 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:07:34.841 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:07:34.841 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42b5840) pid(370) version 11:1:1:4 [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:34.848 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:34.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:07:34.854 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:34.854 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:34.854 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:35.057 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:07:35.057 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b42a3c70) skgpid ospid 370 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:35.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:35.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:35.936 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429db90) allocated [ CSSD]2013-05-23 13:07:35.937 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:07:35.937 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429db90 - 1,2,3 [ CSSD]2013-05-23 13:07:35.937 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b429db90) pid(383) version 11:1:1:4 [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429db90), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:35.954 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:35.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:07:35.961 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:35.961 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:35.962 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:36.164 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429db90 [ CSSD]2013-05-23 13:07:36.164 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429db90) con(0x7f82b42a3c70) skgpid ospid 383 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:36.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:36.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:36.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:37.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:37.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:38.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:39.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:39.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:40.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:40.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:41.289 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:41.289 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:41.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:41.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:41.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009a002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:41.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:41.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:41.924 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:07:41.924 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:41.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009b002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:41.932 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:41.932 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:42.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:43.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:43.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:44.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:44.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(009c002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:45.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:45.292 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:07:45.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:45.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:46.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:47.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:47.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:48.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:49.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:49.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:50.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:50.295 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:50.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:50.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:07:51.198 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:07:51.199 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:07:51.200 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:07:51.200 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b5b40) pid(549) version 11:1:1:4 [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b46c0, requested num -1 [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:07:51.206 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:51.213 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:07:51.213 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:07:51.213 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:07:51.213 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:07:51.416 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:07:51.416 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b427c5d0) skgpid ospid 549 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:07:51.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:51.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:52.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:53.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:53.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:54.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:54.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(009d002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:55.297 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:07:55.298 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:07:55.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:55.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:56.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:57.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009e002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:57.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:07:57.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:07:57.176 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:07:57.176 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:07:57.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009f002b) incarnation(174631051) [ CSSD]2013-05-23 13:07:57.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:07:57.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:07:57.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:57.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:07:58.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:07:59.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:07:59.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:00.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:00.300 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:00.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:00.669 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:01.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:01.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:02.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:03.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:03.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:04.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:04.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a0002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:05.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:05.303 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:05.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:05.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:06.456 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:08:06.457 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:08:06.457 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:08:06.457 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5b40) pid(699) version 11:1:1:4 [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:06.464 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:06.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:08:06.470 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:08:06.470 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:06.471 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:06.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:06.673 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:08:06.673 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42ccc30) skgpid ospid 699 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:07.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:07.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:08.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:09.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:09.305 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:08:09.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:09.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:10.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:10.693 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:11.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:11.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:12.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a1002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:12.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:08:12.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:08:12.427 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:08:12.427 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:12.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a2002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:12.435 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:08:12.435 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:08:12.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:13.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:13.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:14.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:14.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:14.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:14.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a3002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:15.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:15.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:16.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:17.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:17.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:18.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:19.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:19.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:19.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:19.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:20.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:20.714 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:21.706 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:08:21.707 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:08:21.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:08:21.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42b5b40) pid(852) version 11:1:1:4 [ CSSD]2013-05-23 13:08:21.713 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:08:21.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:08:21.713 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b46c0, requested num -1 [ CSSD]2013-05-23 13:08:21.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:21.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:08:21.714 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:21.714 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:21.721 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:08:21.721 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:08:21.721 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:21.721 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:21.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:21.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:21.923 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:08:21.923 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b427c5d0) skgpid ospid 852 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:22.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:23.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:23.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:24.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:24.315 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:24.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:24.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a4002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:25.149 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5b40) allocated [ CSSD]2013-05-23 13:08:25.150 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:25.150 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5b40 - 1,2,3 [ CSSD]2013-05-23 13:08:25.150 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42b5b40) pid(915) version 11:1:1:4 [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5b40), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:25.157 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:25.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:08:25.165 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:08:25.165 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:25.166 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:25.368 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5b40 [ CSSD]2013-05-23 13:08:25.368 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5b40) con(0x7f82b42a3c70) skgpid ospid 915 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:25.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:25.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:26.326 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39a0) allocated [ CSSD]2013-05-23 13:08:26.327 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:26.328 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39a0 - 1,2,3 [ CSSD]2013-05-23 13:08:26.328 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b39a0) pid(935) version 11:1:1:4 [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b39a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42cd480 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:26.334 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:26.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:08:26.341 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:08:26.341 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:08:26.341 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:26.448 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 13:08:26.449 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:26.449 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 13:08:26.449 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b42cbb70) pid(940) version 11:1:1:4 [ CSSD]2013-05-23 13:08:26.464 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:08:26.466 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:08:26.468 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:08:26.470 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 13:08:26.470 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b42b46c0) skgpid ospid 940 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:26.544 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39a0 [ CSSD]2013-05-23 13:08:26.544 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39a0) con(0x7f82b42ccc30) skgpid ospid 935 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:26.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:27.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a5002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:27.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:08:27.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:08:27.679 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:08:27.679 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:27.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a6002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:27.686 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:08:27.686 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:08:27.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:27.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:28.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:28.317 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:08:28.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:29.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a7002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:29.230 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:08:29.230 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:08:29.230 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:08:29.230 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:29.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a8002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:29.237 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:08:29.238 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:08:29.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:29.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:30.738 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:30.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:31.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:31.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:32.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:33.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:33.320 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:33.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:33.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:34.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:34.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a9002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:35.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:35.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:36.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:36.966 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:08:36.967 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:08:36.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:08:36.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5840) pid(1023) version 11:1:1:4 [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42b46c0, requested num -1 [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:36.973 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:36.980 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:08:36.980 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:08:36.980 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:36.980 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:37.183 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:08:37.183 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b42ccc30) skgpid ospid 1023 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:37.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:37.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:38.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:38.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:38.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:39.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:39.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:40.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:08:40.611 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:40.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:08:40.611 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42b5840) pid(1093/1093) version 11:1:1:4 [ CSSD]2013-05-23 13:08:40.617 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:08:40.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:08:40.617 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:08:40.617 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:08:40.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:08:40.630 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:08:40.630 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:08:40.630 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:08:40.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:08:40.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b42a3c70) skgpid 1093 ospid 1093 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:40.758 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:40.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 13:08:40.776 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:40.776 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 13:08:40.776 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5840) pid(1137/1137) version 11:1:1:4 [ CSSD]2013-05-23 13:08:40.782 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b5840), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:08:40.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:08:40.782 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:08:40.782 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:08:40.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:41.007 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 13:08:41.007 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:41.008 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 13:08:41.008 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e6d0) pid(1110) version 11:1:1:4 [ CSSD]2013-05-23 13:08:41.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 13:08:41.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42a9150) skgpid ospid 1110 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:42.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:42.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:42.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:42.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00aa002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:42.930 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:08:42.930 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:08:42.930 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:08:42.930 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:42.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ab002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:42.936 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:08:42.936 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:08:43.326 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:43.326 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:44.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:44.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:44.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:44.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ac002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:46.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:46.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:46.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:48.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:48.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:48.329 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:48.329 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:48.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:50.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:50.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:50.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:08:50.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:52.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:52.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:52.216 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 13:08:52.216 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:08:52.217 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 13:08:52.217 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e330) pid(1359) version 11:1:1:4 [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e330), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42b46c0, requested num -1 [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9050/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:08:52.223 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:52.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:08:52.230 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:08:52.230 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:08:52.230 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:08:52.332 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:52.332 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:08:52.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 13:08:52.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42a9150) skgpid ospid 1359 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:08:52.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:53.224 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:08:53.224 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:53.225 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:08:53.225 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e400) pid(510/510) version 11:1:1:4 [ CSSD]2013-05-23 13:08:53.241 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e400), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:08:53.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:08:53.241 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:08:53.241 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:08:53.498 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e400), client(2/0x7f82b41edd50) [ CSSD]2013-05-23 13:08:53.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 13:08:53.498 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:08:53.498 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:08:54.044 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d38d0) allocated [ CSSD]2013-05-23 13:08:54.044 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:08:54.045 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d38d0 - 1,2,3 [ CSSD]2013-05-23 13:08:54.045 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429eb50) proc(0x7f82b42d38d0) pid(608/608) version 11:1:1:4 [ CSSD]2013-05-23 13:08:54.061 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d38d0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:08:54.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:08:54.061 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:08:54.061 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:08:54.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:54.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:54.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:54.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ad002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:56.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:56.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:56.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:08:57.335 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:08:57.335 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:08:58.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:08:58.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:08:58.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ae002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:58.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:08:58.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:08:58.180 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:08:58.180 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:08:58.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00af002b) incarnation(174631051) [ CSSD]2013-05-23 13:08:58.188 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:08:58.188 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:08:58.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:00.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:00.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:00.804 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:01.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:02.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:02.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:02.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:02.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:03.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:04.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:04.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:05.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b0002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:05.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:06.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:06.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:07.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:07.342 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:07.343 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:07.467 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:07.468 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:09:07.469 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:07.469 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fe080) pid(1529) version 11:1:1:4 [ CSSD]2013-05-23 13:09:07.475 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 13:09:07.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:09:07.475 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 13:09:07.475 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:07.475 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:09:07.476 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:07.476 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:07.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:09:07.482 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:09:07.482 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:07.482 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:07.685 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:07.685 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b427c5d0) skgpid ospid 1529 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:08.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:08.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:09.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:10.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:10.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:10.826 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:11.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:11.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:11.345 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:09:12.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:12.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:12.877 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:12.878 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:09:12.879 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:12.879 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3820) proc(0x7f82b41fe080) pid(1626) version 11:1:1:4 [ CSSD]2013-05-23 13:09:12.998 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204650) allocated [ CSSD]2013-05-23 13:09:12.998 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:09:12.999 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204650 - 1,2,3 [ CSSD]2013-05-23 13:09:12.999 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b4204650) pid(1636) version 11:1:1:4 [ CSSD]2013-05-23 13:09:13.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:09:13.018 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:09:13.022 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204650 [ CSSD]2013-05-23 13:09:13.022 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204650) con(0x7f82b42b46c0) skgpid ospid 1636 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5306/0x7f82b42ccac0) [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5306 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42ccac0 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d65f0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:13.100 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:09:13.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5306 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:09:13.106 [1199044928] >TRACE: clssgmExitGrock: client 5306 (0x7f82b42ccac0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:09:13.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d68f0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:09:13.106 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42d68f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:13.107 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:13.107 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b42d3820) skgpid ospid 1626 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:13.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:13.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b1002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:13.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:09:13.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:09:13.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:09:13.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:13.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b2002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:13.451 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:09:13.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:09:14.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:14.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:15.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b3002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:15.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:16.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:16.348 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:16.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:16.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:17.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:18.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:18.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:19.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:20.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:20.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:20.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:21.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:21.351 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:21.351 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:22.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:22.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:22.720 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:22.721 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:09:22.722 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:22.722 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b41fe080) pid(1707) version 11:1:1:4 [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42d3820, requested num -1 [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:22.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:22.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:09:22.735 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:09:22.735 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:22.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:22.938 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:22.938 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b42b46c0) skgpid ospid 1707 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:23.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:24.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:24.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:25.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b4002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:25.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:25.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:25.413 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:09:25.413 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:25.413 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fe080) pid(1766) version 11:1:1:4 [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:25.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:25.427 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:09:25.427 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:09:25.427 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:25.427 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:25.630 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:25.630 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b427c5d0) skgpid ospid 1766 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:26.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:26.355 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:26.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:26.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:27.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:28.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:28.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:28.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b5002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:28.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:09:28.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:09:28.695 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:09:28.695 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:28.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b6002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:28.702 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:09:28.702 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:09:29.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:29.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b7002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:29.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:09:29.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:09:29.497 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:09:29.497 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:29.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b8002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:29.505 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:09:29.505 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:09:30.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:30.357 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:09:30.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:30.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:30.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:31.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:32.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:32.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:33.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:34.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:34.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:35.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b9002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:35.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:35.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:35.360 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:36.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:36.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:37.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:37.974 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:37.975 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:09:37.975 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:37.975 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fe080) pid(1885) version 11:1:1:4 [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:37.982 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:37.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:09:37.989 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:09:37.989 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:37.989 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:38.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:38.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b427c5d0) skgpid ospid 1885 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:38.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:38.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:39.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:40.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:40.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:40.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:40.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:40.891 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:41.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:42.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:42.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:43.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:43.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ba002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:43.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:09:43.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:09:43.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:09:43.946 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:43.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00bb002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:43.953 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:09:43.953 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:09:44.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:44.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:45.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00bc002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:45.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:45.366 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:45.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:46.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:46.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:47.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:48.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:48.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:49.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:50.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:50.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:50.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:50.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:50.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:09:51.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:52.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:52.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:53.224 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:09:53.225 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:09:53.225 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:09:53.225 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b41fe080) pid(2038) version 11:1:1:4 [ CSSD]2013-05-23 13:09:53.231 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:09:53.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:09:53.231 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42d3820, requested num -1 [ CSSD]2013-05-23 13:09:53.231 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:53.231 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:09:53.232 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:09:53.232 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:53.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:09:53.239 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:09:53.239 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:09:53.239 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:09:53.441 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:09:53.441 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b42b46c0) skgpid ospid 2038 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:09:53.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:54.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:54.371 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:09:54.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:54.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:55.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00bd002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:55.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:56.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:56.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:57.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:09:58.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:09:58.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:09:59.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00be002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:59.206 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:09:59.206 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:09:59.206 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:09:59.206 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:09:59.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00bf002b) incarnation(174631051) [ CSSD]2013-05-23 13:09:59.212 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:09:59.212 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dbf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:09:59.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:09:59.374 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:09:59.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:00.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:00.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:00.934 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:01.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:02.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:02.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:03.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:04.378 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:04.378 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:04.815 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:10:04.815 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:10:04.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:10:04.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46c0) proc(0x7f82b41fe080) pid(2358/2358) version 11:1:1:4 [ CSSD]2013-05-23 13:10:04.832 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:10:04.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:10:04.832 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:10:04.832 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 13:10:04.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:04.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:10:05.114 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b42b46c0) skgpid 2358 ospid 2358 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:05.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c0002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:05.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:06.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:06.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:07.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:08.475 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe080) allocated [ CSSD]2013-05-23 13:10:08.476 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:10:08.476 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe080 - 1,2,3 [ CSSD]2013-05-23 13:10:08.476 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3820) proc(0x7f82b41fe080) pid(2384) version 11:1:1:4 [ CSSD]2013-05-23 13:10:08.482 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fe080), client(1/0x7f82b42b3550) [ CSSD]2013-05-23 13:10:08.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:10:08.482 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3550 with con 0x7f82b42d3db0, requested num -1 [ CSSD]2013-05-23 13:10:08.482 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:08.482 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d6770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:10:08.483 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:10:08.483 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:08.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3550) [ CSSD]2013-05-23 13:10:08.490 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3550), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:10:08.490 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:08.490 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:10:08.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe080 [ CSSD]2013-05-23 13:10:08.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe080) con(0x7f82b42d3820) skgpid ospid 2384 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:08.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:10:08.850 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:10:08.850 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:10:08.851 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:10:08.851 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 13:10:08.851 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b42ccc30) skgpid 1137 ospid 1137 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:08.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:08.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:09.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:09.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:09.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:10.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:10.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:10.955 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:11.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:12.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:12.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:13.383 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:13.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:10:13.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:14.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c1002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:14.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:10:14.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:10:14.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:10:14.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:14.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c2002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:14.461 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:10:14.461 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:10:14.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:14.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:15.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c3002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:15.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:15.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:10:15.965 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:10:15.965 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:10:15.965 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:10:15.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:10:15.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207cd0) skgpid 29297 ospid 29297 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:15.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:10:15.967 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:10:15.967 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:10:15.967 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:10:15.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:10:15.970 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:10:15.970 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:10:15.970 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:10:15.971 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:10:15.971 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42bad40) skgpid 29299 ospid 29299 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:16.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:16.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:17.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:18.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:18.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:18.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:18.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:19.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:20.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:20.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:20.978 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:21.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac06c060) [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac06c060), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac06c060), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0724b0 [ CSSD]2013-05-23 13:10:21.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0724b0) con(0x7f82ac06c940) skgpid 3235 ospid 3235 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:22.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:22.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:23.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:23.390 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:23.725 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:10:23.726 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:10:23.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:10:23.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42833d0) pid(2524) version 11:1:1:4 [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:10:23.733 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:23.741 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:10:23.741 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:10:23.741 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:23.741 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:10:23.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:23.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:10:23.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42bad40) skgpid ospid 2524 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:24.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:24.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:25.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c4002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:25.666 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:10:25.667 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:10:25.668 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:10:25.668 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42cbe70) pid(2580) version 11:1:1:4 [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:10:25.674 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:25.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:10:25.681 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:10:25.681 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:25.681 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:10:25.884 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:10:25.884 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b4207f10) skgpid ospid 2580 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:25.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:26.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:26.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:27.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:28.393 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:28.393 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:28.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:28.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:29.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c5002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:29.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:10:29.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:10:29.703 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:10:29.703 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:29.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c6002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:29.711 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:10:29.711 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:10:29.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c7002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:29.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:10:29.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:10:29.755 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:10:29.755 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:29.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c8002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:29.762 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:10:29.762 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:10:29.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:30.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:30.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:30.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:31.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:32.396 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:32.396 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:10:32.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:32.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:33.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:34.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:34.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:35.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c9002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:36.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:37.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:37.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:37.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:37.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:38.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:38.977 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:10:38.978 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:10:38.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:10:38.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3820) proc(0x7f82b42833d0) pid(2712) version 11:1:1:4 [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:10:38.984 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:38.992 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:10:38.992 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:10:38.992 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:38.992 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:10:39.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:39.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:39.194 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:10:39.194 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d3820) skgpid ospid 2712 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:40.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:41.022 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:41.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:41.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:42.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:42.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:42.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:43.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:43.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:44.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:44.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ca002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:44.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:10:44.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:10:44.954 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:10:44.954 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:44.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00cb002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:44.961 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:10:44.961 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:10:45.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:45.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:45.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cc002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:46.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:47.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:47.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:47.406 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:47.406 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:48.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:49.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:49.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:50.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:50.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00cd002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:50.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:10:50.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:10:50.158 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:10:50.158 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:50.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ce002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:50.164 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:10:50.164 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:10:51.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:10:51.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:51.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:52.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:52.409 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:52.409 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:53.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:53.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:54.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:54.238 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:10:54.239 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:10:54.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:10:54.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42cbe70) pid(2853) version 11:1:1:4 [ CSSD]2013-05-23 13:10:54.245 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:10:54.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:10:54.245 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:10:54.245 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:54.245 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:10:54.246 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:10:54.246 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:10:54.252 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:10:54.252 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:10:54.252 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:10:54.253 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:10:54.455 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:10:54.455 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42ccc30) skgpid ospid 2853 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:10:55.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:55.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:55.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cf002b) incarnation(174631051) [ CSSD]2013-05-23 13:10:56.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:57.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:57.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:10:57.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:10:57.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:10:58.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:10:59.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:10:59.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:00.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:00.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d0002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:00.206 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:00.206 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:00.206 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:11:00.206 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:00.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d1002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:00.213 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:00.213 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:01.069 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:01.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:01.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:02.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:02.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:02.416 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:03.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:03.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:04.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:05.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d2002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:05.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:05.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:05.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d3002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:05.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:05.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:05.906 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:11:05.906 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:05.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d4002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:05.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:05.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:06.040 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:11:06.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:11:06.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:11:06.043 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:11:06.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:07.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:07.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:07.419 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:07.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:08.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:09.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:09.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:09.487 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:11:09.488 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:11:09.489 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:11:09.489 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(2996) version 11:1:1:4 [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:11:09.505 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:09.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:11:09.512 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:11:09.512 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:09.512 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:11:09.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:11:09.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 2996 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:10.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:11.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:11.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:11.422 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:11:11.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:11.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:12.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:13.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:13.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:14.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:15.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d5002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:15.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:15.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:15.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d6002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:15.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:15.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:15.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:11:15.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:15.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d7002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:15.460 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:15.460 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:15.815 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:11:15.816 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:11:15.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:11:15.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42cbe70) pid(3083/3083) version 11:1:1:4 [ CSSD]2013-05-23 13:11:15.822 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:11:15.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:11:15.822 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:11:15.822 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:11:15.846 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a3c70) skgpid 3083 ospid 3083 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:16.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:16.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:16.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:17.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:17.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:18.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:19.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:19.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:20.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:21.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:21.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:21.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:21.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:21.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:22.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:23.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:23.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:24.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:24.747 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:11:24.748 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:11:24.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:11:24.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42833d0) pid(3168) version 11:1:1:4 [ CSSD]2013-05-23 13:11:24.754 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:11:24.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:11:24.754 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:11:24.754 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:24.754 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:11:24.755 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:11:24.755 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:24.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:11:24.762 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:11:24.762 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:24.762 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:11:24.964 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:11:24.964 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42bad40) skgpid ospid 3168 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:25.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d8002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:25.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:25.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:25.927 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:11:25.928 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:11:25.929 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:11:25.929 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42cbe70) pid(3215) version 11:1:1:4 [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d3820, requested num -1 [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:11:25.935 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:25.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:11:25.942 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:11:25.942 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:25.942 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:11:26.144 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:11:26.144 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42ccc30) skgpid ospid 3215 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:26.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:26.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:26.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:27.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:27.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:28.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:29.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:29.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:30.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d9002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:30.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:30.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:30.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:11:30.014 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:30.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00da002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:30.020 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:30.020 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:30.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:30.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00db002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:30.701 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:30.701 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:30.701 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:11:30.701 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:30.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00dc002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:30.707 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:30.707 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:31.138 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:31.434 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:31.434 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:31.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:31.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:32.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:33.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:33.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:34.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:35.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00dd002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:35.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:35.436 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:11:35.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:35.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:36.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:37.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:37.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:38.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:39.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:39.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:39.997 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:11:39.998 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:11:39.999 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:11:39.999 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42833d0) pid(3319) version 11:1:1:4 [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:11:40.006 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:40.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:11:40.013 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:11:40.013 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:40.013 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:11:40.215 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:11:40.215 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42bad40) skgpid ospid 3319 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:40.439 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:40.440 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:40.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:41.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:41.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:41.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:42.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:43.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:43.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:44.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:45.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:45.443 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:45.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00de002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:45.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:45.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:45.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00df002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:45.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:11:45.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:11:45.950 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:11:45.950 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:45.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e0002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:45.957 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:11:45.957 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:11:46.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:47.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:47.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:48.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:49.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:49.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:50.446 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:50.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:50.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:51.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:11:51.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:51.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:52.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:53.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:53.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:54.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:55.248 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:11:55.248 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:11:55.249 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:11:55.249 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42cbe70) pid(3469) version 11:1:1:4 [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:11:55.255 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:11:55.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:11:55.262 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:11:55.262 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:11:55.262 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:11:55.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:11:55.449 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:11:55.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:11:55.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a3c70) skgpid ospid 3469 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:11:55.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e1002b) incarnation(174631051) [ CSSD]2013-05-23 13:11:55.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:55.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:56.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:57.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:57.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:11:58.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:11:59.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:11:59.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:00.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e2002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:00.108 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:00.108 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:00.108 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:00.109 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:00.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e3002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:00.115 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:00.115 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:00.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:00.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:00.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:01.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e4002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:01.197 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:01.197 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:01.197 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:01.197 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:01.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e5002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:01.203 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:01.203 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:01.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:01.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:01.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:02.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:03.469 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:12:03.470 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:12:03.471 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:12:03.472 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:12:03.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e6002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:03.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:03.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:03.543 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:12:03.543 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:12:03.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e7002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:03.549 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:03.549 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:03.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:03.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:04.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:05.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:05.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:05.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e8002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:06.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:06.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:06.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:08.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:08.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:08.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:10.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:10.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:10.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:10.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:10.497 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:12:10.498 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:12:10.498 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:12:10.498 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(3629) version 11:1:1:4 [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:12:10.505 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:10.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:12:10.511 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:12:10.511 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:10.511 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:12:10.714 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:12:10.714 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 3629 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:10.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:11.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:11.715 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:12:11.715 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:12:11.716 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:12:11.716 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3820) proc(0x7f82b42cbe70) pid(3700) version 11:1:1:4 [ CSSD]2013-05-23 13:12:12.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:12.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:12.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:14.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:14.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:14.263 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:12:14.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42d3820) skgpid ospid 3700 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:14.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:15.461 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:15.461 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:15.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e9002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:16.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:16.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:16.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ea002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:16.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:16.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:16.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:16.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:16.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00eb002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:16.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:16.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:16.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:18.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:18.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:18.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:19.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:19.463 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:12:20.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:20.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:20.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:21.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:22.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:22.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:22.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:24.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:24.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:24.466 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:24.466 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:24.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:25.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ec002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:25.747 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:12:25.748 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:12:25.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:12:25.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42833d0) pid(4139) version 11:1:1:4 [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d3820, requested num -1 [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:12:25.754 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:25.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:12:25.761 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:12:25.761 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:25.761 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:12:25.964 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:12:25.964 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42bad40) skgpid ospid 4139 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:26.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:12:26.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:12:26.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:12:26.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cbe70) pid(4186) version 11:1:1:4 [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:12:26.194 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:26.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:12:26.201 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:12:26.201 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:26.201 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:12:26.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:26.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:26.404 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:12:26.404 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b427c5d0) skgpid ospid 4186 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:26.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:28.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:28.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:28.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:29.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:29.469 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:30.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ed002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:30.280 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:30.280 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:30.280 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:30.280 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:30.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ee002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:30.287 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:30.287 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:30.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:30.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:30.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:31.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:31.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ef002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:31.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:31.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:31.689 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:31.689 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:31.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f0002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:31.696 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:31.696 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:32.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:32.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:32.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:34.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:34.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:34.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:34.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:34.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:35.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f1002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:36.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:36.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:36.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:38.475 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:38.475 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:12:38.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:38.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:38.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:40.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:40.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:40.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:40.997 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:12:40.998 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:12:40.998 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:12:40.998 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(4338) version 11:1:1:4 [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42833d0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:12:41.004 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:41.011 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:12:41.011 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:12:41.011 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:41.011 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:12:41.213 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:12:41.213 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 4338 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:41.300 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:42.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:42.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:43.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:43.478 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:43.478 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:44.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:44.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:45.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:45.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f2002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:46.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:46.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:46.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f3002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:46.941 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:12:46.941 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:12:46.941 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:12:46.941 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:46.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f4002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:46.948 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:12:46.948 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:12:47.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:48.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:48.481 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:48.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:48.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:49.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:50.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:50.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:51.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:51.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:12:52.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:52.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:53.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:53.484 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:53.485 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d38d0 [ CSSD]2013-05-23 13:12:54.041 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d38d0) con(0x7f82b429eb50) skgpid 608 ospid 608 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:54.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:54.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:55.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:55.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f5002b) incarnation(174631051) [ CSSD]2013-05-23 13:12:56.250 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:12:56.251 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:12:56.252 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:12:56.252 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cbe70) pid(4501) version 11:1:1:4 [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42cbe70), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:12:56.258 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:12:56.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:12:56.265 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:12:56.265 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:12:56.265 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:12:56.468 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:12:56.468 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b427c5d0) skgpid ospid 4501 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:12:56.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:56.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:57.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:12:58.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:12:58.488 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:12:58.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:12:58.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:12:59.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:00.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:00.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:01.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:01.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:02.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f6002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:02.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:13:02.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:13:02.190 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:13:02.190 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:02.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f7002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:02.197 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:13:02.197 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:13:02.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:02.490 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:13:02.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:02.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:03.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:04.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:04.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:05.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:05.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f8002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:06.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:06.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:07.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:07.493 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:07.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:08.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:08.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:09.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:10.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:10.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:11.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:11.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:11.501 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:13:11.502 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:13:11.503 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:13:11.503 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42833d0) pid(4650) version 11:1:1:4 [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:11.509 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:11.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:13:11.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:13:11.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:11.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:11.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:13:11.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42ccc30) skgpid ospid 4650 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:12.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:12.497 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:12.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:12.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:13.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:14.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:14.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:15.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:15.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f9002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:16.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:16.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:17.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:17.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fa002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:17.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:13:17.450 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:13:17.450 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:13:17.450 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:17.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fb002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:17.456 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:13:17.456 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:13:17.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:17.500 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:18.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:18.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:19.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:20.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:20.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:21.387 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:21.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:21.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:21.502 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:13:22.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:22.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:23.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:24.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:24.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:25.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:25.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fc002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:26.452 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:13:26.453 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:26.453 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:13:26.453 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(4785) version 11:1:1:4 [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:26.460 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:26.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:13:26.466 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:13:26.466 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:26.466 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:26.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:26.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:26.623 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:13:26.624 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:26.625 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:13:26.625 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42cbe70) pid(4800) version 11:1:1:4 [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbe70), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4204870 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:26.631 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:26.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:13:26.638 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:13:26.638 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:13:26.638 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:26.669 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:13:26.669 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 4785 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:26.744 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:13:26.745 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:26.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:13:26.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(4805) version 11:1:1:4 [ CSSD]2013-05-23 13:13:26.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:13:26.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:13:26.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:13:26.765 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5120) allocated [ CSSD]2013-05-23 13:13:26.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:13:26.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 4805 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:26.766 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:13:26.767 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5120 - 1,2,3 [ CSSD]2013-05-23 13:13:26.767 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42a5120) pid(4808) version 11:1:1:4 [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5120), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:26.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:26.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:13:26.779 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:13:26.779 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42833d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:26.779 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42833d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:26.840 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:13:26.840 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42bad40) skgpid ospid 4800 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:26.981 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5120 [ CSSD]2013-05-23 13:13:26.981 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5120) con(0x7f82b42a3c70) skgpid ospid 4808 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:26.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:26.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:27.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:28.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:28.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:29.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:30.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fd002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:30.539 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:13:30.539 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:13:30.539 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:13:30.539 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:30.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fe002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:30.545 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:13:30.545 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:13:31.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:31.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:31.421 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:31.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:31.508 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:31.508 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:32.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ff002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:32.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:13:32.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:13:32.718 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:13:32.718 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:32.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0100002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:32.725 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:13:32.725 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:13:33.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:33.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:33.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:35.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:35.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:35.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:35.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0101002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:36.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:36.512 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:37.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:37.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:37.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:38.698 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:13:38.699 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:38.699 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:13:38.699 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(3136/3136) version 11:1:1:4 [ CSSD]2013-05-23 13:13:38.716 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:13:38.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:13:38.716 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:13:38.716 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:13:39.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:39.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:39.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:41.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:41.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:41.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:41.498 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:13:41.499 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:41.500 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:13:41.500 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4286740) pid(5007) version 11:1:1:4 [ CSSD]2013-05-23 13:13:41.515 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:41.515 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:41.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:42.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5120) allocated [ CSSD]2013-05-23 13:13:42.017 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:13:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5120 - 1,2,3 [ CSSD]2013-05-23 13:13:42.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a5120) pid(5366) version 11:1:1:4 [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5120), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42c8400, requested num -1 [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:42.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:42.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:13:42.030 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:13:42.030 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:42.031 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:42.067 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:13:42.067 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b427c5d0) skgpid ospid 5007 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:42.233 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5120 [ CSSD]2013-05-23 13:13:42.233 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5120) con(0x7f82b42bad40) skgpid ospid 5366 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:43.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:43.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:43.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:45.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:45.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:45.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:45.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0102002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:46.518 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:46.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:47.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:47.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:47.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:47.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0103002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:47.967 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:13:47.967 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:13:47.967 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:13:47.967 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:47.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0104002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:47.973 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:13:47.973 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:13:49.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:49.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:49.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:51.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:51.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:51.464 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:13:51.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:51.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:51.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:53.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:53.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:53.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:54.167 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:13:54.168 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:13:54.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:13:54.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42aed80) pid(5479/5479) version 11:1:1:4 [ CSSD]2013-05-23 13:13:54.184 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42aed80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:13:54.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:13:54.184 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:13:54.184 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:13:55.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:55.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:55.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:55.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0105002b) incarnation(174631051) [ CSSD]2013-05-23 13:13:56.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:13:56.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:13:57.266 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 13:13:57.267 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:13:57.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 13:13:57.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cf950) pid(5569) version 11:1:1:4 [ CSSD]2013-05-23 13:13:57.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:57.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:57.273 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cf950), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:13:57.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:13:57.273 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 13:13:57.273 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:57.274 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:13:57.274 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:13:57.274 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:13:57.281 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:13:57.281 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:13:57.281 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dac0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:13:57.281 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dac0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:13:57.483 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 13:13:57.483 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b427c5d0) skgpid ospid 5569 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:13:57.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:13:59.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:13:59.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:13:59.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:01.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:01.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:01.492 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:01.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:01.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:01.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:03.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0106002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:03.216 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:14:03.216 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:14:03.216 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:14:03.216 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:03.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0107002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:03.223 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:14:03.223 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:14:03.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:03.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:03.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:05.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:05.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:05.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0108002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:05.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:06.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:06.531 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:07.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:07.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:07.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:09.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:09.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:09.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:11.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:11.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:11.512 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:11.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:11.534 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:11.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:12.516 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 13:14:12.517 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:14:12.518 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 13:14:12.518 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b429dac0) pid(5725) version 11:1:1:4 [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429dac0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cfad0, requested num -1 [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:12.524 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:12.531 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:14:12.531 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:14:12.531 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:12.531 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:12.733 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 13:14:12.733 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b427c5d0) skgpid ospid 5725 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:13.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 13:14:13.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:14:13.187 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 13:14:13.187 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42cf950) pid(5772) version 11:1:1:4 [ CSSD]2013-05-23 13:14:13.305 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a18d0) allocated [ CSSD]2013-05-23 13:14:13.306 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:14:13.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a18d0 - 1,2,3 [ CSSD]2013-05-23 13:14:13.307 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5120) proc(0x7f82b42a18d0) pid(5791) version 11:1:1:4 [ CSSD]2013-05-23 13:14:13.325 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:14:13.327 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:14:13.330 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a18d0 [ CSSD]2013-05-23 13:14:13.330 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a18d0) con(0x7f82b42a5120) skgpid ospid 5791 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:13.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:13.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5307/0x7f82b4207ce0) [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5307 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207ce0 with con 0x7f82b42a90a0, requested num -1 [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:13.409 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:14:13.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5307 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:14:13.415 [1199044928] >TRACE: clssgmExitGrock: client 5307 (0x7f82b4207ce0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:14:13.415 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5900) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:14:13.415 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b5900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:13.416 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 13:14:13.416 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b427c5d0) skgpid ospid 5772 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:13.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:15.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:15.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:15.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0109002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:15.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:16.537 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:16.537 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:17.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:17.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:18.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:18.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010a002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:18.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:14:18.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:14:18.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:14:18.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:18.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010b002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:18.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:14:18.481 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:14:19.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:19.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:20.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:21.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:21.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:21.532 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:21.540 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:21.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:22.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:23.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:23.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:24.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:14:24.221 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4207f10) skgpid 5479 ospid 5479 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:25.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:25.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:25.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010c002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:26.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:26.544 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:26.544 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:26.714 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:14:26.715 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:14:26.715 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:14:26.715 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(5902) version 11:1:1:4 [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:26.721 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:26.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:14:26.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:14:26.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:26.728 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:26.930 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:14:26.930 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 5902 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:27.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:27.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:27.763 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:14:27.764 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:14:27.765 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:14:27.765 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42aed80) pid(5920) version 11:1:1:4 [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42aed80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:27.782 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:27.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:14:27.789 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:14:27.789 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:27.789 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:27.991 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:14:27.991 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42a3c70) skgpid ospid 5920 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:28.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:29.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:29.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:30.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:30.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010d002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:30.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:14:30.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:14:30.792 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:14:30.792 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:30.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010e002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:30.799 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:14:30.799 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:14:31.547 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:31.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:31.553 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:31.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:31.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:32.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:33.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:33.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:33.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010f002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:33.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:14:33.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:14:33.719 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:14:33.719 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:33.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0110002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:33.725 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:14:33.725 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:14:34.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:35.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:35.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:35.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0111002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:36.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:36.550 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:36.550 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:37.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:37.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:38.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:39.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:39.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:40.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:41.553 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:41.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:41.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:41.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:41.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:42.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:43.026 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:14:43.027 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:14:43.028 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:14:43.028 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(6082) version 11:1:1:4 [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:43.034 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:43.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:14:43.041 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:14:43.041 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:43.041 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:43.244 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:14:43.244 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 6082 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:43.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:43.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:44.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:45.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:45.556 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:14:45.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:45.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:45.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0112002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:46.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:47.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:47.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:48.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:48.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0113002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:48.967 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:14:48.967 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:14:48.967 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:14:48.967 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:48.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0114002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:48.973 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:14:48.973 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:14:49.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:49.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:50.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:50.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:50.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:51.613 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:14:51.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:51.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:52.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:53.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:53.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:54.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:55.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:14:55.562 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:14:55.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:55.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:55.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0115002b) incarnation(174631051) [ CSSD]2013-05-23 13:14:56.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:57.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:57.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:14:58.277 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:14:58.277 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:14:58.278 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:14:58.278 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42aed80) pid(6256) version 11:1:1:4 [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42aed80), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:14:58.284 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:14:58.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:14:58.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:14:58.291 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:14:58.291 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:14:58.291 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:14:58.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:14:58.494 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42a3c70) skgpid ospid 6256 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:14:59.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:14:59.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:00.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:00.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:00.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:01.634 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:01.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:01.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:02.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:03.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:03.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:04.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0116002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:04.215 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:15:04.215 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:15:04.215 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:15:04.215 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:04.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0117002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:04.222 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:15:04.222 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:15:04.319 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:15:04.320 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:15:04.320 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:15:04.320 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(6353/6353) version 11:1:1:4 [ CSSD]2013-05-23 13:15:04.326 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:15:04.326 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:15:04.326 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:15:04.326 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:15:04.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:04.567 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:04.568 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:15:04.625 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid 6353 ospid 6353 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:05.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:05.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:05.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0118002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:06.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:07.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:07.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:08.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:09.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:09.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:09.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:09.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:10.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:11.664 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:11.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:11.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:12.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:13.536 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:15:13.537 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:15:13.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:15:13.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42aed80) pid(6424) version 11:1:1:4 [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42aed80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42bad40, requested num -1 [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:15:13.544 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:13.551 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:15:13.551 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:15:13.551 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:13.551 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:15:13.754 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:15:13.754 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4207f10) skgpid ospid 6424 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:13.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:13.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:14.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:14.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:14.574 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:15.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0119002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:16.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:16.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:16.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 13:15:16.184 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41edd50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:15:16.184 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41edd50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:15:16.184 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:15:16.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42a9150) skgpid 510 ospid 510 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:16.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:18.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:18.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:18.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:19.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011a002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:19.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:15:19.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:15:19.463 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:15:19.463 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:19.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011b002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:19.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:15:19.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:15:19.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:19.578 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:20.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:20.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:20.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:21.684 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:22.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:22.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:22.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:23.580 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:23.580 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:15:24.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:24.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:24.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:26.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011c002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:26.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:26.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:26.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:26.983 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:15:26.984 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:15:26.984 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:15:26.984 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(6558) version 11:1:1:4 [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42aed80, requested num -1 [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:15:27.000 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:27.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:15:27.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:15:27.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:27.007 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:15:27.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:15:27.209 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 6558 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:28.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:28.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:28.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:28.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:28.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:28.782 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:15:28.783 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:15:28.784 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:15:28.784 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42aed80) pid(6580) version 11:1:1:4 [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42aed80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4207c10, requested num -1 [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:15:28.789 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:28.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:15:28.796 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:15:28.796 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:28.796 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:15:28.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:15:28.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b427c5d0) skgpid ospid 6580 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:30.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:30.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:30.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:31.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011d002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:31.059 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:15:31.059 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:15:31.059 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:15:31.059 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:31.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011e002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:31.065 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:15:31.065 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:15:31.704 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:32.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:32.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:32.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:33.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:33.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:34.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:34.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:34.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:34.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011f002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:34.716 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:15:34.716 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:15:34.716 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:15:34.716 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:34.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0120002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:34.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:15:34.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:15:36.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0121002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:36.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:36.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:36.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:38.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:38.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:38.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:38.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:38.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:40.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:40.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:40.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:41.725 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:42.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:42.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:42.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:43.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:43.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:44.048 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:15:44.049 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:15:44.050 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:15:44.050 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(6766) version 11:1:1:4 [ CSSD]2013-05-23 13:15:44.056 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207c10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:15:44.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:15:44.056 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42aed80, requested num -1 [ CSSD]2013-05-23 13:15:44.056 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:44.056 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:15:44.057 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:15:44.057 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:44.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:15:44.063 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:15:44.063 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:44.064 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:15:44.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:44.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:44.266 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:15:44.266 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 6766 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:15:44.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:46.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0122002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:46.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:46.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:46.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:47.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:47.596 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:15:48.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:48.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:48.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:49.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0123002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:49.964 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:15:49.964 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:15:49.964 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:15:49.964 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:49.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0124002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:49.971 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:15:49.971 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:15:50.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:50.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:50.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:51.745 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:15:52.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:52.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:52.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:52.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:52.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:54.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:54.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:54.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:56.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0125002b) incarnation(174631051) [ CSSD]2013-05-23 13:15:56.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:56.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:56.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:57.602 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:15:57.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:15:58.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:15:58.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:15:58.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:15:59.299 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:15:59.299 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:15:59.300 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:15:59.300 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42aed80) pid(6911) version 11:1:1:4 [ CSSD]2013-05-23 13:15:59.306 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42aed80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:15:59.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:15:59.306 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4207c10, requested num -1 [ CSSD]2013-05-23 13:15:59.306 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:59.306 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:15:59.307 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:15:59.307 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:15:59.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:15:59.313 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:15:59.313 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:15:59.313 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:15:59.515 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:15:59.515 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b427c5d0) skgpid ospid 6911 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:00.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:00.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:00.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:01.775 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:02.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:02.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:02.605 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:02.605 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:02.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:04.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:04.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:04.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:05.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0126002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:05.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:05.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:05.222 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:16:05.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:05.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0127002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:05.229 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:05.229 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:06.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0128002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:06.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0129002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:06.202 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:06.202 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:06.202 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:16:06.202 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:06.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012a002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:06.208 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:06.208 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:06.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:16:06.339 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:16:06.340 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:16:06.341 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:16:06.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:06.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:06.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:16:06.578 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:16:06.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:16:06.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(6487/6487) version 11:1:1:4 [ CSSD]2013-05-23 13:16:06.594 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:16:06.594 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:16:06.595 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:16:06.595 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:16:06.608 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:06.608 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:16:06.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:08.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:08.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:08.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:10.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:10.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:10.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:11.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:11.611 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:11.805 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:12.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:12.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:12.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:14.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:14.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:14.548 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a9090) allocated [ CSSD]2013-05-23 13:16:14.549 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:16:14.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a9090 - 1,2,3 [ CSSD]2013-05-23 13:16:14.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42a9090) pid(7051) version 11:1:1:4 [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a9090), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:16:14.567 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:14.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:16:14.574 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:16:14.574 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e6d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:14.574 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e6d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:16:14.777 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a9090 [ CSSD]2013-05-23 13:16:14.777 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a9090) con(0x7f82b4207f10) skgpid ospid 7051 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:14.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:15.306 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 13:16:15.307 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:16:15.307 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 13:16:15.307 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba670) proc(0x7f82b429dac0) pid(7100/7100) version 11:1:1:4 [ CSSD]2013-05-23 13:16:15.314 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429dac0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:16:15.314 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:16:15.314 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:16:15.314 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:16:15.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:16:15.330 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:16:15.330 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:16:15.330 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:16:15.331 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 13:16:15.331 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42ba670) skgpid 7100 ospid 7100 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:16.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012b002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:16.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:16.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:16.614 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:16.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:16.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:18.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:18.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:19.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:20.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012c002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:20.469 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:20.469 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:20.469 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:16:20.469 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:20.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012d002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:20.475 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:20.476 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:20.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:16:20.517 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:16:20.517 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:16:20.517 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 23 [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 13:16:20.525 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42c6340) skgpid 31740 ospid 31740 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:20.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:20.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:20.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 13:16:20.693 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:16:20.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 13:16:20.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ae300) pid(7135/7135) version 11:1:1:4 [ CSSD]2013-05-23 13:16:20.709 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42ae300), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:16:20.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:16:20.709 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:16:20.709 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:16:20.835 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42ae300), client(2/0x7f82b4286810) [ CSSD]2013-05-23 13:16:20.835 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 13:16:20.835 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:16:20.835 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 24 [ CSSD]2013-05-23 13:16:21.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:21.617 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:21.617 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:21.836 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:22.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:22.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:22.897 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207c10), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:16:22.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:16:22.897 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:16:22.897 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 13:16:23.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:24.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:24.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:25.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:26.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012e002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:26.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:26.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:26.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:26.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:27.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:27.250 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:16:27.251 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:16:27.251 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:16:27.251 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(7185) version 11:1:1:4 [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:16:27.257 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:27.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:16:27.264 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:16:27.264 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:27.264 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:16:27.467 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:16:27.467 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 7185 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:28.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:28.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:29.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:29.811 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:16:29.811 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:16:29.812 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:16:29.812 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(7233) version 11:1:1:4 [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:16:29.829 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:29.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:16:29.837 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:16:29.837 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:29.837 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:16:30.039 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:16:30.039 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 7233 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:30.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:30.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:31.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:31.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012f002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:31.306 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:31.306 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:31.307 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:16:31.307 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:31.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0130002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:31.313 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:31.313 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:31.622 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:31.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:31.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:32.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:32.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:33.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:34.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:34.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:35.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:35.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0131002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:35.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:35.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:35.724 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:16:35.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:35.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0132002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:35.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:35.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:36.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0133002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:36.625 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:36.626 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:36.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:36.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:37.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:38.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:38.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:39.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:40.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:40.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:41.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:41.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:41.629 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:41.876 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:42.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:42.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:43.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:44.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:44.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:45.072 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:16:45.073 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:16:45.074 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:16:45.074 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c00) proc(0x7f82b429e400) pid(7400) version 11:1:1:4 [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:16:45.090 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:45.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:16:45.097 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:16:45.097 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:16:45.097 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:16:45.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:45.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:16:45.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42b5c00) skgpid ospid 7400 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:16:46.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0134002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:46.632 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:46.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:46.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:46.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:47.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:48.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:48.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:49.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:50.634 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:50.635 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:16:50.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:50.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:50.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0135002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:50.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:16:50.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:16:50.972 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:16:50.972 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:16:50.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0136002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:50.979 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:16:50.979 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:16:51.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:51.896 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:16:52.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:52.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:53.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:54.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:54.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:55.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:55.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:16:55.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:16:56.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0137002b) incarnation(174631051) [ CSSD]2013-05-23 13:16:56.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:56.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:57.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:16:58.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:16:58.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:16:59.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:00.343 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:17:00.344 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:17:00.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:17:00.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(7540) version 11:1:1:4 [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:00.351 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:00.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:17:00.357 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:00.357 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:00.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:00.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:17:00.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 7540 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:00.641 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:00.641 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:00.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:00.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:01.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:01.916 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:02.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:02.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:03.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:03.783 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:17:03.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:17:03.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:17:03.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:17:03.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0138002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:03.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:03.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:03.865 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:17:03.865 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:17:03.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0139002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:03.873 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:03.873 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:04.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:04.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:05.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:05.644 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:05.644 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:05.694 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:17:05.695 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:17:05.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:17:05.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(7628) version 11:1:1:4 [ CSSD]2013-05-23 13:17:05.702 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:17:05.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:17:05.702 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:17:05.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:05.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:05.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:05.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:05.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:17:05.709 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:05.709 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:05.709 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:05.912 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:17:05.912 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 7628 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:06.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013a002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:06.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:06.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:06.222 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:17:06.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:06.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013b002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:06.228 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:06.228 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:06.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013c002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:06.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:06.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:07.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:08.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:08.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:09.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:09.647 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:09.647 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:17:10.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:10.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:11.183 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:17:11.184 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:17:11.184 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:17:11.184 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c00) proc(0x7f82b429e400) pid(7710) version 11:1:1:4 [ CSSD]2013-05-23 13:17:11.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:11.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:12.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:12.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:13.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:13.789 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:17:13.789 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42b5c00) skgpid ospid 7710 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:14.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:14.650 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:14.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:14.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:15.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:15.592 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:17:15.593 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:17:15.593 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:17:15.593 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429e400) pid(8051) version 11:1:1:4 [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:15.598 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:15.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:17:15.605 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:15.605 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:15.605 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:15.808 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:17:15.808 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b4207f10) skgpid ospid 8051 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:16.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013d002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:16.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:16.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:17.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:18.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:18.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:19.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:19.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:19.653 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:20.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:20.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:21.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013e002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:21.469 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:21.469 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:21.469 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:17:21.469 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:21.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:21.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013f002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:21.476 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:21.476 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:21.967 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:22.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:22.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:23.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:24.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:24.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:24.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:24.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:25.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:26.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0140002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:27.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:27.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:27.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:27.511 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:17:27.512 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:17:27.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:17:27.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(8203) version 11:1:1:4 [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:27.530 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:27.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:17:27.538 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:27.538 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:27.538 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:27.741 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:17:27.741 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 8203 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:28.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:28.659 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:17:29.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:29.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:29.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:30.844 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:17:30.845 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:17:30.846 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:17:30.846 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(8230) version 11:1:1:4 [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:30.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:30.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:17:30.870 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:30.870 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:30.870 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:31.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:31.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:31.073 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:17:31.073 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 8230 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:31.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:31.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0141002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:31.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:31.558 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:31.558 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:17:31.558 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:31.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0142002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:31.565 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:31.565 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:31.987 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:33.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:33.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:33.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:33.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:33.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:35.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:35.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:35.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:17:35.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:17:35.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:17:35.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b429e400) pid(8302) version 11:1:1:4 [ CSSD]2013-05-23 13:17:35.194 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:17:35.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:17:35.194 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:17:35.194 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:35.194 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:35.195 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:35.195 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:35.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:17:35.201 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:35.201 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:35.201 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:35.404 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:17:35.404 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b4207f10) skgpid ospid 8302 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:35.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:36.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0143002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:36.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0144002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:36.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:36.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:36.724 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:17:36.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:36.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0145002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:36.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:36.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:37.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:37.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:37.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:38.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:38.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:39.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:39.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:39.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:41.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:41.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:41.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:42.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:43.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:43.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:43.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:43.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:43.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:45.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:45.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:45.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:46.106 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:17:46.107 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:17:46.108 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:17:46.108 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b42d8e90) pid(8380) version 11:1:1:4 [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42cbb70, requested num -1 [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c8030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:17:46.113 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:46.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:17:46.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:17:46.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:17:46.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:17:46.323 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:17:46.323 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429dc50) skgpid ospid 8380 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:17:46.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0146002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:47.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:47.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:47.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:48.670 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:48.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:49.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:49.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:49.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:51.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:51.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:51.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:51.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0147002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:51.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:17:51.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:17:51.972 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:17:51.972 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:17:51.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0148002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:51.980 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:17:51.980 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:17:52.028 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:17:52.673 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:52.673 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:17:53.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:53.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:53.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:55.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:55.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:55.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:56.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0149002b) incarnation(174631051) [ CSSD]2013-05-23 13:17:57.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:57.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:57.676 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:17:57.677 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:17:57.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:17:59.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:17:59.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:17:59.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:01.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:01.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:01.356 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:18:01.357 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:18:01.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:18:01.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5c00) proc(0x7f82b429e400) pid(8562) version 11:1:1:4 [ CSSD]2013-05-23 13:18:01.363 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:18:01.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:18:01.363 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba720 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:18:01.363 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:01.363 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:18:01.364 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:01.364 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:01.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:18:01.370 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba720), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:18:01.370 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:01.370 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:01.573 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:18:01.573 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42b5c00) skgpid ospid 8562 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:01.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:02.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:02.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:02.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:03.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:03.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:03.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:05.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:05.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:05.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:06.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014a002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:07.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014b002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:07.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:18:07.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:18:07.241 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:18:07.242 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:07.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014c002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:07.247 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:18:07.248 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:18:07.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:07.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:07.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:07.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:07.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:09.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:09.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:09.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:11.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:11.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:11.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:11.686 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:18:11.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:12.068 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:13.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:13.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:13.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:15.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:15.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:15.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:16.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014d002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:16.607 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 13:18:16.607 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:18:16.608 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 13:18:16.608 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42cbb70) pid(8726) version 11:1:1:4 [ CSSD]2013-05-23 13:18:16.624 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbb70), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:18:16.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:18:16.624 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 13:18:16.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:16.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:18:16.625 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:16.625 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:16.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:18:16.632 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:18:16.632 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:16.633 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:16.689 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:16.689 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:16.835 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 13:18:16.835 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b4207f10) skgpid ospid 8726 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:17.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:17.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:17.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:18.039 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3030), client(2/0x7f82b4204870) [ CSSD]2013-05-23 13:18:18.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 13:18:18.039 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:18:18.039 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:18:19.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:19.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:19.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:21.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:21.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:21.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:21.693 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:22.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:22.080 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:22.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014e002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:22.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:18:22.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:18:22.492 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:18:22.492 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:22.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014f002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:22.499 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:18:22.499 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:18:23.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:23.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:24.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:25.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:25.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:26.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:26.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0150002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:26.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:26.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:26.917 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 13:18:26.918 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:26.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 13:18:26.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b42b3800) pid(8926) version 11:1:1:4 [ CSSD]2013-05-23 13:18:26.925 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3800), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:18:26.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:18:26.926 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42a2a00 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:18:26.926 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:18:26.926 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:18:26.926 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:26.926 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:26.932 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:18:26.932 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:18:26.932 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:18:26.933 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:27.038 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42baac0) allocated [ CSSD]2013-05-23 13:18:27.039 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:27.040 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42baac0 - 1,2,3 [ CSSD]2013-05-23 13:18:27.040 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8440) proc(0x7f82b42baac0) pid(8933) version 11:1:1:4 [ CSSD]2013-05-23 13:18:27.054 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:18:27.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:18:27.058 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:18:27.060 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42baac0 [ CSSD]2013-05-23 13:18:27.060 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42baac0) con(0x7f82b42c8440) skgpid ospid 8933 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:27.135 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 13:18:27.135 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b42b5b40) skgpid ospid 8926 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:27.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:27.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:27.787 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 13:18:27.788 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:27.789 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 13:18:27.789 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42b3800) pid(8947) version 11:1:1:4 [ CSSD]2013-05-23 13:18:27.805 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3800), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:18:27.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:18:27.805 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:18:27.805 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:27.805 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:18:27.806 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:27.806 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:27.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:18:27.812 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:18:27.812 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:27.812 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:28.015 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 13:18:28.015 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b4207f10) skgpid ospid 8947 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:28.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:28.583 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbc40) allocated [ CSSD]2013-05-23 13:18:28.584 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:28.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbc40 - 1,2,3 [ CSSD]2013-05-23 13:18:28.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42cbc40) pid(8958/8958) version 11:1:1:4 [ CSSD]2013-05-23 13:18:28.600 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbc40), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:18:28.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:18:28.600 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:18:28.600 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:18:28.635 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:18:28.635 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:18:28.635 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:18:28.635 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:18:28.636 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbc40 [ CSSD]2013-05-23 13:18:28.636 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbc40) con(0x7f82b4207f10) skgpid 8958 ospid 8958 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:28.804 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbc40) allocated [ CSSD]2013-05-23 13:18:28.805 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:28.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbc40 - 1,2,3 [ CSSD]2013-05-23 13:18:28.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42cbc40) pid(8967/8967) version 11:1:1:4 [ CSSD]2013-05-23 13:18:28.811 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbc40), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:18:28.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:18:28.811 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:18:28.811 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ba720), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ba720), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbc40 [ CSSD]2013-05-23 13:18:28.857 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbc40) con(0x7f82b4207f10) skgpid 8967 ospid 8967 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:29.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:29.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:30.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:31.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:31.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:31.699 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:31.699 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:31.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0151002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:31.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:18:31.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:18:31.822 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:18:31.822 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:31.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0152002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:31.828 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:18:31.828 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:18:31.877 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 13:18:31.878 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:18:31.879 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 13:18:31.879 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42b3800) pid(9005) version 11:1:1:4 [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3800), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:31.895 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:31.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:18:31.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:18:31.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:31.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:32.100 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:32.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 13:18:32.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b4207f10) skgpid ospid 9005 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:32.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:33.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:33.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:34.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:35.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:35.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:36.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:36.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0153002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:36.702 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:36.702 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:37.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:37.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:37.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0154002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:37.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:18:37.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:18:37.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:18:37.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:37.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0155002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:37.747 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:18:37.748 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:18:38.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:39.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:39.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:40.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:41.005 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbc40) allocated [ CSSD]2013-05-23 13:18:41.006 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:41.006 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbc40 - 1,2,3 [ CSSD]2013-05-23 13:18:41.006 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e3f0) proc(0x7f82b42cbc40) pid(9145) version 11:1:1:4 [ CSSD]2013-05-23 13:18:41.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:41.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:41.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbc40 [ CSSD]2013-05-23 13:18:41.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbc40) con(0x7f82b429e3f0) skgpid ospid 9145 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:41.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:41.705 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:42.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:42.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:43.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:43.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:44.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:45.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:45.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:46.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:46.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0156002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:46.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:46.708 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:47.149 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 13:18:47.150 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:18:47.151 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 13:18:47.151 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b42b3800) pid(9345) version 11:1:1:4 [ CSSD]2013-05-23 13:18:47.156 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3800), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:18:47.157 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:47.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:18:47.163 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:18:47.163 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:18:47.163 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:18:47.366 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 13:18:47.366 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b42b5b40) skgpid ospid 9345 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:47.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:47.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:48.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:49.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:49.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:50.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:50.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:18:50.581 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:18:50.581 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:18:50.581 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:18:50.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:18:50.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid 3136 ospid 3136 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:18:51.558 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:18:51.559 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:18:51.559 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:18:51.559 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(9426/9426) version 11:1:1:4 [ CSSD]2013-05-23 13:18:51.565 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:18:51.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:18:51.565 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:18:51.565 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:18:51.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:51.712 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:51.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:51.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:52.150 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:18:52.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:52.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0157002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:52.991 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:18:52.991 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:18:52.991 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:18:52.991 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:18:52.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0158002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:52.997 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:18:52.997 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:18:53.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:53.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:54.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:55.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:55.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:56.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:56.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0159002b) incarnation(174631051) [ CSSD]2013-05-23 13:18:56.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:18:56.715 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:18:57.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:57.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:18:58.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:18:59.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:18:59.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:00.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:01.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:01.718 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:01.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:01.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:02.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:02.399 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3800) allocated [ CSSD]2013-05-23 13:19:02.400 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:19:02.400 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3800 - 1,2,3 [ CSSD]2013-05-23 13:19:02.400 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b3800) pid(9501) version 11:1:1:4 [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3800), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:02.407 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:02.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:19:02.414 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:19:02.414 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:02.414 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:02.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:02.616 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3800 [ CSSD]2013-05-23 13:19:02.616 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3800) con(0x7f82b42ccc30) skgpid ospid 9501 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:03.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:03.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:04.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:05.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:05.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:06.270 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(2/0x7f82b41edd50) [ CSSD]2013-05-23 13:19:06.270 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 13:19:06.270 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:19:06.270 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 13:19:06.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:06.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015a002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:06.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:06.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:07.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:07.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:08.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015b002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:08.249 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:19:08.249 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:19:08.249 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:19:08.249 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:08.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015c002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:08.255 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:19:08.255 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:19:08.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:09.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:09.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:10.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:10.724 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:10.725 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:19:11.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:11.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:12.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:12.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:13.490 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:19:13.491 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:19:13.491 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:19:13.491 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42cd1c0) pid(9639) version 11:1:1:4 [ CSSD]2013-05-23 13:19:13.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8580) allocated [ CSSD]2013-05-23 13:19:13.610 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:19:13.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8580 - 1,2,3 [ CSSD]2013-05-23 13:19:13.611 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b42d8580) pid(9649) version 11:1:1:4 [ CSSD]2013-05-23 13:19:13.627 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:19:13.629 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:19:13.633 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8580 [ CSSD]2013-05-23 13:19:13.633 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8580) con(0x7f82b42ba970) skgpid ospid 9649 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5308/0x7f82b42aee50) [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5308 (0x7f82b42aee50) [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42aee50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42ba950/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:13.713 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:19:13.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5308 (0x7f82b42aee50) [ CSSD]2013-05-23 13:19:13.719 [1199044928] >TRACE: clssgmExitGrock: client 5308 (0x7f82b42aee50), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:19:13.719 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:19:13.719 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:13.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:19:13.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b3800) skgpid ospid 9639 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:13.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:13.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:14.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:15.728 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:15.728 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:15.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:15.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:16.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:16.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015d002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:17.653 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ccf90) allocated [ CSSD]2013-05-23 13:19:17.654 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:19:17.655 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ccf90 - 1,2,3 [ CSSD]2013-05-23 13:19:17.655 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42ccf90) pid(9685) version 11:1:1:4 [ CSSD]2013-05-23 13:19:17.661 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ccf90), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:19:17.661 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:19:17.661 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:19:17.661 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:17.661 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:19:17.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:17.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:17.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:19:17.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:19:17.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:17.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:17.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ccf90 [ CSSD]2013-05-23 13:19:17.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ccf90) con(0x7f82b42ccc30) skgpid ospid 9685 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:17.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:17.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:18.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:19.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:19.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:20.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:20.731 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:20.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:22.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:22.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:22.220 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:22.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:23.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015e002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:23.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:19:23.497 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:19:23.497 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:19:23.497 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:23.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015f002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:23.504 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:19:23.505 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:19:24.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:24.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:24.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:25.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:25.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:26.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:26.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:26.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:26.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0160002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:28.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:28.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:28.054 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:19:28.055 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:19:28.055 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:19:28.055 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e4e0) proc(0x7f82b42cd1c0) pid(9812) version 11:1:1:4 [ CSSD]2013-05-23 13:19:28.061 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:19:28.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:19:28.061 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:19:28.061 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:28.061 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:19:28.062 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:28.062 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:28.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:19:28.068 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:19:28.068 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:28.068 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:28.271 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:19:28.271 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b429e4e0) skgpid ospid 9812 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:28.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:29.738 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:29.738 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:19:30.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:30.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:30.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:32.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:32.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:32.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0161002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:32.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:19:32.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:19:32.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:19:32.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:32.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0162002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:32.087 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:19:32.087 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:19:32.240 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:32.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:32.904 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:19:32.905 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:19:32.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:19:32.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42cd1c0) pid(9874) version 11:1:1:4 [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:32.912 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:32.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:19:32.919 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:19:32.919 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bac60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:32.919 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bac60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:33.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:19:33.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b3800) skgpid ospid 9874 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:34.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:34.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:34.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:34.741 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:34.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:36.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:36.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:36.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:36.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0163002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:38.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:38.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:38.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:38.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0164002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:38.750 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:19:38.750 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:19:38.750 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:19:38.750 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:38.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0165002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:38.759 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:19:38.759 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:19:39.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:39.744 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:40.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:40.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:40.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:42.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:42.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:42.261 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:42.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:44.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:44.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:44.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:44.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:44.748 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:46.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:46.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:46.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:46.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0166002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:48.154 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:19:48.155 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:19:48.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:19:48.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e4e0) proc(0x7f82b42cd1c0) pid(10037) version 11:1:1:4 [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba720 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:19:48.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:48.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:19:48.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba720), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:19:48.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:19:48.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:19:48.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:48.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:48.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:19:48.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b429e4e0) skgpid ospid 10037 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:19:48.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:49.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:49.751 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:50.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:50.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:50.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:52.281 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:19:52.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:52.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:52.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:54.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0167002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:54.001 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:19:54.001 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:19:54.001 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:19:54.001 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:19:54.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0168002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:54.008 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:19:54.008 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:19:54.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:54.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:54.754 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:54.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:19:54.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:56.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:56.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:56.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0169002b) incarnation(174631051) [ CSSD]2013-05-23 13:19:56.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:58.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:19:58.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:19:59.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:19:59.757 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:19:59.758 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:00.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:00.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:01.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:02.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:02.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:02.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:03.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:03.403 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:20:03.404 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:20:03.405 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:20:03.405 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42cd1c0) pid(10428) version 11:1:1:4 [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:20:03.421 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:03.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:20:03.428 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:20:03.428 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bac60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:03.428 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bac60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:20:03.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:20:03.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b3800) skgpid ospid 10428 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:04.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:04.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:04.761 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:04.761 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:04.798 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:20:04.799 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:20:04.800 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:20:04.800 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e4c0) proc(0x7f82b42cd1c0) pid(10482/10482) version 11:1:1:4 [ CSSD]2013-05-23 13:20:04.816 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:20:04.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:20:04.816 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:20:04.816 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:20:05.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:05.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:20:05.091 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:20:05.091 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:20:05.091 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:20:05.092 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:20:05.092 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b429e4c0) skgpid 10482 ospid 10482 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:06.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:06.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:06.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016a002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:07.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:08.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:08.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:08.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:08.764 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:20:09.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:09.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016b002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:09.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:09.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:09.256 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:09.256 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:09.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016c002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:09.263 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:09.263 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:10.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:10.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:11.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:12.342 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:12.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:12.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:13.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:13.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:13.768 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:14.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:14.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:15.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:16.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:16.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:16.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016d002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:17.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:18.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:18.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:18.663 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ccf90) allocated [ CSSD]2013-05-23 13:20:18.664 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:20:18.665 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ccf90 - 1,2,3 [ CSSD]2013-05-23 13:20:18.665 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42ccf90) pid(10590) version 11:1:1:4 [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ccf90), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:20:18.670 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:18.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:20:18.676 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:20:18.676 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:18.676 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:20:18.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:18.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:18.879 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ccf90 [ CSSD]2013-05-23 13:20:18.879 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ccf90) con(0x7f82b42ccc30) skgpid ospid 10590 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:19.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:20.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:20.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:21.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:22.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:22.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:22.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:23.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:23.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:23.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:24.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016e002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:24.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:24.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:24.520 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:24.520 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:24.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016f002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:24.527 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:24.527 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:24.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:24.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:25.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:26.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:26.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:26.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0170002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:27.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:28.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:20:28.312 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:20:28.313 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:20:28.313 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42cd1c0) pid(10696) version 11:1:1:4 [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:20:28.319 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:28.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:20:28.325 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:20:28.325 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bac60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:28.325 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bac60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:20:28.528 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:20:28.528 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b3800) skgpid ospid 10696 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:28.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:28.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:28.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:28.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:29.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:30.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:30.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:31.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:32.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0171002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:32.339 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:32.339 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:32.339 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:32.339 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:32.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0172002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:32.346 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:32.346 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:32.382 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:32.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:32.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:33.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:33.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:33.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:33.911 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:20:33.911 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:20:33.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:20:33.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42cd1c0) pid(10748) version 11:1:1:4 [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba720 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:20:33.928 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:33.934 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:20:33.934 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba720), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:20:33.934 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bac60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:33.934 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bac60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:20:34.137 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:20:34.137 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b3800) skgpid ospid 10748 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:34.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:34.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:35.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:36.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:36.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:36.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0173002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:37.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:38.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:38.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:38.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:38.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:39.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:39.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0174002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:39.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:39.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:39.767 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:39.768 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:39.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0175002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:39.774 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:39.774 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:40.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:40.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:41.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:42.402 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:42.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:42.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:43.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:43.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:43.787 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:44.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:44.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:45.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:46.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:46.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:46.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0176002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:47.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:48.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:48.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:48.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:48.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:49.170 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 13:20:49.171 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:20:49.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 13:20:49.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e4e0) proc(0x7f82b42cd1c0) pid(10890) version 11:1:1:4 [ CSSD]2013-05-23 13:20:49.187 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cd1c0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:20:49.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:20:49.187 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 13:20:49.187 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:49.187 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:20:49.188 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:20:49.188 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:49.195 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:20:49.195 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:20:49.195 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:20:49.196 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:20:49.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 13:20:49.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b429e4e0) skgpid ospid 10890 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:49.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:50.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0177002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:50.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:50.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:50.495 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:50.495 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:50.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0178002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:50.502 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:50.502 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:50.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:50.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:51.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:52.423 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:20:53.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:53.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:53.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 13:20:53.189 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:20:53.189 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:20:53.189 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 13:20:53.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:20:53.197 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:20:53.197 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:20:53.197 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:20:53.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 13:20:53.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b427d8a0) skgpid 23462 ospid 23462 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:20:53.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:53.793 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:53.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:55.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0179002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:55.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:20:55.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:20:55.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:20:55.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:20:55.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:55.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:55.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017a002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:55.030 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:20:55.030 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:20:55.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:56.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017b002b) incarnation(174631051) [ CSSD]2013-05-23 13:20:57.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:57.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:57.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:20:58.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:20:58.797 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:20:59.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:20:59.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:20:59.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:01.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:01.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:01.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:02.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:03.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:03.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:03.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:03.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:03.800 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:04.432 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 13:21:04.432 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:21:04.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 13:21:04.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c7b30) pid(11036) version 11:1:1:4 [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7b30), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b5cc0, requested num -1 [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:21:04.439 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:04.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:21:04.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:21:04.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:04.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:21:04.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 13:21:04.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42ccc30) skgpid ospid 11036 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:05.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:05.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:05.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:06.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017c002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:06.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:06.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:06.494 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:21:06.494 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:06.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017d002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:06.500 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:06.500 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:06.630 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:21:06.630 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:21:06.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:21:06.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:21:06.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017e002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:07.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:07.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:07.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:08.803 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:08.803 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:09.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:09.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:09.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:10.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017f002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:10.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:10.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:10.273 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:21:10.273 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:10.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0180002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:10.279 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:10.279 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:11.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:11.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:11.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:12.463 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:13.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:13.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:13.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:13.806 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:13.806 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:15.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:15.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:15.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:15.767 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 13:21:15.767 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:21:15.768 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 13:21:15.768 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42c7b30) pid(11184/11184) version 11:1:1:4 [ CSSD]2013-05-23 13:21:15.774 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7b30), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:21:15.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:21:15.774 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:21:15.774 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 13:21:15.791 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42b35f0) skgpid 11184 ospid 11184 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:16.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0181002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:17.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:17.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:17.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:18.809 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:18.809 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:19.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:19.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:19.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 13:21:19.693 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:21:19.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 13:21:19.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42c7b30) pid(11211) version 11:1:1:4 [ CSSD]2013-05-23 13:21:19.699 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7b30), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:21:19.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:21:19.699 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:21:19.699 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:19.699 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:21:19.700 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:21:19.700 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:19.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:21:19.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:21:19.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:19.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:21:19.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:19.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 13:21:19.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b427d8a0) skgpid ospid 11211 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:21.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:21.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:21.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:22.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:23.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:23.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:23.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:23.813 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:23.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:25.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:25.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:25.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0182002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:25.532 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:25.532 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:25.532 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:21:25.532 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:25.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0183002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:25.538 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:25.538 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:25.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:27.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0184002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:27.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:27.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:27.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:28.573 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:21:28.574 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:21:28.574 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:21:28.574 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5bf0) pid(11317) version 11:1:1:4 [ CSSD]2013-05-23 13:21:28.580 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 13:21:28.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:21:28.580 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:21:28.580 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:28.580 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:21:28.581 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:21:28.581 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:28.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:21:28.587 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:21:28.587 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:28.587 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:21:28.790 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:21:28.790 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b42ccc30) skgpid ospid 11317 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:28.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:28.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:29.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:29.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:29.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:31.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:31.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:31.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:32.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:32.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0185002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:32.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:32.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:32.601 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:21:32.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:32.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0186002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:32.607 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:32.607 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:33.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:33.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:33.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:33.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:33.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:34.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:21:34.944 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:21:34.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:21:34.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b42b5bf0) pid(11372) version 11:1:1:4 [ CSSD]2013-05-23 13:21:34.950 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:21:34.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:21:34.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:21:34.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:34.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:21:34.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:21:34.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:34.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:21:34.958 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:21:34.958 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:34.958 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:21:35.160 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:21:35.160 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b42b35f0) skgpid ospid 11372 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:35.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:35.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:35.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:37.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0187002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:37.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:37.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:38.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:38.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:38.822 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:39.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:39.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:40.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:40.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0188002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:40.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:40.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:40.779 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:21:40.779 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:40.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0189002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:40.785 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:40.785 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:41.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:41.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:42.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:42.524 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:43.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:43.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:43.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:43.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:44.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:45.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:45.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:46.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:47.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018a002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:47.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:47.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:48.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:48.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:48.829 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:49.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:49.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:50.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:50.194 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:21:50.195 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:21:50.195 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:21:50.195 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b5bf0) pid(11556) version 11:1:1:4 [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:21:50.201 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:50.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:21:50.208 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:21:50.208 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:21:50.208 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:21:50.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:21:50.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b427d8a0) skgpid ospid 11556 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:21:51.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:51.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:52.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:52.544 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:21:53.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:53.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:53.832 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:53.832 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:54.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:55.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:55.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:56.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018b002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:56.028 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:21:56.028 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:21:56.028 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:21:56.028 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:21:56.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018c002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:56.034 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:21:56.034 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:21:56.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:57.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018d002b) incarnation(174631051) [ CSSD]2013-05-23 13:21:57.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:57.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:21:58.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:21:58.835 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:21:58.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:21:59.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:21:59.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:00.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:00.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018e002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:00.447 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:00.447 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:00.447 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:00.447 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:00.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018f002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:00.453 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:00.453 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:01.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:01.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:02.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:02.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:03.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:03.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:03.838 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:03.838 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:04.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:22:04.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:22:04.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:22:04.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:22:04.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0190002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:04.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:04.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:04.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:22:04.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:22:04.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0191002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:04.199 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:04.199 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:04.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:05.443 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:22:05.444 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:22:05.444 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:22:05.444 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5bf0) pid(11712) version 11:1:1:4 [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:22:05.451 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:05.457 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:05.457 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:22:05.457 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:05.457 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:22:05.660 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:22:05.660 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b42ccc30) skgpid ospid 11712 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:05.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:05.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:06.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:07.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0192002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:07.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:07.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:08.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:08.841 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:08.841 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:09.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:09.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:10.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:11.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0193002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:11.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:11.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:11.290 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:11.290 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:11.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0194002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:11.298 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:11.298 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:11.634 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:22:11.635 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:22:11.635 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:22:11.635 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5bf0) pid(11829) version 11:1:1:4 [ CSSD]2013-05-23 13:22:11.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:11.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:12.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:12.587 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:12.844 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:12.844 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:22:13.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:13.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:14.124 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:22:14.124 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b42ccc30) skgpid ospid 11829 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:14.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:15.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:15.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:16.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:17.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0195002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:17.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:17.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:17.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:17.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:18.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:19.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:19.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:20.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:20.693 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:22:20.693 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:22:20.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:22:20.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42b5bf0) pid(12196) version 11:1:1:4 [ CSSD]2013-05-23 13:22:20.700 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:22:20.700 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:22:20.700 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:22:20.700 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:20.700 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:22:20.701 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:22:20.701 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:20.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:22:20.707 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:22:20.707 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:20.707 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:22:20.910 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:22:20.910 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b42ccc30) skgpid ospid 12196 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:21.652 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5bf0) allocated [ CSSD]2013-05-23 13:22:21.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:22:21.653 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5bf0 - 1,2,3 [ CSSD]2013-05-23 13:22:21.653 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b5bf0) pid(10572/10572) version 11:1:1:4 [ CSSD]2013-05-23 13:22:21.659 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 13:22:21.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:22:21.660 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:22:21.660 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:22:21.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:21.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:22.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:22.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:22.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:22.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:23.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:23.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:24.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:25.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:25.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:26.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:26.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0196002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:26.551 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:26.551 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:26.551 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:26.551 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:26.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0197002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:26.558 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:26.558 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:27.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0198002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:27.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:27.853 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:27.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:27.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:28.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:28.832 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:22:28.833 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:22:28.834 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:22:28.834 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42d8e90) pid(12294) version 11:1:1:4 [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42b3980, requested num -1 [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:22:28.840 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:28.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:22:28.847 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:22:28.847 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:28.847 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:22:29.050 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:22:29.050 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42c7c00) skgpid ospid 12294 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:29.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:29.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:30.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:30.536 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 13:22:30.537 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:22:30.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 13:22:30.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e330) proc(0x7f82b42d8e90) pid(11260/11260) version 11:1:1:4 [ CSSD]2013-05-23 13:22:30.544 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d8e90), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:22:30.544 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:22:30.544 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:22:30.544 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:22:31.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:31.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:32.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:32.649 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:32.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:32.856 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:32.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0199002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:32.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:32.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:32.863 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:32.863 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:32.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019a002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:32.870 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:32.870 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:33.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:33.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:34.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:35.942 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 13:22:35.943 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:22:35.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 13:22:35.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad40) proc(0x7f82b42a1690) pid(12373) version 11:1:1:4 [ CSSD]2013-05-23 13:22:35.950 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a1690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:35.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:35.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d8630, requested num -1 [ CSSD]2013-05-23 13:22:35.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:35.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429eca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:22:35.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:22:35.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:35.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:22:35.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:22:35.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4ae0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:35.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4ae0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:22:35.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:35.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:36.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 13:22:36.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42bad40) skgpid ospid 12373 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:36.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:37.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019b002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:37.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:37.860 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:37.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:37.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:38.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:40.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:40.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:40.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:41.740 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7f60) allocated [ CSSD]2013-05-23 13:22:41.741 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:22:41.742 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7f60 - 1,2,3 [ CSSD]2013-05-23 13:22:41.742 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7c00) proc(0x7f82b42c7f60) pid(11264/11264) version 11:1:1:4 [ CSSD]2013-05-23 13:22:41.749 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7f60), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 13:22:41.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:22:41.749 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:22:41.749 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:22:41.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019c002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:41.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:41.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:41.802 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:41.802 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:41.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019d002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:41.808 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:41.808 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:42.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:42.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:42.547 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42b5bf0), client(2/0x7f82b42a9160) [ CSSD]2013-05-23 13:22:42.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42a9160) [ CSSD]2013-05-23 13:22:42.547 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:22:42.547 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 13:22:42.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:42.671 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:42.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:42.863 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:44.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:44.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:44.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:45.344 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7f60), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 13:22:45.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:22:45.344 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:22:45.344 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 13:22:46.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:46.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:46.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:22:46.286 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:22:46.286 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:22:46.286 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:22:46.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid 6487 ospid 6487 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:46.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:47.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019e002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:47.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:47.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:48.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:48.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:48.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:50.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:50.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:50.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:51.195 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:22:51.196 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:22:51.196 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:22:51.196 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b4207c10) pid(12532) version 11:1:1:4 [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba720 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:22:51.204 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:51.210 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:22:51.210 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba720), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:22:51.210 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:22:51.210 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:22:51.413 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:22:51.413 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42b35f0) skgpid ospid 12532 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:22:52.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:52.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:52.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:22:52.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:52.869 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:52.869 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:54.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:54.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:54.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:56.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:56.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:56.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:22:57.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019f002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:57.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:22:57.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:22:57.050 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:22:57.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:22:57.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a0002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:57.057 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:22:57.057 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:22:57.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a1002b) incarnation(174631051) [ CSSD]2013-05-23 13:22:57.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:22:57.872 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:22:58.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:22:58.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:22:58.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:00.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:00.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:00.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:02.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:02.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:02.725 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:02.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:02.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:02.875 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:04.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:04.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:04.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:06.445 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:06.446 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:23:06.447 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:06.447 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(12679) version 11:1:1:4 [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:06.453 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:06.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:23:06.460 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:23:06.460 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:06.460 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:06.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:06.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:06.663 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:06.663 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 12679 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:06.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:07.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a2002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:07.878 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:07.878 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:08.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:08.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:08.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:10.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:10.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:10.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:12.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a3002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:12.308 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:23:12.308 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:23:12.308 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:23:12.308 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:12.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a4002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:12.314 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:23:12.315 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:23:12.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:12.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:12.751 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:12.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:12.881 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:12.881 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:14.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:14.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:14.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:16.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:16.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:16.884 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:16.884 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:23:16.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:17.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a5002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:18.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:18.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:18.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:20.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:20.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:20.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:21.696 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:21.697 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:23:21.697 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:21.697 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(12848) version 11:1:1:4 [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:21.704 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:21.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:23:21.711 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:23:21.711 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:21.711 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:21.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:21.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:21.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:21.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 12848 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:22.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:22.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:22.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:23.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:24.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:24.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:25.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:26.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:26.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:26.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:26.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:27.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:27.212 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:27.213 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:27.213 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:27.213 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d4c0) proc(0x7f82b4207c10) pid(12939) version 11:1:1:4 [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42c8370) [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8370) [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42c8370 with con 0x7f82b42a3c70, requested num -1 [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:27.220 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:27.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8370) [ CSSD]2013-05-23 13:23:27.227 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8370), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:23:27.227 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:23:27.227 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:27.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a6002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:27.335 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5980) allocated [ CSSD]2013-05-23 13:23:27.336 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:27.336 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5980 - 1,2,3 [ CSSD]2013-05-23 13:23:27.336 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b42d5980) pid(12944) version 11:1:1:4 [ CSSD]2013-05-23 13:23:27.351 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:23:27.353 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:23:27.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:23:27.356 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5980 [ CSSD]2013-05-23 13:23:27.356 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5980) con(0x7f82b42a3c70) skgpid ospid 12944 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:27.429 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:27.429 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d4c0) skgpid ospid 12939 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:27.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a7002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:27.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:23:27.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:23:27.557 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:23:27.557 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:27.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a8002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:27.563 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:23:27.563 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:23:28.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:28.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:29.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:29.091 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:29.093 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:29.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:29.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b4207c10) pid(12962) version 11:1:1:4 [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:29.100 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:29.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:23:29.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:23:29.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:29.106 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:29.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:29.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42b35f0) skgpid ospid 12962 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:30.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:30.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:31.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:31.894 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:31.894 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:32.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:32.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:32.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:33.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:33.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a9002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:33.126 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:23:33.126 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:23:33.126 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:23:33.126 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:33.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01aa002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:33.134 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:23:33.134 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:23:34.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:34.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:35.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:35.897 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:35.897 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:23:36.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:36.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:36.952 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:36.953 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:23:36.953 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:36.953 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d4c0) proc(0x7f82b4207c10) pid(13026) version 11:1:1:4 [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42ba720) [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba720 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:36.959 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:36.966 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba720) [ CSSD]2013-05-23 13:23:36.966 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba720), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:23:36.966 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42be580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:36.966 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42be580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:37.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:37.168 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:37.168 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d4c0) skgpid ospid 13026 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:37.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ab002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:38.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:38.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:39.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:40.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:40.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:40.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:40.899 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:41.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:41.439 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:23:41.440 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:41.440 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:23:41.440 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(13111) version 11:1:1:4 [ CSSD]2013-05-23 13:23:42.093 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:23:42.093 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 13111 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:42.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:42.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:42.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ac002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:42.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:23:42.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:23:42.809 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:23:42.809 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:42.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ad002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:42.815 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:23:42.815 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:23:42.825 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:42.987 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 13:23:42.987 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c30) allocated [ CSSD]2013-05-23 13:23:42.988 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:42.988 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:42.988 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 13:23:42.988 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b41fe180) pid(12499/12499) version 11:1:1:4 [ CSSD]2013-05-23 13:23:42.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c30 - 1,2,3 [ CSSD]2013-05-23 13:23:42.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d3c30) pid(11262/11262) version 11:1:1:4 [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d3c30), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b41fe180), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:23:42.996 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:23:43.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:43.779 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d3c30), client(2/0x7f82b42c8370) [ CSSD]2013-05-23 13:23:43.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42c8370) [ CSSD]2013-05-23 13:23:43.779 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:23:43.779 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 13:23:43.933 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204290) allocated [ CSSD]2013-05-23 13:23:43.933 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:43.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204290 - 1,2,3 [ CSSD]2013-05-23 13:23:43.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6a90) proc(0x7f82b4204290) pid(11258/11258) version 11:1:1:4 [ CSSD]2013-05-23 13:23:43.939 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4204290), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:23:43.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:23:43.939 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:23:43.939 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:23:43.978 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4204290), client(2/0x7f82b42d9760) [ CSSD]2013-05-23 13:23:43.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 13:23:43.978 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:23:43.978 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 13:23:44.175 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b41fe180), client(2/0x7f82b42a2a00) [ CSSD]2013-05-23 13:23:44.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:23:44.175 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:23:44.175 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 13:23:44.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:44.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:45.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:45.902 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:45.902 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:46.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:46.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:47.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:47.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ae002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:48.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:48.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:49.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:50.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 13:23:50.773 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4286810), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:23:50.773 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4286810), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:23:50.773 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 13:23:50.778 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42c6340) skgpid 7135 ospid 7135 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:50.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:50.905 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:23:51.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:51.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:51.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:52.201 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 13:23:52.202 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:23:52.203 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 13:23:52.203 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fb0) proc(0x7f82b42a3ad0) pid(13356) version 11:1:1:4 [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a3ad0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b427d410, requested num -1 [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:23:52.209 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:52.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:23:52.216 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:23:52.216 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:23:52.216 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:23:52.419 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 13:23:52.419 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42d5fb0) skgpid ospid 13356 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:23:52.853 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:23:53.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:53.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:53.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:54.579 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:23:54.580 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:23:54.580 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:23:54.580 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fb0) proc(0x7f82b42c5f40) pid(13287/13287) version 11:1:1:4 [ CSSD]2013-05-23 13:23:54.597 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:23:54.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:23:54.597 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:23:54.597 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:23:54.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:54.908 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:23:55.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:55.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:55.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:57.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:57.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:57.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:57.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01af002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:58.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b0002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:58.057 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:23:58.057 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:23:58.057 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:23:58.058 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:23:58.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b1002b) incarnation(174631051) [ CSSD]2013-05-23 13:23:58.064 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:23:58.064 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:23:59.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:23:59.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:23:59.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:23:59.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:23:59.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:01.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:01.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:01.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:02.873 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:03.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:03.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:03.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:04.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:04.915 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:05.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:05.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:05.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:07.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:07.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:07.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:07.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b2002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:07.452 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf750) allocated [ CSSD]2013-05-23 13:24:07.453 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:24:07.454 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf750 - 1,2,3 [ CSSD]2013-05-23 13:24:07.454 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5be0) proc(0x7f82b42cf750) pid(13508) version 11:1:1:4 [ CSSD]2013-05-23 13:24:07.470 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf750), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:24:07.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:24:07.470 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42ce870, requested num -1 [ CSSD]2013-05-23 13:24:07.470 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:07.470 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca380/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:24:07.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:07.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:07.478 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:24:07.478 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:24:07.478 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca680) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:07.478 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:07.680 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf750 [ CSSD]2013-05-23 13:24:07.680 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf750) con(0x7f82b42d5be0) skgpid ospid 13508 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:09.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:09.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:09.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:09.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:09.918 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:11.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:11.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:11.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:12.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:13.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:13.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:13.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b3002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:13.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:24:13.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:24:13.315 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:24:13.315 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:13.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b4002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:13.322 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:24:13.322 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:24:13.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:13.794 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf750) allocated [ CSSD]2013-05-23 13:24:13.795 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:24:13.795 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf750 - 1,2,3 [ CSSD]2013-05-23 13:24:13.795 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cf750) pid(13606) version 11:1:1:4 [ CSSD]2013-05-23 13:24:13.914 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd210) allocated [ CSSD]2013-05-23 13:24:13.915 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:24:13.916 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd210 - 1,2,3 [ CSSD]2013-05-23 13:24:13.916 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ce870) proc(0x7f82b42dd210) pid(13616) version 11:1:1:4 [ CSSD]2013-05-23 13:24:13.934 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:24:13.936 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:24:13.939 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd210 [ CSSD]2013-05-23 13:24:13.939 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd210) con(0x7f82b42ce870) skgpid ospid 13616 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5309/0x7f82b42aee50) [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5309 (0x7f82b42aee50) [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42aee50 with con 0x7f82b42ce870, requested num -1 [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42ca380/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:14.017 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:24:14.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5309 (0x7f82b42aee50) [ CSSD]2013-05-23 13:24:14.023 [1199044928] >TRACE: clssgmExitGrock: client 5309 (0x7f82b42aee50), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:24:14.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca680) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:24:14.023 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42ca680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:14.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf750 [ CSSD]2013-05-23 13:24:14.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf750) con(0x7f82b42c6340) skgpid ospid 13606 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:14.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:14.921 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:15.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:15.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:15.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:17.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:17.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:17.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b5002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:17.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:18.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:18.923 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:24:19.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:19.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:19.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:21.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:21.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:21.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:22.716 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf750) allocated [ CSSD]2013-05-23 13:24:22.717 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:24:22.718 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf750 - 1,2,3 [ CSSD]2013-05-23 13:24:22.718 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ce870) proc(0x7f82b42cf750) pid(13684) version 11:1:1:4 [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf750), client(1/0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429ecc0 with con 0x7f82b42cf880, requested num -1 [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca380/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:22.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:22.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:22.731 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429ecc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:24:22.731 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca680) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:22.731 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:22.917 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:22.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf750 [ CSSD]2013-05-23 13:24:22.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf750) con(0x7f82b42ce870) skgpid ospid 13684 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:23.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:23.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:23.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:23.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:23.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:24.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:24:24.647 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:24:24.647 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:24:24.647 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:24:24.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:24:24.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d5fb0) skgpid 13287 ospid 13287 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:25.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:25.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:25.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:27.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:27.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:27.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b6002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:27.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:28.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b7002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:28.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:24:28.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:24:28.564 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:24:28.565 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:28.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b8002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:28.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:24:28.571 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:24:28.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:28.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:29.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:29.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:29.346 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 13:24:29.347 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:24:29.347 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 13:24:29.347 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a3ad0) pid(13772) version 11:1:1:4 [ CSSD]2013-05-23 13:24:29.363 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a3ad0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d5be0, requested num -1 [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:29.364 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:29.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:24:29.370 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:24:29.370 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:29.370 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:29.573 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 13:24:29.573 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42c6340) skgpid ospid 13772 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:29.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:31.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:31.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:31.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:32.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:33.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b9002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:33.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:24:33.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:24:33.391 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:24:33.391 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:33.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ba002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:33.397 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:24:33.397 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:24:33.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:33.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:33.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:33.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:33.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:35.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:35.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:35.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:37.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:37.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:37.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bb002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:37.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:37.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:37.936 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:24:37.966 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:24:37.967 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:24:37.967 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:24:37.967 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fb0) proc(0x7f82b42c5f40) pid(13842) version 11:1:1:4 [ CSSD]2013-05-23 13:24:37.973 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:24:37.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:24:37.973 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b427d410, requested num -1 [ CSSD]2013-05-23 13:24:37.973 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:37.973 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:24:37.974 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:37.974 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:37.980 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:24:37.980 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:24:37.980 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:37.980 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:38.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:24:38.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d5fb0) skgpid ospid 13842 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:39.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:39.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:39.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:41.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:41.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:41.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:42.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:42.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:42.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:43.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:43.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:43.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01bc002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:43.819 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:24:43.819 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:24:43.819 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:24:43.819 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:43.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01bd002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:43.826 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:24:43.826 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:24:43.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:45.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:45.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:45.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:47.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01be002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:47.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:47.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:47.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:47.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:47.943 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:49.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:49.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:49.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:51.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:51.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:51.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:52.945 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:52.946 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:24:52.979 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:24:53.227 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 13:24:53.228 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:24:53.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 13:24:53.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5be0) proc(0x7f82b42a3ad0) pid(14007) version 11:1:1:4 [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a3ad0), client(1/0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429ecc0 with con 0x7f82b427d410, requested num -1 [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:24:53.235 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:53.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:24:53.241 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429ecc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:24:53.241 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:24:53.241 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:24:53.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 13:24:53.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42d5be0) skgpid ospid 14007 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:24:53.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:53.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:53.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:55.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:55.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:55.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:56.948 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:24:56.948 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:24:57.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bf002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:57.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:57.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:57.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:24:59.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c0002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:59.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:24:59.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:24:59.068 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:24:59.068 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:24:59.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c1002b) incarnation(174631051) [ CSSD]2013-05-23 13:24:59.074 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:24:59.074 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:24:59.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:24:59.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:24:59.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:01.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:01.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:01.951 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:01.951 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:02.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:02.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:03.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:03.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:04.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:05.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:25:05.248 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:05.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:25:05.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5be0) proc(0x7f82b42c5f40) pid(14149/14149) version 11:1:1:4 [ CSSD]2013-05-23 13:25:05.255 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:25:05.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:25:05.255 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:25:05.255 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:25:05.542 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d5be0) skgpid 14149 ospid 14149 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:05.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:05.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:06.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:06.954 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:06.954 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:07.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c2002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:07.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:07.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:08.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:08.487 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 13:25:08.488 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:25:08.489 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 13:25:08.489 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fb0) proc(0x7f82b42a3ad0) pid(14173) version 11:1:1:4 [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a3ad0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427d410, requested num -1 [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:25:08.505 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:25:08.506 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:08.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:25:08.512 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:25:08.512 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:08.512 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:25:08.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 13:25:08.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b42d5fb0) skgpid ospid 14173 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:09.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:09.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:10.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:11.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:11.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:11.957 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:11.958 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:12.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:13.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:13.368 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:25:13.368 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:13.369 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:25:13.369 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5be0) proc(0x7f82b42c5f40) pid(13342/13342) version 11:1:1:4 [ CSSD]2013-05-23 13:25:13.375 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:25:13.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:25:13.375 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:25:13.375 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:25:13.432 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9d40) allocated [ CSSD]2013-05-23 13:25:13.432 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:13.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9d40 - 1,2,3 [ CSSD]2013-05-23 13:25:13.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42573d0) proc(0x7f82b42c9d40) pid(13334/13334) version 11:1:1:4 [ CSSD]2013-05-23 13:25:13.438 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9d40), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:25:13.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:25:13.438 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:25:13.438 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 13:25:13.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:13.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:14.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:14.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c3002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:14.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:25:14.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:25:14.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:25:14.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:14.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c4002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:14.332 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:25:14.332 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:25:15.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:15.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:16.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:16.961 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:16.961 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:17.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c5002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:17.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:17.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:18.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:19.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:19.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:20.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:21.963 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:21.964 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:22.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:22.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:22.169 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd590) allocated [ CSSD]2013-05-23 13:25:22.169 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:22.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd590 - 1,2,3 [ CSSD]2013-05-23 13:25:22.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42dd590) pid(14307/14307) version 11:1:1:4 [ CSSD]2013-05-23 13:25:22.176 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd590), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:25:22.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:25:22.176 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:25:22.176 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 13:25:22.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:23.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:23.748 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0460) allocated [ CSSD]2013-05-23 13:25:23.749 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:25:23.749 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0460 - 1,2,3 [ CSSD]2013-05-23 13:25:23.749 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de190) proc(0x7f82b42e0460) pid(14324) version 11:1:1:4 [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0460), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42e0380, requested num -1 [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0be0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:25:23.755 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:23.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:25:23.761 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:25:23.761 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0ee0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:23.761 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0ee0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:25:23.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0460 [ CSSD]2013-05-23 13:25:23.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0460) con(0x7f82b42de190) skgpid ospid 14324 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:24.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:24.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:24.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd590 [ CSSD]2013-05-23 13:25:24.425 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd590) con(0x7f82b42c6340) skgpid 14307 ospid 14307 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:24.868 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c5f40), client(2/0x7f82b429ecc0) [ CSSD]2013-05-23 13:25:24.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:25:24.868 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:25:24.868 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 13:25:24.934 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd8e0) allocated [ CSSD]2013-05-23 13:25:24.934 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:24.935 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd8e0 - 1,2,3 [ CSSD]2013-05-23 13:25:24.935 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5fb0) proc(0x7f82b42dd8e0) pid(14264/14264) version 11:1:1:4 [ CSSD]2013-05-23 13:25:24.941 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd8e0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:25:24.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:25:24.941 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:25:24.941 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 13:25:26.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:26.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:26.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:26.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:26.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:27.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c6002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:28.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:28.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:28.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:29.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c7002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:29.574 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:25:29.574 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:25:29.574 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:25:29.574 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:29.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c8002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:29.582 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:25:29.582 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:25:29.616 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0780) allocated [ CSSD]2013-05-23 13:25:29.617 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:25:29.618 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0780 - 1,2,3 [ CSSD]2013-05-23 13:25:29.618 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de4b0) proc(0x7f82b42e0780) pid(14410) version 11:1:1:4 [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0780), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e06a0, requested num -1 [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0f00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:25:29.624 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:29.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:25:29.632 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:25:29.632 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1200) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:29.632 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1200) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:25:29.834 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0780 [ CSSD]2013-05-23 13:25:29.834 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0780) con(0x7f82b42de4b0) skgpid ospid 14410 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:30.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:30.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:30.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:31.970 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:31.970 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:32.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:32.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:32.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:33.068 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:33.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c9002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:33.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:25:33.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:25:33.643 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:25:33.643 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:33.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ca002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:33.650 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:25:33.650 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:25:33.961 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd8e0), client(2/0x7f82b42cb000) [ CSSD]2013-05-23 13:25:33.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cb000) [ CSSD]2013-05-23 13:25:33.961 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:25:33.961 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 13:25:34.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:34.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:34.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:36.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:36.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:36.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:36.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:36.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:37.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cb002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:38.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:38.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:38.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:38.997 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0c20) allocated [ CSSD]2013-05-23 13:25:38.998 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:25:38.999 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0c20 - 1,2,3 [ CSSD]2013-05-23 13:25:38.999 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de950) proc(0x7f82b42e0c20) pid(14520) version 11:1:1:4 [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0c20), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42e0b40, requested num -1 [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e13a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:25:39.005 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:39.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:25:39.012 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:25:39.012 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e16a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:39.012 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e16a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:25:39.215 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0c20 [ CSSD]2013-05-23 13:25:39.215 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0c20) con(0x7f82b42de950) skgpid ospid 14520 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:40.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:40.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:40.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:40.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:40.976 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:25:42.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:42.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:42.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:43.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:44.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:44.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:44.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:44.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cc002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:44.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:25:44.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:25:44.822 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:25:44.822 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:44.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01cd002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:44.829 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:25:44.829 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:25:45.979 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:45.979 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:46.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:46.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:46.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:47.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ce002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:48.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:48.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:48.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:50.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:50.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:50.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:50.982 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:50.983 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:52.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:52.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:52.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:53.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:25:54.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:54.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:54.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0b60) allocated [ CSSD]2013-05-23 13:25:54.248 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:25:54.249 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0b60 - 1,2,3 [ CSSD]2013-05-23 13:25:54.249 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de890) proc(0x7f82b42e0b60) pid(14669) version 11:1:1:4 [ CSSD]2013-05-23 13:25:54.254 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0b60), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:25:54.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:25:54.254 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42e0a80, requested num -1 [ CSSD]2013-05-23 13:25:54.255 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:54.255 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e12e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:25:54.255 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:25:54.255 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:25:54.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:25:54.262 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:25:54.262 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e15e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:25:54.262 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e15e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:25:54.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0b60 [ CSSD]2013-05-23 13:25:54.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0b60) con(0x7f82b42de890) skgpid ospid 14669 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:25:54.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:55.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:55.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:25:56.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:56.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:56.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:57.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cf002b) incarnation(174631051) [ CSSD]2013-05-23 13:25:58.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:25:58.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:25:58.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:25:59.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:25:59.989 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:26:00.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d0002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:00.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:00.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:00.084 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:26:00.084 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:00.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d1002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:00.092 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:00.092 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:00.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:00.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:00.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:02.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:02.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:02.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:03.136 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:04.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:04.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:04.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:04.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:04.992 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:06.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:06.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:06.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:06.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d2002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:06.784 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:06.784 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:06.784 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:26:06.784 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:06.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d3002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:06.793 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:06.793 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:06.923 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:26:06.924 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:26:06.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:26:06.926 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:26:07.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d4002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:08.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:08.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:08.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:09.507 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0c20) allocated [ CSSD]2013-05-23 13:26:09.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:26:09.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0c20 - 1,2,3 [ CSSD]2013-05-23 13:26:09.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de950) proc(0x7f82b42e0c20) pid(14816) version 11:1:1:4 [ CSSD]2013-05-23 13:26:09.525 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0c20), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:26:09.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:09.525 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e0b40, requested num -1 [ CSSD]2013-05-23 13:26:09.525 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:09.525 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e13a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:26:09.526 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:26:09.526 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:09.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:09.533 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:26:09.533 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e16a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:09.533 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e16a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:26:09.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0c20 [ CSSD]2013-05-23 13:26:09.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0c20) con(0x7f82b42de950) skgpid ospid 14816 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:09.995 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:09.995 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:10.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:10.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:10.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:12.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:12.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:12.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:13.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:14.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:14.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:14.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:14.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:14.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:15.227 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0c20) allocated [ CSSD]2013-05-23 13:26:15.228 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:26:15.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0c20 - 1,2,3 [ CSSD]2013-05-23 13:26:15.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de950) proc(0x7f82b42e0c20) pid(14897/14897) version 11:1:1:4 [ CSSD]2013-05-23 13:26:15.244 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0c20), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:26:15.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:26:15.244 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:26:15.244 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 13:26:15.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:26:15.260 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:26:15.260 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:26:15.260 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 13:26:15.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0c20 [ CSSD]2013-05-23 13:26:15.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0c20) con(0x7f82b42de950) skgpid 14897 ospid 14897 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:15.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d5002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:15.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:15.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:15.344 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:26:15.344 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:15.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d6002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:15.351 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:15.351 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:16.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:16.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:16.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:17.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d7002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:18.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:18.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:18.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:19.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:19.001 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:26:20.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:20.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:20.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41edd50) [ CSSD]2013-05-23 13:26:20.845 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41edd50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:26:20.845 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41edd50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:26:20.845 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:26:20.853 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid 9426 ospid 9426 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:20.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:22.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:22.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:22.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:23.179 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:24.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:24.004 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:24.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:24.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:24.778 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:26:24.779 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:26:24.780 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:26:24.780 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(14998) version 11:1:1:4 [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:26:24.786 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:24.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:26:24.793 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:26:24.793 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:24.793 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:26:24.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:24.996 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:26:24.996 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 14998 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:26.053 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:26:26.057 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:26:26.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:26:26.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(15048/15048) version 11:1:1:4 [ CSSD]2013-05-23 13:26:26.074 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:26:26.074 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:26:26.074 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:26:26.074 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 13:26:26.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:26.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:26.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:27.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d8002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:28.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:28.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:28.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:29.007 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:29.007 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:29.885 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0790) allocated [ CSSD]2013-05-23 13:26:29.887 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:26:29.887 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0790 - 1,2,3 [ CSSD]2013-05-23 13:26:29.887 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b42e0790) pid(15078) version 11:1:1:4 [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0790), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e06b0, requested num -1 [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0f10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:26:29.894 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:29.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:29.902 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:26:29.902 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1210) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:29.902 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1210) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:26:30.104 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0790 [ CSSD]2013-05-23 13:26:30.104 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0790) con(0x7f82b42b5b40) skgpid ospid 15078 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:30.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d9002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:30.592 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:30.592 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:30.592 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:26:30.592 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:30.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01da002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:30.598 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:30.598 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:30.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:30.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:30.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:32.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:32.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:32.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:33.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:33.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01db002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:33.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:33.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:33.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:26:33.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:33.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01dc002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:33.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:33.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:34.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:34.010 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:34.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:34.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:34.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:36.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:36.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:36.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:37.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01dd002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:38.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:38.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:38.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:39.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:39.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:40.027 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0920) allocated [ CSSD]2013-05-23 13:26:40.028 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:26:40.028 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0920 - 1,2,3 [ CSSD]2013-05-23 13:26:40.028 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42e0920) pid(15157) version 11:1:1:4 [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0920), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42e0840, requested num -1 [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e10a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:26:40.035 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:40.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:26:40.042 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:26:40.042 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e13a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:40.042 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e13a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:26:40.244 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0920 [ CSSD]2013-05-23 13:26:40.244 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0920) con(0x7f82b42b59f0) skgpid ospid 15157 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:40.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:40.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:40.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:42.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:42.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:43.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:43.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:44.016 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:44.016 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:44.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:44.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:45.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:45.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01de002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:45.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:26:45.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:26:45.847 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:26:45.847 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:45.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01df002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:45.854 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:26:45.854 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:26:46.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:46.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:47.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:47.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e0002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:48.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:48.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:49.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:49.020 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:49.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:50.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:50.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:51.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:52.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:52.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:53.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:53.243 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:26:54.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:54.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:26:54.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:54.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:55.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:55.277 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0920) allocated [ CSSD]2013-05-23 13:26:55.278 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:26:55.278 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0920 - 1,2,3 [ CSSD]2013-05-23 13:26:55.278 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42e0920) pid(15308) version 11:1:1:4 [ CSSD]2013-05-23 13:26:55.285 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0920), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:26:55.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:55.285 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e0840, requested num -1 [ CSSD]2013-05-23 13:26:55.285 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:55.285 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e10a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:26:55.286 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:26:55.286 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:26:55.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:26:55.293 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:26:55.293 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e13a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:26:55.293 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e13a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:26:55.496 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0920 [ CSSD]2013-05-23 13:26:55.496 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0920) con(0x7f82b42b59f0) skgpid ospid 15308 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:26:56.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:56.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:57.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:26:57.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e1002b) incarnation(174631051) [ CSSD]2013-05-23 13:26:58.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:26:58.026 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:26:58.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:26:58.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:26:59.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:00.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:00.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:01.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e2002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:01.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:01.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:01.094 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:27:01.094 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:01.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e3002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:01.100 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:01.100 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:01.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:02.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:02.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:03.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:03.029 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:03.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:03.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:04.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:27:04.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:27:04.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:27:04.446 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:27:04.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e4002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:04.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:04.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:04.520 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:27:04.520 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:27:04.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e5002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:04.527 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:04.527 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:04.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:04.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:05.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:06.029 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0790) allocated [ CSSD]2013-05-23 13:27:06.030 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:27:06.031 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0790 - 1,2,3 [ CSSD]2013-05-23 13:27:06.031 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42e0790) pid(15423) version 11:1:1:4 [ CSSD]2013-05-23 13:27:06.037 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0790), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42e0640, requested num -1 [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:06.038 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:06.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:27:06.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:06.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:06.044 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:06.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0790 [ CSSD]2013-05-23 13:27:06.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0790) con(0x7f82b4207f10) skgpid ospid 15423 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:07.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:07.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:07.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:07.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e6002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:08.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:08.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:09.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:09.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:09.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:10.531 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0920) allocated [ CSSD]2013-05-23 13:27:10.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:27:10.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0920 - 1,2,3 [ CSSD]2013-05-23 13:27:10.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42e0920) pid(15486) version 11:1:1:4 [ CSSD]2013-05-23 13:27:10.538 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0920), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:27:10.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:27:10.538 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e0840, requested num -1 [ CSSD]2013-05-23 13:27:10.538 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:10.538 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e10a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:10.539 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:10.539 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:10.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:27:10.546 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:10.546 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e13a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:10.546 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e13a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:10.749 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0920 [ CSSD]2013-05-23 13:27:10.749 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0920) con(0x7f82b42b59f0) skgpid ospid 15486 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:11.021 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0850) allocated [ CSSD]2013-05-23 13:27:11.022 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:27:11.022 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0850 - 1,2,3 [ CSSD]2013-05-23 13:27:11.022 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42e0850) pid(15543) version 11:1:1:4 [ CSSD]2013-05-23 13:27:11.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:11.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:11.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:13.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:13.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:13.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:13.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:13.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:13.286 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:13.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0850 [ CSSD]2013-05-23 13:27:13.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0850) con(0x7f82b4207f10) skgpid ospid 15543 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:15.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:15.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:15.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:16.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e7002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:16.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:16.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:16.338 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:27:16.338 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:16.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e8002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:16.346 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:16.346 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:17.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:17.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:17.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:17.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e9002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:18.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:18.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:19.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:19.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:19.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:21.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:21.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:21.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:22.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:22.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:27:23.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:23.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:23.307 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:23.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:27:24.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid 15048 ospid 15048 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:25.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:25.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:25.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:25.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:27:25.782 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:27:25.783 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:27:25.783 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(15956) version 11:1:1:4 [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:25.789 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:25.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:27:25.796 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:25.796 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de0f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:25.796 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de0f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:25.999 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:27:25.999 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 15956 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:27.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:27.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:27.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:27.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:27.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:27.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ea002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:29.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:29.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:29.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:30.141 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:27:30.142 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:27:30.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:27:30.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(16022) version 11:1:1:4 [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:30.149 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:30.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:27:30.156 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:30.156 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de0f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:30.156 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de0f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:30.359 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:27:30.359 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 16022 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:31.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:31.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:31.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:31.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01eb002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:31.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:31.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:31.587 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:27:31.587 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:31.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ec002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:31.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:31.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:32.047 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:32.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:33.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:33.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:33.328 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:33.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:34.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ed002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:34.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:34.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:34.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:27:34.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:34.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ee002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:34.162 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:34.162 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:35.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:35.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:35.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:35.521 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:27:35.522 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:27:35.523 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:27:35.523 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207f10) proc(0x7f82b42833d0) pid(16068) version 11:1:1:4 [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:35.529 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:35.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 13:27:35.535 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:35.535 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de0f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:35.535 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de0f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:35.738 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:27:35.738 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4207f10) skgpid ospid 16068 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:37.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:37.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:37.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:37.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:37.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:37.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ef002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:39.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:39.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:39.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:41.040 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:27:41.041 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:27:41.042 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:27:41.042 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b42833d0) pid(16148) version 11:1:1:4 [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42833d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:41.048 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:41.053 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:41.053 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:27:41.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:27:41.054 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:41.054 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:41.054 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:41.257 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:27:41.257 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42b5b40) skgpid ospid 16148 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:41.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:41.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:41.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:43.349 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:43.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:43.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:43.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:45.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:45.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:45.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:46.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:46.056 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:46.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42a9160) [ CSSD]2013-05-23 13:27:46.350 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42a9160), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:27:46.350 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42a9160), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:27:46.350 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5bf0 [ CSSD]2013-05-23 13:27:46.356 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5bf0) con(0x7f82b427d8a0) skgpid 10572 ospid 10572 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:46.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f0002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:46.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:27:46.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:27:46.843 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:27:46.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:46.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f1002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:46.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:27:46.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:27:47.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:47.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:47.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:47.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f2002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:49.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:49.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:49.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:51.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:51.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:51.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:51.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:51.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:53.369 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:27:53.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:53.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:53.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:54.785 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:27:54.786 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:27:54.786 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:27:54.786 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(16301/16301) version 11:1:1:4 [ CSSD]2013-05-23 13:27:54.802 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:27:54.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:27:54.802 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:27:54.802 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 13:27:55.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:55.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:55.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:56.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:27:56.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:27:56.290 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 13:27:56.291 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:27:56.292 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 13:27:56.292 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b42830a0) pid(16311) version 11:1:1:4 [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42830a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:27:56.298 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:27:56.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:27:56.305 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:27:56.305 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429d6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:27:56.305 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429d6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:27:56.507 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 13:27:56.507 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b42c7b30) skgpid ospid 16311 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:27:57.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:57.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:57.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:27:57.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f3002b) incarnation(174631051) [ CSSD]2013-05-23 13:27:59.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:27:59.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:27:59.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:01.065 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:01.065 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:01.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:01.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:01.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:02.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f4002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:02.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:28:02.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:28:02.092 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:28:02.092 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:02.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f5002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:02.098 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:28:02.098 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:28:03.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:03.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:03.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:03.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:05.068 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:05.068 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:28:05.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:05.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:05.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:07.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:07.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:07.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:07.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f6002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:09.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:09.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:09.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:10.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:10.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:11.540 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 13:28:11.541 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:28:11.541 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 13:28:11.541 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b42b3030) pid(16452) version 11:1:1:4 [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b3030), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a9160 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:11.548 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:11.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:28:11.555 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a9160), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:28:11.555 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b45f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:11.555 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b45f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:11.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:11.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:11.757 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 13:28:11.757 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b42c7b30) skgpid ospid 16452 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:11.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:13.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:13.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:13.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:13.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:15.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:15.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:15.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:15.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:15.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:17.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f7002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:17.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:28:17.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:28:17.340 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:28:17.340 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:17.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f8002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:17.346 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:28:17.346 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:28:17.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:17.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:17.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:18.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f9002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:19.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:19.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:19.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:20.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:20.078 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:21.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:21.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:21.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:23.436 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:23.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:23.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:23.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:24.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:24.080 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:28:25.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:25.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:25.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:26.791 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 13:28:26.792 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:28:26.792 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 13:28:26.792 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b42830a0) pid(16596) version 11:1:1:4 [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42830a0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:26.798 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:26.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:28:26.805 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:28:26.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429d6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:26.805 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429d6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:27.007 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 13:28:27.007 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b42c7b30) skgpid ospid 16596 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:27.500 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c81e0) allocated [ CSSD]2013-05-23 13:28:27.501 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:28:27.502 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c81e0 - 1,2,3 [ CSSD]2013-05-23 13:28:27.502 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42c81e0) pid(16643) version 11:1:1:4 [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c81e0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4207960 with con 0x7f82b42af470, requested num -1 [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:27.509 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:27.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:27.518 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:28:27.518 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b45f0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:28:27.518 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b45f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:27.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de0d0) allocated [ CSSD]2013-05-23 13:28:27.625 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:28:27.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de0d0 - 1,2,3 [ CSSD]2013-05-23 13:28:27.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42833d0) proc(0x7f82b42de0d0) pid(16648) version 11:1:1:4 [ CSSD]2013-05-23 13:28:27.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:28:27.643 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:28:27.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:28:27.647 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de0d0 [ CSSD]2013-05-23 13:28:27.647 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de0d0) con(0x7f82b42833d0) skgpid ospid 16648 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:27.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c81e0 [ CSSD]2013-05-23 13:28:27.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c81e0) con(0x7f82b427d8a0) skgpid ospid 16643 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:27.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:27.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:27.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:29.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fa002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:29.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:29.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:29.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:29.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:29.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:30.403 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42830a0) allocated [ CSSD]2013-05-23 13:28:30.404 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:28:30.405 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42830a0 - 1,2,3 [ CSSD]2013-05-23 13:28:30.405 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b42830a0) pid(16675) version 11:1:1:4 [ CSSD]2013-05-23 13:28:30.411 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42830a0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 13:28:30.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:28:30.411 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:28:30.411 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:30.411 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:28:30.412 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:30.412 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:30.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:28:30.418 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:28:30.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429d6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:30.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429d6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:30.621 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42830a0 [ CSSD]2013-05-23 13:28:30.621 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42830a0) con(0x7f82b42c7b30) skgpid ospid 16675 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:31.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:31.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:31.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:32.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fb002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:32.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:28:32.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:28:32.587 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:28:32.587 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:32.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fc002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:32.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:28:32.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:28:33.464 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:33.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:33.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:33.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:34.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:34.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:34.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fd002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:34.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:28:34.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:28:34.424 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:28:34.424 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:34.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fe002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:34.430 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:28:34.430 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:28:35.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:35.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:35.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:37.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:37.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:37.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:39.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ff002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:39.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:39.089 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:39.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:39.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:39.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:40.820 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 13:28:40.821 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:28:40.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 13:28:40.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b3030) pid(16809) version 11:1:1:4 [ CSSD]2013-05-23 13:28:41.402 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 13:28:41.402 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b427d8a0) skgpid ospid 16809 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:41.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:41.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:41.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:42.046 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 13:28:42.047 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:28:42.047 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 13:28:42.047 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42af3a0) pid(16916) version 11:1:1:4 [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42af3a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:42.054 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:42.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:42.061 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:28:42.061 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:42.061 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:42.264 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 13:28:42.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b4257120) skgpid ospid 16916 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:43.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:43.092 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:28:43.485 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:43.725 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 13:28:43.726 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:28:43.726 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 13:28:43.726 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42b3030) pid(14948/14948) version 11:1:1:4 [ CSSD]2013-05-23 13:28:43.742 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b3030), client(1/0x7f82b42a9160) [ CSSD]2013-05-23 13:28:43.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:28:43.742 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:28:43.742 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 13:28:43.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:43.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:43.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:45.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:46.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:46.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:47.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0200002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:47.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:28:47.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:28:47.831 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:28:47.831 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:47.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0201002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:47.837 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:28:47.837 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:28:48.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:48.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:48.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:48.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:48.095 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:49.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0202002b) incarnation(174631051) [ CSSD]2013-05-23 13:28:50.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:50.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:50.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.859 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 13:28:50.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 13:28:50.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b429e330) skgpid 11260 ospid 11260 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:50.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42c8370) [ CSSD]2013-05-23 13:28:50.862 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42c8370), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:28:50.862 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42c8370), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.862 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7f60 [ CSSD]2013-05-23 13:28:50.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7f60) con(0x7f82b42c7c00) skgpid 11264 ospid 11264 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9760), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9760), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c30 [ CSSD]2013-05-23 13:28:50.866 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c30) con(0x7f82b427c5d0) skgpid 11262 ospid 11262 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:50.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:28:50.869 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:28:50.869 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:28:50.869 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:28:50.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204290 [ CSSD]2013-05-23 13:28:50.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204290) con(0x7f82b42d6a90) skgpid 11258 ospid 11258 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:52.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:52.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:52.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:53.098 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:53.098 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:53.534 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:28:54.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:54.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:54.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:56.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:56.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:56.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:57.297 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:28:57.298 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:28:57.298 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:28:57.298 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207c10) pid(17113) version 11:1:1:4 [ CSSD]2013-05-23 13:28:57.304 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:28:57.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:57.304 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 13:28:57.304 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:57.304 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:28:57.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:28:57.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:28:57.311 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:28:57.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:28:57.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5e20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:28:57.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5e20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:28:57.514 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:28:57.514 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d8a0) skgpid ospid 17113 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:28:58.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:28:58.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:28:58.101 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:28:58.101 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:28:58.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:28:59.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0203002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:00.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:00.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:00.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:02.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:02.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:02.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:03.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0204002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:03.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:29:03.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:29:03.088 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:29:03.088 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:03.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0205002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:03.095 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:29:03.095 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:29:03.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:03.104 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:03.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:04.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:04.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:04.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:06.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:06.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:06.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:07.106 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:07.106 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:29:08.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:08.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:08.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:09.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0206002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:10.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:10.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:10.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:12.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:12.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:12.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:12.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:12.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:12.547 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:29:12.548 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:29:12.549 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:29:12.549 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(17264) version 11:1:1:4 [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:12.555 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:12.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:29:12.563 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:29:12.563 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5e20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:12.563 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5e20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:12.765 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:29:12.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 17264 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:13.576 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:14.098 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:29:14.099 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:29:14.100 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:29:14.100 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b4207c10) pid(17313) version 11:1:1:4 [ CSSD]2013-05-23 13:29:14.219 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 13:29:14.220 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:29:14.220 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 13:29:14.220 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5d20) proc(0x7f82b42cfa20) pid(17323) version 11:1:1:4 [ CSSD]2013-05-23 13:29:14.237 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:29:14.238 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:29:14.242 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 13:29:14.242 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b42b5d20) skgpid ospid 17323 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:14.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:14.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:14.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5310/0x7f82b42cbf40) [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5310 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cbf40 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:14.322 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:29:14.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5310 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:29:14.328 [1199044928] >TRACE: clssgmExitGrock: client 5310 (0x7f82b42cbf40), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:29:14.328 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:29:14.328 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:14.329 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:29:14.329 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42b35f0) skgpid ospid 17313 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:16.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:16.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:16.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:17.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:17.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:18.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:18.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0207002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:18.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:29:18.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:29:18.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:29:18.336 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:18.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0208002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:18.342 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:29:18.342 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:29:18.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:18.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:19.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0209002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:20.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:20.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:20.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:22.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:22.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:22.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:22.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:22.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:23.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:24.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:24.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:24.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:26.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:26.119 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:29:26.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:26.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:26.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:27.802 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:29:27.803 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:29:27.804 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:29:27.804 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(17437) version 11:1:1:4 [ CSSD]2013-05-23 13:29:27.809 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:29:27.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:29:27.809 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:29:27.809 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:27.809 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:29:27.810 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:27.810 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:27.817 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:29:27.817 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:29:27.817 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:27.817 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:28.019 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:29:28.019 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 17437 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:28.413 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:28.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:28.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:29.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020a002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:30.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:30.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:30.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:30.662 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:29:30.663 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:29:30.664 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:29:30.664 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b429e870) pid(17496) version 11:1:1:4 [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e870), client(1/0x7f82b4286810) [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c7c00, requested num -1 [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:30.670 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:30.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 13:29:30.677 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:29:30.677 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:30.677 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:30.879 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:29:30.879 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427c5d0) skgpid ospid 17496 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:31.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:31.122 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:32.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:32.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:32.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:33.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020b002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:33.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:29:33.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:29:33.593 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:29:33.593 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:33.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020c002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:33.600 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:29:33.601 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:29:33.617 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:34.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:34.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:34.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:34.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020d002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:34.682 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:29:34.682 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:29:34.682 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:29:34.682 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:34.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020e002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:34.689 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:29:34.689 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:29:36.125 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:36.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:36.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:36.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:36.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:38.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:38.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:38.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:39.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020f002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:40.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:40.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:40.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:41.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:41.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:42.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:42.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:42.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:43.052 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:29:43.052 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:29:43.053 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:29:43.053 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(17589) version 11:1:1:4 [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e870), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:43.059 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:43.066 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:29:43.066 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:29:43.066 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:43.066 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:43.269 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:29:43.269 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid ospid 17589 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:43.640 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:44.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:44.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:44.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:46.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:46.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:46.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:46.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:46.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:48.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:48.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:48.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:48.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0210002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:48.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:29:48.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:29:48.840 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:29:48.840 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:48.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0211002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:48.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:29:48.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:29:49.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0212002b) incarnation(174631051) [ CSSD]2013-05-23 13:29:50.133 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:50.134 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:29:50.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:50.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:50.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:52.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:52.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:52.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:53.661 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:29:54.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:54.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:54.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:55.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:29:55.136 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:29:56.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:56.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:56.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:58.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:29:58.313 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:29:58.313 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:29:58.313 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(17734) version 11:1:1:4 [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e870), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:29:58.329 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:29:58.336 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:29:58.336 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:29:58.336 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:29:58.336 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:29:58.538 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:29:58.538 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid ospid 17734 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:29:58.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:29:58.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:29:58.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:29:59.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0213002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:00.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:00.140 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:00.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:00.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:00.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:02.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:02.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:02.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:03.683 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:04.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0214002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:04.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:04.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:04.103 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:04.103 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:04.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0215002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:04.109 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:04.109 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:04.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:04.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:04.717 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:30:04.718 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:30:04.718 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:30:04.718 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207c10) pid(18011/18011) version 11:1:1:4 [ CSSD]2013-05-23 13:30:04.735 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 13:30:04.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:30:04.735 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:30:04.735 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:30:04.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:05.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 13:30:05.015 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:30:05.015 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:30:05.015 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:30:05.016 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:30:05.016 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d8a0) skgpid 18011 ospid 18011 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:05.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:05.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:06.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:06.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:06.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:08.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:08.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:08.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:09.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:09.146 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:30:09.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0216002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:10.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:10.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:10.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:12.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:12.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:12.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:13.571 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:30:13.572 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:30:13.573 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:30:13.573 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b4207c10) pid(18078) version 11:1:1:4 [ CSSD]2013-05-23 13:30:13.579 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:13.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:13.579 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:30:13.579 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:13.579 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:30:13.580 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:30:13.580 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:13.586 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:13.586 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:30:13.586 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429eb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:13.586 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429eb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:30:13.706 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:13.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:30:13.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42b35f0) skgpid ospid 18078 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:14.148 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:14.149 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:14.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:14.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:14.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:16.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:30:16.370 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:30:16.370 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:30:16.370 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 13:30:16.374 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42a3c70) skgpid 12499 ospid 12499 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:16.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:16.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:16.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:18.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:18.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:18.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:19.151 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:19.152 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:19.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0217002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:19.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0218002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:19.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:19.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:19.362 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:19.362 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:19.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0219002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:19.369 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:19.369 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:20.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:20.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:20.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:22.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:22.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:23.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:23.726 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:24.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:24.155 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:24.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:24.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:25.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:27.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:27.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:27.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:28.834 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:30:28.835 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:30:28.836 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:30:28.836 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207c10) pid(18230) version 11:1:1:4 [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d4c0, requested num -1 [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:30:28.842 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:28.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:30:28.849 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:30:28.849 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:28.849 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:30:29.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:29.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:29.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:30:29.051 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427c5d0) skgpid ospid 18230 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:29.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:29.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:29.158 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:29.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021a002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:30.924 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:30:30.925 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:30:30.926 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:30:30.926 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429e870) pid(18284) version 11:1:1:4 [ CSSD]2013-05-23 13:30:30.931 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429e870), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:30:30.931 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:30:30.932 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:30:30.932 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:30.932 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:30:30.932 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:30:30.932 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:30.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:30:30.939 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:30:30.939 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:30.939 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:30:31.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:31.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:31.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:31.141 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:30:31.141 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b35f0) skgpid ospid 18284 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:33.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:33.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:33.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:33.749 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:34.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:34.161 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:34.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021b002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:34.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:34.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:34.613 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:34.613 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:34.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021c002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:34.622 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:34.622 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:34.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021d002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:34.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:34.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:34.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:34.946 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:34.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021e002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:34.953 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:34.953 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:35.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:35.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:35.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:37.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:37.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:37.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:39.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:39.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:39.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:39.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:39.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:39.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021f002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:41.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:41.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:41.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:43.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:43.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:43.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:43.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:44.083 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:30:44.084 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:30:44.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:30:44.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(18460) version 11:1:1:4 [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:30:44.090 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:44.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:30:44.098 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:30:44.098 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:44.098 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:30:44.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:44.168 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:44.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:30:44.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 18460 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:30:45.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:45.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:45.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:47.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:47.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:47.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:49.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:49.171 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:49.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:49.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:49.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:49.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0220002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:49.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0221002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:49.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:49.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:49.865 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:49.865 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:49.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0222002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:49.872 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:49.872 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:50.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0223002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:50.834 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:30:50.834 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:30:50.834 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:30:50.834 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:50.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0224002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:50.840 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:30:50.840 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:30:51.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:51.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:51.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:53.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:53.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:53.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:53.791 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:30:54.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:54.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:55.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:55.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:55.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:57.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:57.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:57.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:59.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:30:59.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:30:59.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:30:59.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:30:59.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:30:59.334 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:30:59.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:30:59.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5d20) proc(0x7f82b429e870) pid(18596) version 11:1:1:4 [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429e870), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d4c0, requested num -1 [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:30:59.341 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:30:59.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:30:59.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:30:59.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:30:59.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:30:59.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0225002b) incarnation(174631051) [ CSSD]2013-05-23 13:30:59.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:30:59.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:30:59.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b5d20) skgpid ospid 18596 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:01.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:01.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:01.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:03.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:03.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:03.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:03.812 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:04.181 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:04.181 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:05.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0226002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:05.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:05.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:05.111 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:31:05.111 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:05.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0227002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:05.118 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:05.118 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:05.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:05.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:05.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:07.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0228002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:07.078 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:07.078 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:07.078 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:31:07.078 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:07.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0229002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:07.084 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:07.084 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:07.204 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:31:07.205 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:31:07.207 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:31:07.207 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:31:07.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:07.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:07.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:09.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:09.184 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:09.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:09.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:09.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022a002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:09.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:11.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:11.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:11.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:13.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:13.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:13.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:13.835 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:14.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:14.187 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:14.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:31:14.594 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:31:14.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:31:14.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3c70) proc(0x7f82b4207c10) pid(18768) version 11:1:1:4 [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:31:14.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:14.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:31:14.608 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:31:14.608 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:14.608 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:31:14.811 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:31:14.811 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a3c70) skgpid ospid 18768 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:15.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:15.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:15.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:15.677 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:31:15.678 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:31:15.679 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:31:15.679 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(18817/18817) version 11:1:1:4 [ CSSD]2013-05-23 13:31:15.684 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429e870), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:31:15.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:31:15.684 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:31:15.684 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:31:15.702 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid 18817 ospid 18817 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:17.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:17.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:17.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:19.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:19.191 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:19.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022b002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:19.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:19.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:19.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:20.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022c002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:20.366 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:20.366 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:20.367 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:31:20.367 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:20.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022d002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:20.373 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:20.373 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:20.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b429ecc0) [ CSSD]2013-05-23 13:31:20.887 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b429ecc0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:31:20.887 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b429ecc0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:31:20.887 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 13:31:20.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:31:20.894 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:31:20.894 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:31:20.894 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:31:20.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:31:20.895 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d5be0) skgpid 13342 ospid 13342 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9d40 [ CSSD]2013-05-23 13:31:20.902 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9d40) con(0x7f82b42573d0) skgpid 13334 ospid 13334 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:21.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:21.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:21.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:23.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:23.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:23.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:23.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:24.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:24.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:25.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:25.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:25.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:27.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:27.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:27.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:28.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:28.197 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:31:29.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022e002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:29.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:29.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:29.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:29.854 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:31:29.855 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:31:29.856 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:31:29.856 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5d20) proc(0x7f82b429e870) pid(18919) version 11:1:1:4 [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:31:29.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:29.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:31:29.868 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:31:29.868 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:29.869 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:31:30.071 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:31:30.071 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b5d20) skgpid ospid 18919 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:31.184 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:31:31.185 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:31:31.185 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:31:31.185 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429e870) pid(18972) version 11:1:1:4 [ CSSD]2013-05-23 13:31:31.191 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:31:31.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:31:31.191 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:31:31.191 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:31.191 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:31:31.192 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:31:31.192 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:31.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:31:31.198 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:31:31.198 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:31.198 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:31:31.400 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:31:31.400 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b35f0) skgpid ospid 18972 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:31.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:31.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:31.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:33.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:33.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:33.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:33.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:33.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:33.882 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:35.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022f002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:35.210 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:35.210 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:35.210 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:31:35.210 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:35.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0230002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:35.217 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:35.217 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:35.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:35.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:35.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0231002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:35.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:35.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:35.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:31:35.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:35.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0232002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:35.634 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:35.634 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:35.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:37.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:37.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:37.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:38.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:38.203 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:39.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0233002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:39.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:39.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:39.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:41.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:41.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:41.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:43.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:43.206 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:43.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:43.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:43.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:43.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:45.104 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:31:45.105 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:31:45.106 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:31:45.106 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429e870) pid(19106) version 11:1:1:4 [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:31:45.112 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:45.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:31:45.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:31:45.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:31:45.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:31:45.322 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:31:45.322 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b35f0) skgpid ospid 19106 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:31:45.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:45.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:45.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:47.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:47.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:47.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:48.208 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:48.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:49.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0234002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:49.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:49.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:49.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:50.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0235002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:50.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:31:50.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:31:50.885 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:31:50.885 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:31:50.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0236002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:50.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:31:50.892 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:31:51.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:51.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:51.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:52.211 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:52.211 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:31:53.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:53.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:53.923 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:31:53.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:55.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:55.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:55.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:57.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:31:57.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:31:57.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:57.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:31:58.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:31:59.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0237002b) incarnation(174631051) [ CSSD]2013-05-23 13:31:59.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:31:59.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:00.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:00.355 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:00.356 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:32:00.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:00.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(19246) version 11:1:1:4 [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42b35f0, requested num -1 [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:32:00.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:00.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:32:00.380 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:32:00.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:00.381 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:32:00.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:00.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid ospid 19246 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:00.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0238002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:00.784 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:00.784 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:00.784 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:00.784 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:00.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0239002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:00.791 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:00.791 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:01.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:01.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:02.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:02.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:02.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:03.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:03.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:03.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:04.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:04.759 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:32:04.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:32:04.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:32:04.762 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:32:04.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023a002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:04.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:04.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:04.840 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:32:04.840 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:32:04.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023b002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:04.847 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:04.847 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:05.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:05.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:06.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023c002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:06.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:06.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:06.136 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:06.136 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:06.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023d002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:06.143 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:06.143 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:06.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:07.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:07.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:07.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:07.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:08.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:09.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023e002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:09.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:09.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:10.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:11.421 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:11.421 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:32:11.422 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:11.422 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b429e870) pid(19409) version 11:1:1:4 [ CSSD]2013-05-23 13:32:11.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:11.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:12.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:12.224 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:12.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:13.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:13.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42c6340) skgpid ospid 19409 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:13.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:13.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:13.965 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:14.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:15.616 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:15.616 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:32:15.617 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:15.617 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35f0) proc(0x7f82b429e870) pid(19758) version 11:1:1:4 [ CSSD]2013-05-23 13:32:15.632 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:32:15.633 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:15.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:32:15.640 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:32:15.640 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:15.640 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:32:15.842 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:15.842 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42b35f0) skgpid ospid 19758 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:15.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:15.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:16.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:17.226 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:17.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:17.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:17.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:18.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:19.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023f002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:19.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:19.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:20.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:21.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0240002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:21.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:21.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:21.384 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:21.384 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:21.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0241002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:21.391 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:21.391 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:21.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:21.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:22.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:22.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:22.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:23.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:23.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:23.987 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:24.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:25.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:25.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:26.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:27.233 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:27.233 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:27.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:27.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:28.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:29.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0242002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:29.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:29.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:30.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:30.885 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:30.886 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:32:30.887 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:30.887 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b429e870) pid(19933) version 11:1:1:4 [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:32:30.893 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:30.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:32:30.899 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:32:30.899 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:30.899 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:32:31.102 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:31.102 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427c5d0) skgpid ospid 19933 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:31.445 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:31.445 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:32:31.446 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:31.446 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b429e870) pid(19974) version 11:1:1:4 [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:32:31.452 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:31.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:32:31.459 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:32:31.459 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:31.459 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:32:31.661 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:31.662 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42c6340) skgpid ospid 19974 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:31.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:31.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:32.236 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:32.236 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:32.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:33.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:33.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:34.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:34.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:35.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0243002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:35.472 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:35.472 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:35.472 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:35.473 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:35.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0244002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:35.479 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:35.479 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:35.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:35.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:36.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:36.239 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:32:36.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:36.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0245002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:36.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:36.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:36.652 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:36.652 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:36.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0246002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:36.660 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:36.660 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:38.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:38.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:38.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:39.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0247002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:40.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:40.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:40.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:41.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:41.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:42.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:42.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:42.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:44.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:44.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:44.028 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:44.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:46.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:46.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:46.137 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:32:46.138 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:32:46.138 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:32:46.138 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b429e870) pid(20093) version 11:1:1:4 [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429e870), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:32:46.144 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:46.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 13:32:46.151 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:32:46.151 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:32:46.151 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:32:46.245 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:46.245 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:46.354 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:32:46.354 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b42c6340) skgpid ospid 20093 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:46.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cb000) [ CSSD]2013-05-23 13:32:46.388 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cb000), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:32:46.388 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cb000), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:32:46.388 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 23 [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd8e0 [ CSSD]2013-05-23 13:32:46.394 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd8e0) con(0x7f82b42d5fb0) skgpid 14264 ospid 14264 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:46.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:48.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:48.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:48.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:49.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0248002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:50.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:50.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:50.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:51.248 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:51.248 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:32:51.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0249002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:51.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:32:51.901 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:32:51.901 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:32:51.902 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:32:51.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024a002b) incarnation(174631051) [ CSSD]2013-05-23 13:32:51.908 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:32:51.908 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:32:52.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:52.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:52.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:54.049 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:32:54.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:54.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:54.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:54.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:32:54.822 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:32:54.822 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:32:54.822 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 13:32:54.823 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:32:54.823 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid 16301 ospid 16301 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:32:55.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:32:55.251 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:32:56.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:56.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:56.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:58.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:32:58.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:32:58.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:32:59.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024b002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:00.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:00.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:00.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:00.254 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:00.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:01.386 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:33:01.387 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:33:01.387 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:33:01.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(20265) version 11:1:1:4 [ CSSD]2013-05-23 13:33:01.393 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b429e870), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:33:01.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:33:01.393 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42b5720, requested num -1 [ CSSD]2013-05-23 13:33:01.393 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:01.393 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:33:01.394 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:01.394 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:01.401 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:33:01.401 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:33:01.401 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:01.401 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:01.603 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:33:01.603 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid ospid 20265 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:02.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:02.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:02.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:04.070 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:04.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:04.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:04.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:04.909 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:33:04.910 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:04.910 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:33:04.910 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(20225/20225) version 11:1:1:4 [ CSSD]2013-05-23 13:33:04.916 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:33:04.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:33:04.916 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:33:04.916 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 13:33:05.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:05.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:06.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:06.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:06.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:07.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024c002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:07.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:33:07.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:33:07.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:33:07.150 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:07.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024d002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:07.156 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:33:07.156 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:33:08.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:08.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:08.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:09.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024e002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:10.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:10.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:10.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:10.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:10.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:12.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:12.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:12.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:14.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:14.263 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:14.264 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:33:14.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:14.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:14.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:16.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:16.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:16.637 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:33:16.638 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:33:16.638 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:33:16.638 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42aed80) pid(20409) version 11:1:1:4 [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42aed80), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207f20 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:16.645 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:16.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:33:16.652 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:33:16.652 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:16.652 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:16.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:16.855 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:33:16.855 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42c6340) skgpid ospid 20409 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:18.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:18.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:18.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:19.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:19.267 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:19.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024f002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:20.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:20.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:20.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:22.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:22.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:22.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0250002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:22.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:33:22.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:33:22.408 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:33:22.409 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:22.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0251002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:22.415 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:33:22.415 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:33:22.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:24.111 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:24.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:24.270 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:24.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:24.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:24.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:26.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:26.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:26.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:27.797 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:33:27.798 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:27.799 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:33:27.799 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207a80) proc(0x7f82b42aed80) pid(20523) version 11:1:1:4 [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42aed80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42cd480 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:27.806 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:27.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:33:27.812 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:33:27.812 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c5f40) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:33:27.812 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c5f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:27.920 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:33:27.921 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:27.922 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:33:27.922 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(20528) version 11:1:1:4 [ CSSD]2013-05-23 13:33:27.936 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:33:27.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:33:27.942 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:33:27.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:33:27.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid ospid 20528 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:28.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:33:28.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4207a80) skgpid ospid 20523 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:28.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:28.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:28.933 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:33:28.934 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:28.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:33:28.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4286740) pid(20542/20542) version 11:1:1:4 [ CSSD]2013-05-23 13:33:28.950 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4286740), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:33:28.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:33:28.950 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:33:28.950 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:33:28.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:28.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:33:28.985 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:33:28.985 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:33:28.985 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:33:28.986 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:33:28.986 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b427d8a0) skgpid 20542 ospid 20542 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:29.176 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 13:33:29.177 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:29.177 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 13:33:29.177 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42d9690) pid(20551/20551) version 11:1:1:4 [ CSSD]2013-05-23 13:33:29.193 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42d9690), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:33:29.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:33:29.193 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:33:29.193 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:33:29.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:33:29.237 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:33:29.237 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:33:29.238 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:33:29.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 13:33:29.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b427d8a0) skgpid 20551 ospid 20551 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:29.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:29.273 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:29.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0252002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:30.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:30.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:30.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:31.697 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 13:33:31.698 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:31.698 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 13:33:31.698 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207a80) proc(0x7f82b42d9690) pid(20568) version 11:1:1:4 [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42d9690), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:31.704 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:31.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:33:31.711 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:33:31.711 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:31.711 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:31.887 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8fc0) allocated [ CSSD]2013-05-23 13:33:31.887 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:33:31.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8fc0 - 1,2,3 [ CSSD]2013-05-23 13:33:31.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a8fc0) pid(20578) version 11:1:1:4 [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a8fc0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:31.904 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:31.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:33:31.910 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:33:31.910 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42573d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:31.911 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42573d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:31.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 13:33:31.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b4207a80) skgpid ospid 20568 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:32.113 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8fc0 [ CSSD]2013-05-23 13:33:32.113 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8fc0) con(0x7f82b427c5d0) skgpid ospid 20578 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:32.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:32.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:33.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:33.276 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:33.276 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:33:34.131 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:34.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:34.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:35.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:33:35.379 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid 20225 ospid 20225 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:35.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0253002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:35.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:33:35.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:33:35.726 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:33:35.726 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:35.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0254002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:35.733 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:33:35.734 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:33:36.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:36.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:37.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:37.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0255002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:37.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:33:37.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:33:37.656 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:33:37.656 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:37.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0256002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:37.663 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:33:37.663 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:33:38.279 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:38.279 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:38.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:38.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:39.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:39.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0257002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:40.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:40.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:41.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:41.293 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:33:41.294 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:33:41.294 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:33:41.294 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(20717) version 11:1:1:4 [ CSSD]2013-05-23 13:33:41.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:33:41.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 20717 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:42.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:42.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:43.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:43.282 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:43.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:44.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:44.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:44.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:45.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:46.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:46.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:47.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e870) allocated [ CSSD]2013-05-23 13:33:47.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:33:47.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e870 - 1,2,3 [ CSSD]2013-05-23 13:33:47.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e870) pid(20918) version 11:1:1:4 [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b429e870), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:33:47.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:47.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:33:47.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:33:47.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:33:47.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:33:47.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:47.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e870 [ CSSD]2013-05-23 13:33:47.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e870) con(0x7f82b427d8a0) skgpid ospid 20918 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:48.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:48.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:48.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:48.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:49.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:49.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0258002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:50.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:50.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a9160) [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a9160), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 30 [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 13:33:50.951 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b4257120) skgpid 14948 ospid 14948 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:33:51.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:52.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:52.288 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:33:52.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:52.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:52.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0259002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:52.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:33:52.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:33:52.905 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:33:52.905 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:33:52.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025a002b) incarnation(174631051) [ CSSD]2013-05-23 13:33:52.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:33:52.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:33:53.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:54.173 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:33:54.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:54.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:55.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:56.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:56.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:57.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:57.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:33:57.292 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:33:58.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:33:58.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:33:59.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:33:59.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025b002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:00.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:00.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:01.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:02.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:02.295 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:02.406 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:34:02.407 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:34:02.408 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:34:02.408 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(21067) version 11:1:1:4 [ CSSD]2013-05-23 13:34:02.413 [1199044928] >TRACE: clssgmRegisterClient: proc(61/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:34:02.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:34:02.413 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:34:02.414 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:02.414 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:34:02.414 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:02.414 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:02.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:34:02.420 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:34:02.420 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:02.420 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:02.623 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:34:02.623 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 21067 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:02.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:02.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:03.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:04.194 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:04.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:04.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:05.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:06.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:06.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:07.297 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:07.298 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:07.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:08.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025c002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:08.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:34:08.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:34:08.164 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:34:08.164 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:08.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025d002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:08.172 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:34:08.172 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:34:08.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:08.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:09.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:09.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025e002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:10.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:10.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:11.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:12.301 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:12.301 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:12.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:12.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:13.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:14.215 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:14.405 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:34:14.406 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:34:14.407 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:34:14.407 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(21195) version 11:1:1:4 [ CSSD]2013-05-23 13:34:14.526 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:34:14.528 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:34:14.528 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:34:14.528 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4286740) pid(21205) version 11:1:1:4 [ CSSD]2013-05-23 13:34:14.545 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:34:14.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:34:14.551 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:34:14.551 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42ccc30) skgpid ospid 21205 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:14.628 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5311/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:14.628 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5311 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:14.628 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:34:14.628 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:34:14.628 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:34:14.629 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:14.629 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:34:14.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5311 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:14.634 [1199044928] >TRACE: clssgmExitGrock: client 5311 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:34:14.634 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:34:14.634 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:14.635 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:34:14.635 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 21195 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:14.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:14.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:15.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:16.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:16.304 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:34:16.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:16.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:17.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:17.658 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:34:17.659 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:34:17.660 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:34:17.660 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(21234) version 11:1:1:4 [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmRegisterClient: proc(61/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:17.665 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:17.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:34:17.671 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:34:17.671 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:17.671 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:17.874 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:34:17.874 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 21234 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:18.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:18.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:19.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:19.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025f002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:20.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:20.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:21.306 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:21.307 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:21.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:22.362 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:34:22.363 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:34:22.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:34:22.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(20145/20145) version 11:1:1:4 [ CSSD]2013-05-23 13:34:22.380 [1199044928] >TRACE: clssgmRegisterClient: proc(61/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:34:22.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:34:22.380 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:34:22.380 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 31 [ CSSD]2013-05-23 13:34:22.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:22.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:23.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0260002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:23.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:34:23.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:34:23.414 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:34:23.414 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:23.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0261002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:23.421 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:34:23.421 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:34:23.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:24.236 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:24.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:24.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:25.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:26.310 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:26.310 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:26.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:26.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:27.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:28.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:28.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:29.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:29.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0262002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:31.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:31.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:31.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:31.313 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:31.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:31.957 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:34:31.958 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:34:31.958 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:34:31.958 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42cbe70) pid(21376) version 11:1:1:4 [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42cbe70), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:31.965 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:31.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:34:31.971 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:34:31.971 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:31.971 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:32.174 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:34:32.174 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a5440) skgpid ospid 21376 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:32.906 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:34:32.907 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:34:32.908 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:34:32.908 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42a2930) pid(21391) version 11:1:1:4 [ CSSD]2013-05-23 13:34:32.913 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a2930), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:34:32.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:34:32.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 13:34:32.914 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:32.914 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:34:32.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:32.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:32.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:34:32.920 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:34:32.920 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:32.920 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:33.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:33.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:33.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:34:33.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42a5440) skgpid ospid 21391 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:33.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:34.280 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:35.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:35.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:35.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:35.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0263002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:35.983 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:34:35.983 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:34:35.983 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:34:35.983 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:35.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0264002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:35.990 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:34:35.990 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:34:36.316 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:36.316 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:37.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:37.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:37.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:38.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0265002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:38.661 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:34:38.661 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:34:38.661 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:34:38.661 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:38.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0266002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:38.667 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:34:38.667 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:34:39.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:39.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:39.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:40.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0267002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:41.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:41.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:41.319 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:41.319 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:41.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:43.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:43.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:43.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:44.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:45.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:45.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:45.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:46.322 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:46.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:47.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:47.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:47.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:48.166 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 13:34:48.167 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:34:48.167 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 13:34:48.167 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4207e50) pid(21558) version 11:1:1:4 [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207e50), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:34:48.173 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:48.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:34:48.180 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:34:48.180 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:34:48.180 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:34:48.382 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 13:34:48.382 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b42a5440) skgpid ospid 21558 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:34:49.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:49.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:49.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:50.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0268002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:51.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:51.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:51.326 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:51.326 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:51.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:53.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:53.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:53.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0269002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:53.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:34:53.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:34:53.909 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:34:53.909 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:34:53.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026a002b) incarnation(174631051) [ CSSD]2013-05-23 13:34:53.916 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:34:53.916 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:34:53.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:54.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:34:55.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:55.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:55.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:56.329 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:34:56.329 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:34:57.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:57.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:57.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:34:59.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:34:59.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:34:59.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:00.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026b002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:01.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:01.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:01.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:01.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:01.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:03.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:03.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:03.415 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 13:35:03.416 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:35:03.416 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 13:35:03.416 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b427c510) pid(21702) version 11:1:1:4 [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b427c510), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:35:03.422 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:03.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:35:03.428 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:35:03.428 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:03.428 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:35:03.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 13:35:03.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42c6340) skgpid ospid 21702 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:03.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:04.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:05.167 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:35:05.167 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:35:05.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:35:05.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4286740) pid(21762/21762) version 11:1:1:4 [ CSSD]2013-05-23 13:35:05.184 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4286740), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:35:05.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:35:05.184 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:35:05.184 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 13:35:05.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:05.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:05.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:06.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:06.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:06.444 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:35:06.444 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:35:06.444 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:35:06.444 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 13:35:06.445 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:35:06.445 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a5440) skgpid 21762 ospid 21762 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:07.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:07.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:08.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:09.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026c002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:09.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:35:09.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:35:09.158 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:35:09.158 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:09.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026d002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:09.165 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:35:09.165 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:35:09.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:09.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:10.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:10.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026e002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:11.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:11.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:11.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:11.337 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:12.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:13.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:13.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:14.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:14.367 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:15.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:15.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:16.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:16.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:16.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:17.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:17.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:18.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:18.664 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:35:18.665 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:35:18.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:35:18.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42cbe70) pid(21864) version 11:1:1:4 [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42cbe70), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:35:18.672 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:18.679 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:35:18.679 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:35:18.679 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:18.679 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:35:18.882 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:35:18.882 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a5440) skgpid ospid 21864 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:19.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:19.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:20.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026f002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:20.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:20.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:20.343 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:35:21.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:21.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:22.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:23.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:23.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:24.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:24.388 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:24.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0270002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:24.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:35:24.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:35:24.416 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:35:24.416 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:24.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0271002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:24.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:35:24.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:35:25.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:25.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:25.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:25.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:26.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:27.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:27.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:28.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:29.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:29.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:30.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0272002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:30.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:30.349 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:30.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:31.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:31.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:32.215 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:35:32.216 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:35:32.217 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:35:32.217 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207c10) pid(22017) version 11:1:1:4 [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207c10), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:35:32.234 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:32.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:35:32.243 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:35:32.243 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:32.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:35:32.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:32.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:35:32.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4257120) skgpid ospid 22017 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:33.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:33.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:33.919 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:35:33.920 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:35:33.920 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:35:33.920 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(22038) version 11:1:1:4 [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a2930), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:35:33.926 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:35:33.927 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:33.934 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:35:33.934 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:35:33.934 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:33.934 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:35:34.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:35:34.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 22038 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:34.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:34.471 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:35.352 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:35.352 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:35.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:35.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:36.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0273002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:36.246 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:35:36.246 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:35:36.246 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:35:36.246 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:36.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0274002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:36.253 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:35:36.253 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:35:36.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:37.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:37.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:38.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:39.355 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:39.355 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:35:39.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:39.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:39.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0275002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:39.665 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:35:39.665 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:35:39.665 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:35:39.665 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:39.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0276002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:39.672 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:35:39.672 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:35:40.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0277002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:40.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:41.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:41.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:42.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:43.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:43.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:44.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:44.358 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:44.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:44.491 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:45.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:45.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:46.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:47.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:47.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:48.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:49.170 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 13:35:49.170 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:35:49.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 13:35:49.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42d9690) pid(22209) version 11:1:1:4 [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42d9690), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:35:49.177 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:49.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:35:49.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:35:49.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:35:49.184 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:35:49.361 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:49.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:49.386 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 13:35:49.386 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42a5440) skgpid ospid 22209 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:35:49.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:49.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:50.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0278002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:50.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:51.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:51.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:52.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:53.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:53.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:54.365 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:54.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:54.512 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:35:54.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:54.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0279002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:54.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:35:54.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:35:54.913 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:35:54.913 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:35:54.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027a002b) incarnation(174631051) [ CSSD]2013-05-23 13:35:54.920 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:35:54.920 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:35:55.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:55.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:56.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:57.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:57.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:35:58.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:35:59.367 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:35:59.368 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:35:59.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:35:59.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:00.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027b002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:00.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:01.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:01.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:02.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:03.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:03.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:04.370 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:04.370 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:04.420 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:36:04.421 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:36:04.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:36:04.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(22356) version 11:1:1:4 [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42cbe70), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:36:04.428 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:04.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:36:04.435 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:36:04.435 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:04.435 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:36:04.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:04.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:04.637 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:36:04.637 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid ospid 22356 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:05.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:05.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:06.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:07.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027c002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:07.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:07.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:07.371 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:36:07.371 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:07.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027d002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:07.378 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:07.378 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:07.514 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:36:07.514 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:36:07.516 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:36:07.516 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:36:07.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:07.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:08.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:09.373 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:09.373 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:09.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:09.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:10.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027e002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:10.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:10.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:10.159 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:36:10.159 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:10.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027f002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:10.166 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:10.166 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:10.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0280002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:10.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:11.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:11.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:12.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:13.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:13.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:14.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:14.377 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:14.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:14.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:15.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:15.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:16.122 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:36:16.123 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:36:16.123 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:36:16.123 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42aed80) pid(22473/22473) version 11:1:1:4 [ CSSD]2013-05-23 13:36:16.140 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42aed80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:36:16.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:36:16.140 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:36:16.140 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 13:36:16.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:36:16.156 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:36:16.156 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:36:16.156 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 13:36:16.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:36:16.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42c6340) skgpid 22473 ospid 22473 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:16.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:17.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:17.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:18.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:19.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:19.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:19.687 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:36:19.688 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:36:19.688 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:36:19.688 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42a2930) pid(22501) version 11:1:1:4 [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a2930), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:36:19.695 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:19.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:36:19.702 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:36:19.702 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:19.702 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:36:19.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:19.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:19.905 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:36:19.905 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42a5440) skgpid ospid 22501 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:20.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0281002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:20.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:21.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:21.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:22.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:23.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:23.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:36:23.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:23.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:24.576 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:24.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:25.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0282002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:25.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:25.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:25.414 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:36:25.414 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:25.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0283002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:25.420 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:25.420 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:25.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:25.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:26.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:27.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:27.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:28.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:28.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:28.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:30.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:30.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:30.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0284002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:30.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:32.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:32.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:32.487 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 13:36:32.488 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:36:32.489 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 13:36:32.489 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207e50) pid(22641) version 11:1:1:4 [ CSSD]2013-05-23 13:36:32.495 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207e50), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:36:32.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:36:32.495 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:36:32.495 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:32.495 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:36:32.496 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:36:32.496 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:32.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:36:32.502 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:36:32.502 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:32.502 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:36:32.705 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 13:36:32.705 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b4257120) skgpid ospid 22641 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:32.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:33.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:33.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:34.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:34.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:34.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:34.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:34.938 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 13:36:34.939 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:36:34.939 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 13:36:34.939 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b427c510) pid(22670) version 11:1:1:4 [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b427c510), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:36:34.946 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:34.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:36:34.954 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:36:34.954 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:34.954 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:36:35.156 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 13:36:35.156 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42a5440) skgpid ospid 22670 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:36.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:36.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:36.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0285002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:36.502 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:36.502 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:36.502 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:36:36.502 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:36.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0286002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:36.509 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:36.509 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:36.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:38.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:38.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:38.391 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:38.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:38.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:40.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:40.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:40.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0287002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:40.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0288002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:40.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:40.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:40.660 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:36:40.661 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:40.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0289002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:40.667 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:40.667 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:40.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:42.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:42.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:42.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:43.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:43.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:44.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:44.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:44.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:44.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:46.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:46.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:46.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:48.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:48.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:48.398 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:48.398 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:48.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:50.195 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:36:50.196 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:36:50.196 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:36:50.196 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42cbe70) pid(22828) version 11:1:1:4 [ CSSD]2013-05-23 13:36:50.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:50.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:50.203 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42cbe70), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:36:50.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:36:50.203 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 13:36:50.203 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:50.203 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:36:50.204 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:36:50.204 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:50.211 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:36:50.211 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:36:50.211 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:36:50.211 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:36:50.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028a002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:50.413 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:36:50.413 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a5440) skgpid ospid 22828 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:36:50.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:52.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:52.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:52.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:53.401 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:53.401 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:54.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:54.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:54.653 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:36:54.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:55.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028b002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:55.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:36:55.909 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:36:55.909 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:36:55.910 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:36:55.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028c002b) incarnation(174631051) [ CSSD]2013-05-23 13:36:55.916 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:36:55.916 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:36:56.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:56.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:56.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:36:58.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:36:58.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:36:58.404 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:36:58.404 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:36:58.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:00.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:00.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:00.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028d002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:00.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:02.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:02.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:02.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:03.407 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:03.407 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:04.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:04.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:04.675 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:05.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:05.072 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:37:05.073 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:37:05.074 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:37:05.075 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:37:05.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028e002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:05.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:05.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:05.153 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:37:05.153 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:37:05.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028f002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:05.159 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:05.159 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:05.456 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:37:05.457 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:37:05.457 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:37:05.457 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42aed80) pid(22977) version 11:1:1:4 [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42aed80), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:05.464 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:05.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:05.471 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:05.471 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:05.471 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:05.673 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:37:05.673 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4257120) skgpid ospid 22977 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:06.377 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:37:06.378 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:37:06.379 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:37:06.379 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4286740) pid(23024) version 11:1:1:4 [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4286740), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:06.385 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:06.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:37:06.392 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:06.392 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:06.392 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:06.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:06.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:06.594 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:37:06.594 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b4257120) skgpid ospid 23024 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:07.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:07.409 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:07.409 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:37:08.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:08.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:09.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:10.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0290002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:10.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:10.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:10.962 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 13:37:10.963 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:37:10.963 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 13:37:10.963 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b427c510) pid(23104) version 11:1:1:4 [ CSSD]2013-05-23 13:37:11.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:11.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0291002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:11.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:11.161 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:11.161 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:37:11.161 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:11.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0292002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:11.168 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:11.168 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:12.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:12.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:12.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:12.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:13.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:13.596 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 13:37:13.596 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42c6340) skgpid ospid 23104 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:14.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:14.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:14.697 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:15.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:16.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:16.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:17.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:17.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:17.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:18.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:18.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:19.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:20.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0293002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:20.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:20.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:20.706 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:37:20.707 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:37:20.708 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:37:20.708 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(23475) version 11:1:1:4 [ CSSD]2013-05-23 13:37:20.724 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a2930), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:37:20.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:37:20.724 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:37:20.724 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:20.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:20.725 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:20.725 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:20.732 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:37:20.732 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:20.732 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:20.733 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:20.935 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:37:20.935 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 23475 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:21.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:22.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:22.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:22.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:22.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:23.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:24.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:24.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:24.720 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:25.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:26.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0294002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:26.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:26.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:26.416 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:37:26.417 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:26.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0295002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:26.424 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:26.424 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:26.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:26.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:27.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:27.422 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:27.422 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:28.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:28.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:29.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:30.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0296002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:30.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:30.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:31.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:32.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:32.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:32.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:32.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:32.748 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 13:37:32.749 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:37:32.749 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 13:37:32.749 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207e50) pid(23598) version 11:1:1:4 [ CSSD]2013-05-23 13:37:32.756 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207e50), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:37:32.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:37:32.756 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:37:32.756 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:32.756 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:32.757 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:32.757 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:32.763 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:37:32.763 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:32.763 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:32.763 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:32.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 13:37:32.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b4257120) skgpid ospid 23598 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:33.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:34.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:34.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:34.742 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:35.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:35.857 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 13:37:35.858 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:37:35.859 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 13:37:35.859 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4286740) pid(23631) version 11:1:1:4 [ CSSD]2013-05-23 13:37:35.875 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4286740), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:35.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:35.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:37:35.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:35.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:35.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:35.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:35.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:37:35.883 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:35.883 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:35.883 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:35.968 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 13:37:35.969 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:37:35.970 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 13:37:35.970 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42583a0) pid(23638) version 11:1:1:4 [ CSSD]2013-05-23 13:37:35.975 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42583a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:37:35.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:37:35.975 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:37:35.975 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:35.975 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:35.976 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:35.976 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:35.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:37:35.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:35.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:35.982 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:36.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 13:37:36.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a5440) skgpid ospid 23631 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:36.184 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 13:37:36.184 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427c5d0) skgpid ospid 23638 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:36.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:36.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:36.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0297002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:36.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:36.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:36.767 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:37:36.767 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:36.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0298002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:36.774 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:36.774 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:37.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:37.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:37.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:38.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:38.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:39.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:40.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0299002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:40.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:40.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:41.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:41.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029a002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:41.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:41.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:41.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:37:41.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:41.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029b002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:41.673 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:41.673 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:42.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:42.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:42.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:42.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:43.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:44.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:44.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:44.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:45.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:46.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:46.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:47.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:47.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:47.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:48.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:48.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:49.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:50.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029c002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:50.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:50.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:51.216 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 13:37:51.217 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:37:51.218 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 13:37:51.218 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d9690) pid(23799) version 11:1:1:4 [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42d9690), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:37:51.224 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:51.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:37:51.231 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:37:51.231 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:37:51.231 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:37:51.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 13:37:51.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42c6340) skgpid ospid 23799 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:37:51.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:52.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:52.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:52.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:52.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:53.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:54.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:37:54.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:54.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:55.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:56.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:56.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:56.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029d002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:56.915 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:37:56.915 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:37:56.915 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:37:56.916 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:37:56.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029e002b) incarnation(174631051) [ CSSD]2013-05-23 13:37:56.923 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:37:56.923 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:37:57.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:37:57.442 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:37:57.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:37:58.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:37:58.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:37:59.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:00.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029f002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:00.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:00.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:01.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:02.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:02.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:02.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:02.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:03.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:04.805 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:04.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:04.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:05.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:06.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:06.448 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:38:06.482 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:38:06.483 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:38:06.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:38:06.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42cbe70) pid(23942) version 11:1:1:4 [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42cbe70), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4207f10, requested num -1 [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:06.501 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:06.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:06.508 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:38:06.508 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:06.508 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:06.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:38:06.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a5440) skgpid ospid 23942 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:06.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:06.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:07.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:08.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:08.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:09.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:10.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a0002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:10.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:10.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:11.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:11.451 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:11.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:12.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a1002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:12.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:38:12.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:38:12.165 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:38:12.165 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:12.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a2002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:12.173 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:38:12.173 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:38:12.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:12.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:13.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:14.830 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:14.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:14.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:15.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:16.454 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:16.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:16.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:16.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:17.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:18.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:18.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:19.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:20.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a3002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:20.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:20.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:21.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:21.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:21.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:21.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:38:21.743 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:38:21.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:38:21.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42a2930) pid(24082) version 11:1:1:4 [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42a2930), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:21.761 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:21.769 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:38:21.769 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:38:21.769 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:21.769 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:21.972 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:38:21.972 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42a5440) skgpid ospid 24082 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:22.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:22.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:23.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:24.851 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:25.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:25.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:25.461 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:25.461 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:38:25.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:27.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:27.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:27.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a4002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:27.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:38:27.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:38:27.420 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:38:27.420 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:27.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a5002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:27.427 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:38:27.427 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:38:27.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:28.093 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 13:38:28.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:28.095 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 13:38:28.095 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4207c10) pid(24194) version 11:1:1:4 [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41ff1f0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:28.113 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:28.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:38:28.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:38:28.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:38:28.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:28.227 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:38:28.227 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:28.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:38:28.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42c5f40) pid(24199) version 11:1:1:4 [ CSSD]2013-05-23 13:38:28.255 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:38:28.257 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:38:28.258 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:38:28.260 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:38:28.260 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b427c5d0) skgpid ospid 24199 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:28.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 13:38:28.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a5440) skgpid ospid 24194 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:29.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:29.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:29.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:30.464 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:30.464 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:30.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a6002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:31.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:31.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:31.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:33.006 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 13:38:33.007 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:33.008 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 13:38:33.008 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b4207e50) pid(24233) version 11:1:1:4 [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207e50), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:33.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:33.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:33.022 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:38:33.022 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:33.022 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:33.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:33.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:33.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 13:38:33.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b42a5440) skgpid ospid 24233 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:33.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:34.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:35.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:35.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:35.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:35.468 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:35.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:37.007 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 13:38:37.008 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:38:37.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 13:38:37.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b427c510) pid(24271) version 11:1:1:4 [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b427c510), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:37.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:37.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a7002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:37.021 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:38:37.021 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:38:37.021 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:38:37.021 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:37.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:38:37.021 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:38:37.021 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:37.021 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:37.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a8002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:37.027 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:38:37.027 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:38:37.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:37.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:37.223 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 13:38:37.223 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42a5440) skgpid ospid 24271 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:37.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:39.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:39.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:39.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:40.420 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 13:38:40.421 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:40.422 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 13:38:40.422 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42aed80) pid(24341/24341) version 11:1:1:4 [ CSSD]2013-05-23 13:38:40.428 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b42aed80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:38:40.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:38:40.428 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:38:40.428 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 13:38:40.443 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42c6340) skgpid 24341 ospid 24341 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:40.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:40.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:40.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a9002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:40.757 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:38:40.758 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:40.758 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:38:40.758 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42cbe70) pid(24357) version 11:1:1:4 [ CSSD]2013-05-23 13:38:40.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:38:40.782 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:38:40.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:38:40.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42833d0) pid(24385/24385) version 11:1:1:4 [ CSSD]2013-05-23 13:38:40.788 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42833d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:38:40.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:38:40.788 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:38:40.788 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 13:38:41.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:41.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:41.310 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:38:41.310 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b4257120) skgpid ospid 24357 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:41.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:42.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02aa002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:42.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:38:42.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:38:42.670 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:38:42.670 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:42.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ab002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:42.677 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:38:42.677 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:38:43.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:43.199 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:43.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:44.473 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:44.473 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:38:44.893 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:45.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:45.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:45.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:47.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:47.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:47.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:49.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:49.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:49.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:49.476 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:49.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:50.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ac002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:51.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:51.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:51.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:52.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:38:52.258 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:38:52.259 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:38:52.259 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a2930) pid(24601) version 11:1:1:4 [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a2930), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:38:52.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:52.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:38:52.271 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:38:52.271 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:38:52.272 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:38:52.474 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:38:52.474 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42c6340) skgpid ospid 24601 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:38:53.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:53.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:53.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:54.479 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:54.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:54.914 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:38:55.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:55.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:55.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:57.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:57.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:57.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ad002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:57.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:38:57.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:38:57.931 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:38:57.931 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:38:57.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ae002b) incarnation(174631051) [ CSSD]2013-05-23 13:38:57.938 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:38:57.938 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:38:57.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:38:59.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:38:59.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:38:59.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:38:59.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:38:59.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:00.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02af002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:01.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:01.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:01.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:03.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:03.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:04.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:04.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:04.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:04.935 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:05.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:05.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:06.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:07.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:07.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:07.507 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 13:39:07.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:39:07.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 13:39:07.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42cbe70) pid(24772) version 11:1:1:4 [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42cbe70), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:07.515 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:07.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 13:39:07.521 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:39:07.521 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:07.521 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:07.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 13:39:07.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42be650) skgpid ospid 24772 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:08.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:09.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:09.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:09.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:09.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:10.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:10.854 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 13:39:10.855 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:39:10.856 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 13:39:10.856 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a2930) pid(24587/24587) version 11:1:1:4 [ CSSD]2013-05-23 13:39:10.873 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a2930), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:39:10.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:39:10.873 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:39:10.873 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:39:11.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b0002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:11.371 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a2930), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 13:39:11.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:39:11.371 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:39:11.371 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 24 [ CSSD]2013-05-23 13:39:11.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:11.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:12.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:13.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b1002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:13.181 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:39:13.181 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:39:13.181 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:39:13.181 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:13.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b2002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:13.187 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:39:13.187 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:39:13.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:13.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:14.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:14.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:14.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:14.716 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 13:39:14.717 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:39:14.718 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 13:39:14.718 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42cf950) pid(24865) version 11:1:1:4 [ CSSD]2013-05-23 13:39:14.836 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 13:39:14.837 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:39:14.838 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 13:39:14.838 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429e6d0) pid(24875) version 11:1:1:4 [ CSSD]2013-05-23 13:39:14.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:39:14.858 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:39:14.861 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 13:39:14.861 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42a9150) skgpid ospid 24875 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5312/0x7f82b42adc50) [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5312 (0x7f82b42adc50) [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42adc50 with con 0x7f82b429e8f0, requested num -1 [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:14.939 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:39:14.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5312 (0x7f82b42adc50) [ CSSD]2013-05-23 13:39:14.945 [1199044928] >TRACE: clssgmExitGrock: client 5312 (0x7f82b42adc50), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:39:14.945 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59e0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:39:14.945 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b59e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:14.946 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 13:39:14.946 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b42a3f90) skgpid ospid 24865 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:14.956 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:15.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:15.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:16.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:17.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:17.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:18.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:19.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:19.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:19.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:19.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:20.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:21.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b3002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:21.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:21.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:22.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:22.758 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 13:39:22.759 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:39:22.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 13:39:22.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429dfe0) pid(24939) version 11:1:1:4 [ CSSD]2013-05-23 13:39:22.766 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429dfe0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:39:22.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:39:22.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 13:39:22.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:22.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:39:22.767 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:22.767 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:22.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:39:22.774 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:39:22.774 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:22.774 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:22.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 13:39:22.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b4257120) skgpid ospid 24939 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:23.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:23.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:24.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:24.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:24.498 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:24.995 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:25.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:25.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:26.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:27.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:27.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:28.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:28.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b4002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:28.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:39:28.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:39:28.429 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:39:28.429 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:28.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b5002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:28.436 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:39:28.436 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:39:28.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:28.501 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:39:29.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:29.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:30.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:31.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b6002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:31.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:31.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:32.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:33.271 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 13:39:33.272 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:39:33.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 13:39:33.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42cf950) pid(25047) version 11:1:1:4 [ CSSD]2013-05-23 13:39:33.289 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42cf950), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 13:39:33.289 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:39:33.289 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 13:39:33.289 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:33.289 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:39:33.290 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:33.290 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:33.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:39:33.296 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:39:33.296 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:33.296 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:33.499 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 13:39:33.499 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b4257120) skgpid ospid 25047 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:33.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:33.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:33.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:33.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:34.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:35.019 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:35.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:35.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:36.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:36.894 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 13:39:36.895 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:39:36.895 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 13:39:36.895 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b429dfe0) pid(23767/23767) version 11:1:1:4 [ CSSD]2013-05-23 13:39:36.912 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429dfe0), client(1/0x7f82b4207f20) [ CSSD]2013-05-23 13:39:36.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:39:36.912 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:39:36.912 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:39:37.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b7002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:37.321 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:39:37.321 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:39:37.321 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:39:37.321 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:37.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b8002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:37.330 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:39:37.330 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:39:37.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:37.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:38.012 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 13:39:38.013 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:39:38.014 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 13:39:38.014 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429e6d0) pid(25091) version 11:1:1:4 [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b429e8f0, requested num -1 [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:38.020 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:38.027 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 13:39:38.027 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:39:38.027 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:38.027 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:38.229 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 13:39:38.229 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b4257120) skgpid ospid 25091 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:38.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:38.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:38.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:39.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:39.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:40.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:41.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b9002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:41.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:41.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:42.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:43.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:43.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:43.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ba002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:43.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:39:43.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:39:43.683 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:39:43.683 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:43.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bb002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:43.690 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:39:43.690 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:39:43.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:43.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:44.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:45.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:45.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:45.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:46.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:47.513 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:47.513 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:39:47.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:47.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:48.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:49.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:49.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:50.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:51.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bc002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:51.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:51.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:52.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:52.516 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:52.516 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:53.273 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:39:53.274 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:39:53.275 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:39:53.275 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc50) proc(0x7f82b429e400) pid(25249) version 11:1:1:4 [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:39:53.291 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:53.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 13:39:53.298 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:39:53.298 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:39:53.298 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:39:53.500 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:39:53.500 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b429dc50) skgpid ospid 25249 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:39:53.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:53.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:54.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:55.064 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:39:55.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:55.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:56.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:57.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:39:57.520 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:39:57.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:57.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:39:58.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:39:58.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02bd002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:58.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:39:58.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:39:58.932 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:39:58.932 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:39:58.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02be002b) incarnation(174631051) [ CSSD]2013-05-23 13:39:58.938 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:39:58.939 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:39:59.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:39:59.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:00.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:01.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bf002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:01.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:01.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:02.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:02.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:02.523 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:03.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:03.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:04.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:04.684 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e7a0) allocated [ CSSD]2013-05-23 13:40:04.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:40:04.685 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e7a0 - 1,2,3 [ CSSD]2013-05-23 13:40:04.685 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc70) proc(0x7f82b429e7a0) pid(25567/25567) version 11:1:1:4 [ CSSD]2013-05-23 13:40:04.701 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e7a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:40:04.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:40:04.701 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:40:04.701 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:40:05.085 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e7a0 [ CSSD]2013-05-23 13:40:05.161 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e7a0) con(0x7f82b429dc70) skgpid 25567 ospid 25567 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:05.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:05.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:06.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:06.526 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:06.526 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:40:07.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:07.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:08.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:08.543 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 13:40:08.544 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:40:08.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 13:40:08.545 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dc70) proc(0x7f82b429e400) pid(25595) version 11:1:1:4 [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e400), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:40:08.562 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:08.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 13:40:08.568 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:40:08.568 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:08.568 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:40:08.770 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 13:40:08.770 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b429dc70) skgpid ospid 25595 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:09.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:09.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:10.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:11.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c0002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:11.530 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:11.530 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:11.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:11.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:12.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:13.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:13.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:14.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c1002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:14.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:14.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:14.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:14.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:14.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c2002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:14.200 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:14.200 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:40:14.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:15.107 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:15.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:15.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:40:16.492 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 20145 ospid 20145 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:16.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:16.534 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:16.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:17.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:17.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:18.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:19.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:19.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:20.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:21.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c3002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:21.538 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:21.538 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:21.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:21.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:22.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:23.803 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:40:23.804 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:40:23.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:40:23.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(25737) version 11:1:1:4 [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:40:23.812 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:23.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:40:23.818 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:40:23.818 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:23.818 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:40:23.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:23.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:24.021 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:40:24.021 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 25737 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:24.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:25.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:25.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:25.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:26.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:26.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:26.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:28.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:28.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:28.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:29.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c4002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:29.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:29.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:29.443 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:29.443 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:29.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c5002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:29.451 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:29.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:40:30.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:30.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:30.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:31.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c6002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:31.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:31.545 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:32.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:32.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:32.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:33.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:40:33.545 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:40:33.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:40:33.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(25852) version 11:1:1:4 [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:40:33.552 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:33.558 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:40:33.558 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:40:33.558 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:33.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:40:33.761 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:40:33.761 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 25852 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:34.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:34.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:34.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:35.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:36.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:36.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:36.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:36.549 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:36.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:36.693 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:40:36.693 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:40:36.693 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:40:36.693 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:40:36.694 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:40:36.694 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b427c5d0) skgpid 24385 ospid 24385 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:37.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c7002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:37.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:37.584 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:37.584 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:37.584 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:37.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c8002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:37.591 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:37.591 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:40:38.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:38.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:38.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:39.054 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:40:39.055 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:40:39.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:40:39.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207a80) pid(25901) version 11:1:1:4 [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:40:39.062 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:39.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 13:40:39.069 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:40:39.069 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:39.069 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:40:39.272 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:40:39.272 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427c5d0) skgpid ospid 25901 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:40.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:40.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:40.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:40.552 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:40:40.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:41.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c9002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:42.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:42.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:42.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:44.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:44.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:44.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ca002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:44.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:44.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:44.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:44.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:44.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cb002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:44.701 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:44.701 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:40:44.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:45.179 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:45.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:45.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:46.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:46.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:46.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:48.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:48.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:48.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:50.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:50.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:50.560 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:50.560 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:50.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:51.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cc002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:51.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:51.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:51.175 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:51.175 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:51.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cd002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:51.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:51.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:40:51.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ce002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:52.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:52.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:52.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:54.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:54.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:54.305 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:40:54.306 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:40:54.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:40:54.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207a80) pid(26062) version 11:1:1:4 [ CSSD]2013-05-23 13:40:54.312 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:40:54.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:40:54.312 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:40:54.312 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:54.312 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:40:54.313 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:40:54.313 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:54.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:40:54.320 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:40:54.320 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:40:54.320 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:40:54.522 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:40:54.522 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427c5d0) skgpid ospid 26062 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:40:54.563 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:54.563 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:40:54.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:55.203 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:40:56.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:56.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:56.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:58.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:40:58.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:40:58.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:40:59.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:40:59.566 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:40:59.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cf002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:59.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:40:59.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:40:59.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:40:59.947 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:40:59.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d0002b) incarnation(174631051) [ CSSD]2013-05-23 13:40:59.954 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:40:59.954 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:00.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:00.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:00.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:01.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d1002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:02.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:02.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:02.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:04.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:04.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:04.569 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:04.569 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:04.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:05.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:06.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:06.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:06.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:07.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d2002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:07.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:41:07.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:41:07.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:41:07.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:07.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d3002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:07.675 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:41:07.675 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:07.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:41:07.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:41:07.807 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:41:07.808 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:41:08.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:08.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:09.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:09.556 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:41:09.557 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:41:09.558 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:41:09.558 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(26200) version 11:1:1:4 [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:41:09.564 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:09.571 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:41:09.571 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:41:09.571 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:09.571 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:41:09.572 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:09.572 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:09.774 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:41:09.774 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 26200 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:10.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:10.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:11.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:11.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d4002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:12.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:12.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:13.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:14.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:14.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:14.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:14.576 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:15.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:15.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d5002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:15.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:41:15.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:41:15.199 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:41:15.199 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:15.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d6002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:15.208 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:41:15.208 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:15.248 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:15.571 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:41:15.571 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:41:15.572 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:41:15.572 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207a80) pid(26285/26285) version 11:1:1:4 [ CSSD]2013-05-23 13:41:15.578 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 13:41:15.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:41:15.579 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:41:15.579 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:41:15.597 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427c5d0) skgpid 26285 ospid 26285 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:16.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:16.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:17.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:18.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:18.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:19.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:19.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:19.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:20.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:20.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:21.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:21.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d7002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:22.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:22.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:23.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:24.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:24.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:24.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:24.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:24.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:41:24.807 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:41:24.808 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:41:24.808 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b4207a80) pid(26361) version 11:1:1:4 [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:41:24.815 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:24.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 13:41:24.822 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:41:24.822 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:24.822 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:41:25.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:41:25.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427c5d0) skgpid ospid 26361 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:25.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:25.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:26.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:26.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:27.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:28.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:28.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:29.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:29.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:29.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:30.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d8002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:30.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:41:30.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:41:30.462 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:41:30.462 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:30.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d9002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:30.469 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:41:30.469 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:30.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:30.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:31.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:31.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02da002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:32.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:32.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:33.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:41:33.121 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:41:33.121 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:41:33.121 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(22558/22558) version 11:1:1:4 [ CSSD]2013-05-23 13:41:33.139 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 13:41:33.139 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:41:33.139 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:41:33.139 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:41:33.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:33.812 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 13:41:33.813 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:41:33.814 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 13:41:33.814 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42c5f40) pid(26481) version 11:1:1:4 [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b4204870) [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:41:33.821 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:33.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 13:41:33.830 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:41:33.830 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:33.830 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:41:34.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 13:41:34.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b427d8a0) skgpid ospid 26481 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:34.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:34.589 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:34.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:34.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:35.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:35.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:36.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:36.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:37.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:37.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02db002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:37.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:41:37.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:41:37.843 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:41:37.843 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:37.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02dc002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:37.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:41:37.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:38.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:38.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:39.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:39.592 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:39.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:40.066 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 13:41:40.067 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:41:40.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 13:41:40.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42833d0) pid(26531) version 11:1:1:4 [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:41:40.074 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:40.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 13:41:40.080 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:41:40.080 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:40.080 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:41:40.283 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 13:41:40.283 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b427c5d0) skgpid ospid 26531 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:40.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:40.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:41.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:41.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02dd002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:42.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:42.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:43.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:44.093 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 13:41:44.093 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:41:44.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 13:41:44.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42583a0) pid(25693/25693) version 11:1:1:4 [ CSSD]2013-05-23 13:41:44.110 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 13:41:44.110 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:41:44.110 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:41:44.110 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:41:44.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:44.595 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:44.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:44.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:45.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:45.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:45.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02de002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:45.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:41:45.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:41:45.714 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:41:45.714 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:45.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02df002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:45.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:41:45.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:41:46.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:46.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:47.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:48.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:48.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:49.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:49.598 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:49.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:50.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:50.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:51.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:51.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e0002b) incarnation(174631051) [ CSSD]2013-05-23 13:41:52.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:52.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:53.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:54.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:54.601 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:41:54.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:54.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:55.316 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 13:41:55.317 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:41:55.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 13:41:55.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(26706) version 11:1:1:4 [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x266f0d0), client(1/0x268c680) [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268c680) [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268c680 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26eef20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:41:55.334 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:41:55.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268c680) [ CSSD]2013-05-23 13:41:55.341 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268c680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:41:55.341 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eeb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:41:55.341 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eeb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:41:55.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:41:55.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:55.544 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 13:41:55.544 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid ospid 26706 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:41:56.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:56.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:57.000 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 13:41:57.001 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:41:57.001 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 13:41:57.001 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(26332/26332) version 11:1:1:4 [ CSSD]2013-05-23 13:41:57.007 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 13:41:57.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 13:41:57.007 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:41:57.007 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:41:57.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:41:57.530 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(2/0x26e4d00) [ CSSD]2013-05-23 13:41:57.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26e4d00) [ CSSD]2013-05-23 13:41:57.530 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:41:57.530 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 13:41:57.710 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(2/0x26ef150) [ CSSD]2013-05-23 13:41:57.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef150) [ CSSD]2013-05-23 13:41:57.710 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:41:57.710 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:41:57.747 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x266f0d0), client(2/0x26ef0a0) [ CSSD]2013-05-23 13:41:57.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 13:41:57.747 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:41:57.747 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 13:41:58.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:41:58.603 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:41:58.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:41:58.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:41:59.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:00.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:00.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:00.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e1002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:00.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:00.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:00.965 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:00.965 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:00.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e2002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:00.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:00.973 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:01.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e3002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:01.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:01.136 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:01.136 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:01.136 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:01.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e4002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:01.144 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:01.144 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:01.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:01.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e5002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:02.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:02.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:03.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:03.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:03.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:04.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:04.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:05.380 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:05.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:42:05.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:42:05.395 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:42:05.395 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:42:05.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e6002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:05.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:05.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:05.475 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d920/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:42:05.475 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:42:05.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e7002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:05.482 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:05.482 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:05.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:07.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:07.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:07.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:08.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:08.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:09.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:09.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:09.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:10.586 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:10.587 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:42:10.588 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:10.588 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2691370) proc(0x2659ac0) pid(26872) version 11:1:1:4 [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:42:10.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:10.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:10.613 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:42:10.613 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:10.613 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:42:10.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:10.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x2691370) skgpid ospid 26872 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:11.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:11.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:11.365 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:11.365 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:42:11.366 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:11.366 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c1a0) proc(0x2659ac0) pid(26941) version 11:1:1:4 [ CSSD]2013-05-23 13:42:11.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:11.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e8002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:13.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:13.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:13.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:13.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:13.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:14.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:14.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x268c1a0) skgpid ospid 26941 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:15.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:15.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:15.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:15.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:16.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e9002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:16.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:16.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:16.224 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:16.224 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:16.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ea002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:16.231 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:16.231 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:17.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:17.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:17.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:18.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:18.615 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:19.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:19.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:19.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:21.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:21.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:21.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:21.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02eb002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:22.617 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:22.617 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:42:23.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:23.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:23.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:25.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:25.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:25.426 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:25.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:25.850 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:25.850 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:42:25.851 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:25.851 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27345) version 11:1:1:4 [ CSSD]2013-05-23 13:42:25.856 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:42:25.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:25.856 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:42:25.856 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:25.857 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:42:25.857 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:42:25.857 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:25.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:25.863 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:42:25.863 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:25.863 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:42:26.066 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:26.066 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27345 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:27.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:27.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:27.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:27.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:27.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:29.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:29.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:29.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:31.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:31.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:31.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ec002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:31.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:31.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:31.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:31.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:31.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ed002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:31.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:31.481 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:31.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:32.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ee002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:32.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:32.623 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:33.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:33.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:33.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:34.071 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:34.072 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:42:34.073 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:34.073 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27439) version 11:1:1:4 [ CSSD]2013-05-23 13:42:34.079 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:42:34.079 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:34.079 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:42:34.079 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:34.079 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:42:34.080 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:42:34.080 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:34.087 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:34.087 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:42:34.087 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:34.087 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:42:34.290 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:34.290 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27439 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:35.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:35.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:35.447 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:35.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:37.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:37.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:37.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:37.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:37.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:38.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ef002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:38.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:38.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:38.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:38.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:38.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f0002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:38.112 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:38.112 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:39.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:39.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:39.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:41.104 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:41.104 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:42:41.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:41.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27500) version 11:1:1:4 [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:42:41.111 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:41.117 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:41.117 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:42:41.117 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:41.117 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:42:41.319 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:41.319 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27500 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:41.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:41.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:41.630 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:41.630 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:42:41.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:42.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f1002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:43.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:43.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:43.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:45.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:45.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:45.475 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:45.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:46.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:46.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:46.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f2002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:46.735 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:42:46.735 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:42:46.735 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:42:46.735 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:46.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f3002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:46.744 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:42:46.744 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:42:47.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:47.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:48.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:49.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:49.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:50.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:51.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:51.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:51.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:51.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:52.028 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:52.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f4002b) incarnation(174631051) [ CSSD]2013-05-23 13:42:53.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:53.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:54.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:55.502 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:42:55.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:55.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:56.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:56.359 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:42:56.359 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:42:56.360 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:42:56.360 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27687) version 11:1:1:4 [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:42:56.366 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:42:56.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:42:56.373 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:42:56.373 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:42:56.373 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:42:56.576 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:42:56.576 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27687 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:42:56.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:42:56.639 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:42:57.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:57.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:42:58.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:42:59.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:42:59.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:00.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:00.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:00.642 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:43:01.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:01.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:01.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f5002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:01.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:43:01.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:43:01.997 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:43:01.997 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:02.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f6002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:02.005 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:43:02.005 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:43:02.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f7002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:02.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:03.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:03.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:04.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:05.526 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:05.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:05.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:05.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:05.645 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:06.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:07.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:07.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:08.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:09.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:09.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:10.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:10.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:10.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:11.609 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:43:11.610 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:43:11.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:43:11.611 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27827) version 11:1:1:4 [ CSSD]2013-05-23 13:43:11.627 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:43:11.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:43:11.627 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:43:11.627 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:11.627 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:43:11.628 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:11.628 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:11.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:43:11.634 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:43:11.634 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:11.634 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:11.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:11.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:11.836 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:43:11.836 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27827 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:12.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f8002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:12.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:13.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:13.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:14.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:15.547 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:15.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:15.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:15.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:15.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:16.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:17.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f9002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:17.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:43:17.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:43:17.253 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:43:17.253 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:17.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fa002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:17.260 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:43:17.260 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:43:17.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:17.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:18.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:19.654 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:19.655 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:43:19.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:19.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:20.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:21.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:21.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:22.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fb002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:22.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:23.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:23.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:24.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:24.657 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:24.658 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:25.571 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:25.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:25.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:26.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:26.869 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:43:26.870 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:43:26.871 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:43:26.871 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(27971) version 11:1:1:4 [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x261bc40) [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bc40 with con 0x261bac0, requested num -1 [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:26.877 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:26.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bc40) [ CSSD]2013-05-23 13:43:26.884 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:43:26.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261bf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:26.885 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261bf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:27.087 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:43:27.087 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 27971 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:27.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:27.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:28.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:28.500 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 13:43:28.501 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:43:28.501 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 13:43:28.501 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x2659ac0) pid(28026) version 11:1:1:4 [ CSSD]2013-05-23 13:43:28.508 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2659ac0), client(1/0x7f82ac0076c0) [ CSSD]2013-05-23 13:43:28.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076c0) [ CSSD]2013-05-23 13:43:28.508 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac0076c0 with con 0x7f82ac06d530, requested num -1 [ CSSD]2013-05-23 13:43:28.508 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:43:28.508 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:43:28.509 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:28.509 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:28.516 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076c0) [ CSSD]2013-05-23 13:43:28.516 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076c0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:43:28.516 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06bfd0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:43:28.516 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac06bfd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:28.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006930) allocated [ CSSD]2013-05-23 13:43:28.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:43:28.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006930 - 1,2,3 [ CSSD]2013-05-23 13:43:28.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac006930) pid(28031) version 11:1:1:4 [ CSSD]2013-05-23 13:43:28.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:43:28.644 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:43:28.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:43:28.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006930 [ CSSD]2013-05-23 13:43:28.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006930) con(0x7f82ac06d530) skgpid ospid 28031 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:28.718 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 13:43:28.718 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e8b50) skgpid ospid 28026 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:29.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:29.661 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:29.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:29.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:30.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:31.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:31.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:32.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fc002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:32.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fd002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:32.513 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:43:32.513 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:43:32.513 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:43:32.513 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:32.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fe002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:32.520 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:43:32.520 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:43:32.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:33.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:33.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:34.331 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b60) allocated [ CSSD]2013-05-23 13:43:34.332 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:43:34.333 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b60 - 1,2,3 [ CSSD]2013-05-23 13:43:34.333 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c090) proc(0x7f82ac006b60) pid(28081) version 11:1:1:4 [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac006b60), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076d0 with con 0x7f82ac006ab0, requested num -1 [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:34.339 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:34.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:34.346 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:43:34.346 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007360) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:34.347 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:34.549 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b60 [ CSSD]2013-05-23 13:43:34.549 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b60) con(0x7f82ac06c090) skgpid ospid 28081 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:34.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:34.664 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:34.664 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:35.595 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:35.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:35.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:36.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:37.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:37.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:38.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ff002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:38.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:43:38.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:43:38.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:43:38.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:38.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0300002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:38.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:43:38.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:43:38.568 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:39.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:39.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:39.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:39.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:40.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:41.259 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b60) allocated [ CSSD]2013-05-23 13:43:41.260 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:43:41.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b60 - 1,2,3 [ CSSD]2013-05-23 13:43:41.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac006b60) pid(28147) version 11:1:1:4 [ CSSD]2013-05-23 13:43:41.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b60 [ CSSD]2013-05-23 13:43:41.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b60) con(0x7f82ac0076c0) skgpid ospid 28147 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:41.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:41.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:42.125 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b60) allocated [ CSSD]2013-05-23 13:43:42.126 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:43:42.127 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b60 - 1,2,3 [ CSSD]2013-05-23 13:43:42.127 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c090) proc(0x7f82ac006b60) pid(28249) version 11:1:1:4 [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac006b60), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076d0 with con 0x7f82ac006ab0, requested num -1 [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac019660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:42.133 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:42.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 13:43:42.140 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:43:42.140 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac007360) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:42.140 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac007360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:42.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0301002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:42.342 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b60 [ CSSD]2013-05-23 13:43:42.342 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b60) con(0x7f82ac06c090) skgpid ospid 28249 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:42.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:43.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:43.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:44.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:44.670 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:44.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:45.620 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:46.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:46.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:46.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:47.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0302002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:47.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:43:47.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:43:47.775 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d920/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:43:47.775 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:47.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0303002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:47.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:43:47.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06dc20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:43:48.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:48.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:48.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:48.749 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b60) allocated [ CSSD]2013-05-23 13:43:48.749 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:43:48.750 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b60 - 1,2,3 [ CSSD]2013-05-23 13:43:48.750 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac006b60) pid(27622/27622) version 11:1:1:4 [ CSSD]2013-05-23 13:43:48.767 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac006b60), client(1/0x7f82ac006ab0) [ CSSD]2013-05-23 13:43:48.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:43:48.767 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:43:48.767 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:43:49.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:49.674 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:50.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:50.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:50.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:52.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:52.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:52.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0304002b) incarnation(174631051) [ CSSD]2013-05-23 13:43:52.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:54.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:54.060 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:54.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:54.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:54.677 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:43:55.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:43:56.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:56.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:56.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:57.377 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:43:57.378 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:43:57.379 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:43:57.379 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(28502) version 11:1:1:4 [ CSSD]2013-05-23 13:43:57.385 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a20) [ CSSD]2013-05-23 13:43:57.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:43:57.385 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a20 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:43:57.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:57.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:43:57.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:43:57.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:43:57.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:43:57.392 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:43:57.392 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:43:57.392 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:43:57.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:43:57.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 28502 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:43:58.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:43:58.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:43:58.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:43:59.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:43:59.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:00.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:00.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:00.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:02.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:02.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:02.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0305002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:02.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:03.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0306002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:03.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:44:03.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:44:03.036 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:44:03.036 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:03.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0307002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:03.043 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:44:03.043 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:44:04.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:04.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:04.684 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:04.684 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:04.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:05.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:06.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:06.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:06.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:08.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:08.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:08.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:09.687 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:09.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:10.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:10.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:10.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:12.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:12.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:12.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0308002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:12.632 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:12.633 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:44:12.634 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:12.634 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac003440) pid(28643) version 11:1:1:4 [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac007130) [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac007130 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:12.641 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:12.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:44:12.648 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac007130), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:44:12.648 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:12.648 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:12.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:12.851 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:12.851 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac06d530) skgpid ospid 28643 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:14.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:14.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:14.690 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:14.691 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:14.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:15.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:15.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:44:15.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:15.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(28700) version 11:1:1:4 [ CSSD]2013-05-23 13:44:15.163 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06c9b0) allocated [ CSSD]2013-05-23 13:44:15.164 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:44:15.164 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06c9b0 - 1,2,3 [ CSSD]2013-05-23 13:44:15.164 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c290) proc(0x7f82ac06c9b0) pid(28710) version 11:1:1:4 [ CSSD]2013-05-23 13:44:15.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:44:15.195 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:44:15.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06c9b0 [ CSSD]2013-05-23 13:44:15.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06c9b0) con(0x7f82ac06c290) skgpid ospid 28710 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5313/0x7f82ac012e20) [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5313 (0x7f82ac012e20) [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac012e20 with con 0x7f82ac003590, requested num -1 [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac06c360/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:15.362 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:44:15.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5313 (0x7f82ac012e20) [ CSSD]2013-05-23 13:44:15.369 [1199044928] >TRACE: clssgmExitGrock: client 5313 (0x7f82ac012e20), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:44:15.369 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:44:15.369 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:15.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:15.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 28700 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:15.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:16.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:16.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:16.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:18.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:18.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:18.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0309002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:18.286 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:44:18.286 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:44:18.286 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:44:18.287 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:18.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030a002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:18.293 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:44:18.293 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:44:18.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:19.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:19.694 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:20.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:20.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:20.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:22.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:22.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:22.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030b002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:22.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:24.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:24.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:24.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:24.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:24.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:25.712 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:26.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:26.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:26.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:27.897 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:27.898 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:44:27.899 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:27.899 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(28830) version 11:1:1:4 [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a20) [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a20 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:27.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:27.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:27.912 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:44:27.912 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:27.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:28.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:28.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 28830 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:28.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:28.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:28.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:29.701 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:29.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:30.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:30.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:30.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:32.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030c002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:32.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:32.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:32.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:33.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030d002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:33.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:44:33.537 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:44:33.537 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:44:33.537 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:33.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030e002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:33.546 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:44:33.546 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:44:34.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:34.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:34.589 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:34.590 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:44:34.591 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:34.591 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac003440) pid(28911) version 11:1:1:4 [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac007130) [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac007130 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:34.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:34.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:44:34.615 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac007130), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:44:34.615 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac012c90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:34.615 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac012c90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:34.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:34.705 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:34.817 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:34.817 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac06d530) skgpid ospid 28911 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:34.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:35.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:36.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:36.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:36.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:38.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:38.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:38.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030f002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:38.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:44:38.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:44:38.641 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:44:38.641 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:38.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0310002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:38.648 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:44:38.648 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:44:38.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:38.707 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:44:38.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:40.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:40.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:40.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:42.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0311002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:42.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:42.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:43.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:43.151 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:43.152 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:44:43.152 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:43.152 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(28982) version 11:1:1:4 [ CSSD]2013-05-23 13:44:43.158 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a20) [ CSSD]2013-05-23 13:44:43.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:43.158 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a20 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:44:43.158 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:43.158 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:44:43.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:43.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:43.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:43.165 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:44:43.165 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:43.165 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:43.367 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:43.367 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 28982 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:43.710 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:43.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:44.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:44.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:45.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:45.759 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:46.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:46.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:47.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:48.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:48.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:48.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:48.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:48.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0312002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:48.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:44:48.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:44:48.791 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:44:48.791 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:48.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0313002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:48.799 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:44:48.799 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:44:49.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:50.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:50.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:51.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:52.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0314002b) incarnation(174631051) [ CSSD]2013-05-23 13:44:52.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:52.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:53.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:53.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:53.716 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:54.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:54.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:55.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:56.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:56.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:57.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:44:58.401 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:44:58.402 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:44:58.403 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:44:58.403 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(29158) version 11:1:1:4 [ CSSD]2013-05-23 13:44:58.409 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a20) [ CSSD]2013-05-23 13:44:58.409 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:58.409 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a20 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:44:58.409 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:58.409 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:44:58.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:44:58.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:44:58.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:44:58.416 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:44:58.416 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:44:58.416 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:44:58.618 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:44:58.619 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 29158 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:44:58.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:44:58.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:44:58.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:44:58.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:44:58.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:44:59.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:00.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:00.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:01.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:02.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0315002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:02.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:02.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:03.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:03.723 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:03.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:04.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0316002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:04.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:45:04.053 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:45:04.053 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0072a0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:45:04.053 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:04.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0317002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:04.061 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:45:04.061 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007090) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:45:04.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:04.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:05.123 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:45:05.123 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:45:05.124 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:45:05.124 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac003440) pid(29267/29267) version 11:1:1:4 [ CSSD]2013-05-23 13:45:05.141 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac007130) [ CSSD]2013-05-23 13:45:05.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:45:05.141 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:45:05.141 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:45:05.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:06.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:06.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:06.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:45:06.787 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:45:06.787 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:45:06.787 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:45:06.788 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:45:06.788 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac06d530) skgpid 29267 ospid 29267 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:07.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:08.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:08.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:08.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:08.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:08.754 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:09.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:10.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:10.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:11.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:12.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0318002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:12.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:12.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:13.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:13.665 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:45:13.666 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:45:13.667 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:45:13.667 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(29319) version 11:1:1:4 [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a20) [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a20 with con 0x7f82ac012e10, requested num -1 [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac06c360/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:45:13.673 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:13.679 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a20) [ CSSD]2013-05-23 13:45:13.679 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:45:13.679 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac06c660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:13.680 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac06c660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:45:13.730 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:13.730 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:13.882 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:45:13.882 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 29319 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:14.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:14.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:15.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207f20) [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207f20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207f20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 13:45:16.646 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b42a3f90) skgpid 23767 ospid 23767 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:16.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:16.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:17.214 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 13:45:17.215 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:45:17.215 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 13:45:17.215 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac003440) pid(29384/29384) version 11:1:1:4 [ CSSD]2013-05-23 13:45:17.231 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac003440), client(1/0x7f82ac007130) [ CSSD]2013-05-23 13:45:17.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:45:17.231 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:45:17.231 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:45:17.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:17.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:17.733 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:45:18.225 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac003440), client(2/0x7f82ac003880) [ CSSD]2013-05-23 13:45:18.225 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac003880) [ CSSD]2013-05-23 13:45:18.225 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:45:18.225 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 13:45:18.775 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:18.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:18.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:19.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:19.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0319002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:19.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:45:19.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:45:19.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06c650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:45:19.304 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:19.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031a002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:19.311 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:45:19.311 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06ca20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:45:20.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:20.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:21.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:22.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031b002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:22.736 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:22.736 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:22.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:22.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:23.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:24.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:24.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:25.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:26.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:26.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:27.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:27.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:27.740 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:28.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:28.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:28.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:28.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe10) allocated [ CSSD]2013-05-23 13:45:28.917 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:45:28.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe10 - 1,2,3 [ CSSD]2013-05-23 13:45:28.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013050) proc(0x7f82ac00fe10) pid(29469) version 11:1:1:4 [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac00fe10), client(1/0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06c4e0 with con 0x7f82ac00ff40, requested num -1 [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac000b00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:45:28.935 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:28.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:28.943 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06c4e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:45:28.943 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:28.943 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:45:29.146 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe10 [ CSSD]2013-05-23 13:45:29.146 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe10) con(0x7f82ac013050) skgpid ospid 29469 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:29.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:30.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:30.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:31.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:32.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031c002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:32.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:32.743 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:32.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:32.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:33.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:34.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031d002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:34.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:45:34.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:45:34.554 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06c650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:45:34.554 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:34.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031e002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:34.562 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:45:34.562 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06ca20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:45:34.859 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe10) allocated [ CSSD]2013-05-23 13:45:34.860 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:45:34.860 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe10 - 1,2,3 [ CSSD]2013-05-23 13:45:34.860 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013050) proc(0x7f82ac00fe10) pid(29548) version 11:1:1:4 [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac00fe10), client(1/0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06c4e0 with con 0x7f82ac00ff40, requested num -1 [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac000b00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:45:34.866 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:34.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06c4e0) [ CSSD]2013-05-23 13:45:34.873 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06c4e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:45:34.873 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:34.873 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:45:34.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:34.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:35.075 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe10 [ CSSD]2013-05-23 13:45:35.075 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe10) con(0x7f82ac013050) skgpid ospid 29548 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:35.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:35.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe70) allocated [ CSSD]2013-05-23 13:45:35.692 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:45:35.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe70 - 1,2,3 [ CSSD]2013-05-23 13:45:35.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013110) proc(0x7f82ac00fe70) pid(29382/29382) version 11:1:1:4 [ CSSD]2013-05-23 13:45:35.709 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac00fe70), client(1/0x7f82ac014120) [ CSSD]2013-05-23 13:45:35.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac014120) [ CSSD]2013-05-23 13:45:35.709 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:45:35.709 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:45:36.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:36.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:37.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:37.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:37.746 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:38.824 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:38.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031f002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:38.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:45:38.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:45:38.906 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:45:38.906 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:38.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0320002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:38.914 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:45:38.914 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:45:38.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:38.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:39.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:41.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:41.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:41.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:42.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0321002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:42.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:42.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:43.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:43.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:43.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:44.182 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:45:44.183 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:45:44.183 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:45:44.183 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(29633) version 11:1:1:4 [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:45:44.190 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:44.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:45:44.197 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:45:44.197 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:44.197 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:45:44.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:45:44.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 29633 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:45:45.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:45.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:45.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:47.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:47.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:47.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:47.752 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:47.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:48.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:49.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:49.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:49.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:49.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0322002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:49.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:45:49.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:45:49.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:45:49.807 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:49.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0323002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:49.815 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:45:49.815 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:45:51.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:51.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:51.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:52.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0324002b) incarnation(174631051) [ CSSD]2013-05-23 13:45:52.755 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:52.755 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:53.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:53.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:53.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:55.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:55.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:55.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:57.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:57.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:57.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:57.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:45:57.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:45:58.870 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:45:59.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:45:59.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:45:59.432 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002880) allocated [ CSSD]2013-05-23 13:45:59.433 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:45:59.434 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002880 - 1,2,3 [ CSSD]2013-05-23 13:45:59.434 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac000f20) proc(0x7f82ac002880) pid(29799) version 11:1:1:4 [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac002880), client(1/0x7f82ac004960) [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004960) [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004960 with con 0x7f82ac0027c0, requested num -1 [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:45:59.440 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:45:59.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004960) [ CSSD]2013-05-23 13:45:59.447 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:45:59.447 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:45:59.447 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:45:59.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:45:59.650 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002880 [ CSSD]2013-05-23 13:45:59.650 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002880) con(0x7f82ac000f20) skgpid ospid 29799 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:01.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:01.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:01.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:02.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0325002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:02.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:02.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:03.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:03.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:03.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:05.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0326002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:05.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:05.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:05.058 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:46:05.058 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:05.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0327002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:05.067 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:05.067 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:05.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:05.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:05.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:07.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:07.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:07.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:07.765 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:07.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:07.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0328002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:07.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:07.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:07.978 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:46:07.978 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:07.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0329002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:07.986 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:07.986 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:08.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:46:08.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:46:08.118 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:46:08.119 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:46:08.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:09.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:09.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:09.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:11.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:11.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:11.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:12.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032a002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:12.769 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:12.769 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:13.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:13.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:13.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:14.683 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:46:14.683 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:46:14.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:46:14.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(29933) version 11:1:1:4 [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:46:14.690 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:14.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:14.697 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:46:14.697 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:14.697 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:46:14.899 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:46:14.899 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 29933 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:15.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:15.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:15.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:16.017 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0044d0) allocated [ CSSD]2013-05-23 13:46:16.018 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:46:16.018 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0044d0 - 1,2,3 [ CSSD]2013-05-23 13:46:16.018 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0044d0) pid(29986/29986) version 11:1:1:4 [ CSSD]2013-05-23 13:46:16.024 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0044d0), client(1/0x7f82ac004970) [ CSSD]2013-05-23 13:46:16.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac004970) [ CSSD]2013-05-23 13:46:16.024 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:46:16.024 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac004970) [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac004970), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac004970), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0044d0 [ CSSD]2013-05-23 13:46:16.046 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0044d0) con(0x7f82ac001040) skgpid 29986 ospid 29986 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:16.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:16.772 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:46:17.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:17.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:17.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:18.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:19.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:19.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:19.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:20.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032b002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:20.319 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:20.319 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:20.319 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:46:20.319 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:20.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032c002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:20.328 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:20.328 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:21.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 13:46:21.132 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:46:21.132 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:46:21.132 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 13:46:21.138 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42c6340) skgpid 24587 ospid 24587 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:21.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:21.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:21.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:21.775 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:21.775 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:22.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032d002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:23.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:23.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:23.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:25.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:25.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:25.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:26.778 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:26.778 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:27.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:27.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:27.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:28.950 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:29.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:29.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:29.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:29.946 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:46:29.947 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:46:29.948 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:46:29.948 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(30090) version 11:1:1:4 [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:46:29.954 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:29.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:46:29.961 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:46:29.961 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:29.961 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:46:30.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:46:30.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 30090 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:31.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:31.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:31.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:31.782 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:31.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:32.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032e002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:33.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:33.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:33.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:35.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0044d0) allocated [ CSSD]2013-05-23 13:46:35.121 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:46:35.121 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0044d0 - 1,2,3 [ CSSD]2013-05-23 13:46:35.121 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0044d0) pid(30162) version 11:1:1:4 [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0044d0), client(1/0x7f82ac004af0) [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004af0) [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004af0 with con 0x7f82ac002900, requested num -1 [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:46:35.128 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:35.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004af0) [ CSSD]2013-05-23 13:46:35.135 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:46:35.135 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:35.135 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:46:35.338 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0044d0 [ CSSD]2013-05-23 13:46:35.338 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0044d0) con(0x7f82ac001040) skgpid ospid 30162 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:35.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:35.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:35.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032f002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:35.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:35.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:35.572 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002780/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:46:35.572 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:35.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0330002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:35.579 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:35.579 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0009b0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:35.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:35.785 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:46:35.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:37.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:37.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:37.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:38.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:39.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0331002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:39.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:39.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:39.163 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:46:39.163 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:39.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0332002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:39.171 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:39.171 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:39.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:39.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:39.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:40.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:40.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:41.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:41.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:41.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:42.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0333002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:43.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:43.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:43.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:45.205 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0044d0) allocated [ CSSD]2013-05-23 13:46:45.205 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:46:45.206 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0044d0 - 1,2,3 [ CSSD]2013-05-23 13:46:45.206 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0044d0) pid(30240) version 11:1:1:4 [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0044d0), client(1/0x7f82ac004af0) [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004af0) [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004af0 with con 0x7f82ac002900, requested num -1 [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:46:45.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:45.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004af0) [ CSSD]2013-05-23 13:46:45.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:46:45.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:46:45.220 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:46:45.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0044d0 [ CSSD]2013-05-23 13:46:45.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0044d0) con(0x7f82ac001040) skgpid ospid 30240 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:46:45.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:45.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:45.791 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:45.791 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:45.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:47.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:47.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:47.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:49.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:49.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:49.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:49.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:50.794 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:50.794 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:50.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0334002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:50.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:46:50.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:46:50.826 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:46:50.826 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:46:50.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0335002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:50.834 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:46:50.834 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:46:51.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:51.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:51.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:52.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0336002b) incarnation(174631051) [ CSSD]2013-05-23 13:46:53.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:53.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:54.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:55.486 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0044d0) allocated [ CSSD]2013-05-23 13:46:55.487 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:46:55.487 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0044d0 - 1,2,3 [ CSSD]2013-05-23 13:46:55.487 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0044d0) pid(30345/30345) version 11:1:1:4 [ CSSD]2013-05-23 13:46:55.505 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0044d0), client(1/0x7f82ac004970) [ CSSD]2013-05-23 13:46:55.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac004970) [ CSSD]2013-05-23 13:46:55.505 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:46:55.505 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:46:55.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:55.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:55.797 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:55.798 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:46:56.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:57.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:57.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:58.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:46:59.032 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:46:59.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:46:59.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:46:59.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:46:59.800 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:47:00.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:00.454 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005d50) allocated [ CSSD]2013-05-23 13:47:00.455 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:47:00.467 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005d50 - 1,2,3 [ CSSD]2013-05-23 13:47:00.467 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac005070) proc(0x7f82ac005d50) pid(30381) version 11:1:1:4 [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac005d50), client(1/0x7f82ac038070) [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038070) [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038070 with con 0x7f82ac005e80, requested num -1 [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0381e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:00.474 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:00.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038070) [ CSSD]2013-05-23 13:47:00.481 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:00.481 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0384e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:00.481 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0384e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:00.683 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005d50 [ CSSD]2013-05-23 13:47:00.683 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005d50) con(0x7f82ac005070) skgpid ospid 30381 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:01.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:01.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:02.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:02.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0337002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:03.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:03.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:04.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:04.803 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:04.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:05.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:47:05.709 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:47:05.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:47:05.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:47:05.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0338002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:05.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:05.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:05.791 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac004ae0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:47:05.791 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:47:05.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0339002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:05.799 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:05.799 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac004820) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:05.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:05.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:06.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033a002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:06.080 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:06.080 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:06.080 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac004ae0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:47:06.080 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:06.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033b002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:06.089 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:06.089 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac004820) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:06.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:06.719 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005d50) allocated [ CSSD]2013-05-23 13:47:06.720 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:47:06.720 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005d50 - 1,2,3 [ CSSD]2013-05-23 13:47:06.720 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac005070) proc(0x7f82ac005d50) pid(30475) version 11:1:1:4 [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac005d50), client(1/0x7f82ac038070) [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038070) [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038070 with con 0x7f82ac005e80, requested num -1 [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0381e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:06.738 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:06.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038070) [ CSSD]2013-05-23 13:47:06.745 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:06.745 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0384e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:06.745 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0384e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:06.947 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005d50 [ CSSD]2013-05-23 13:47:06.947 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005d50) con(0x7f82ac005070) skgpid ospid 30475 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:07.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:07.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:08.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:09.055 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:47:09.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:09.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:09.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:09.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:10.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:11.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:11.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:11.974 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0378a0) allocated [ CSSD]2013-05-23 13:47:11.975 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:47:11.975 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0378a0 - 1,2,3 [ CSSD]2013-05-23 13:47:11.975 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac004fa0) proc(0x7f82ac0378a0) pid(30549) version 11:1:1:4 [ CSSD]2013-05-23 13:47:12.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:12.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033c002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:13.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:13.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:14.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:14.561 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0378a0 [ CSSD]2013-05-23 13:47:14.561 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0378a0) con(0x7f82ac004fa0) skgpid ospid 30549 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:14.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:14.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:15.710 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0059a0) allocated [ CSSD]2013-05-23 13:47:15.711 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:47:15.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0059a0 - 1,2,3 [ CSSD]2013-05-23 13:47:15.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac038090) proc(0x7f82ac0059a0) pid(30876) version 11:1:1:4 [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0059a0), client(1/0x7f82ac0048d0) [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0048d0) [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0048d0 with con 0x7f82ac0058e0, requested num -1 [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:15.718 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:15.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0048d0) [ CSSD]2013-05-23 13:47:15.725 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0048d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:15.725 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037410) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:15.725 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:15.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:15.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:15.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0059a0 [ CSSD]2013-05-23 13:47:15.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0059a0) con(0x7f82ac038090) skgpid ospid 30876 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:16.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:17.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:17.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:18.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:18.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:18.813 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:47:19.077 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:47:19.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:19.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:20.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:21.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033d002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:21.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:21.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:21.333 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac004ae0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:47:21.333 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:21.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033e002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:21.342 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:21.342 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac004820) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:21.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:21.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:22.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:22.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033f002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:23.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:23.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:23.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:23.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:24.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:26.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:26.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:26.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac004970) [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac004970), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac004970), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0044d0 [ CSSD]2013-05-23 13:47:26.567 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0044d0) con(0x7f82ac001040) skgpid 30345 ospid 30345 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:28.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:28.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:28.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:28.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:28.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:29.098 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:47:30.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:30.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:30.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:30.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:47:30.971 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:47:30.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:47:30.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(31063) version 11:1:1:4 [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:30.978 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:30.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:30.985 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:30.985 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:30.985 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:31.188 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:47:31.188 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 31063 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:32.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:32.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:32.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:32.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0340002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:33.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:33.822 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:34.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:34.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:34.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:35.384 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:47:35.386 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:47:35.386 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:47:35.386 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(31129) version 11:1:1:4 [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:35.393 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:35.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:35.400 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:35.400 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:35.400 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:35.602 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:47:35.602 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 31129 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:36.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:36.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:36.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005c20) allocated [ CSSD]2013-05-23 13:47:36.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:47:36.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005c20 - 1,2,3 [ CSSD]2013-05-23 13:47:36.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0041e0) proc(0x7f82ac005c20) pid(31144) version 11:1:1:4 [ CSSD]2013-05-23 13:47:36.218 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac005c20), client(1/0x7f82ac0015d0) [ CSSD]2013-05-23 13:47:36.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 13:47:36.218 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015d0 with con 0x7f82ac005b60, requested num -1 [ CSSD]2013-05-23 13:47:36.218 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:36.218 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001740/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:36.219 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:36.219 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:36.225 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 13:47:36.225 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:36.225 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:36.225 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:36.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:36.428 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005c20 [ CSSD]2013-05-23 13:47:36.428 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005c20) con(0x7f82ac0041e0) skgpid ospid 31144 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:36.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0341002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:36.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:36.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:36.595 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:47:36.595 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:36.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0342002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:36.603 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:36.604 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003e80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:37.824 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:37.825 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:47:38.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:38.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:38.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:39.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:47:39.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0343002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:39.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:39.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:39.427 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:47:39.427 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:39.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0344002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:39.435 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:39.435 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:40.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:40.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:40.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:42.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:42.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:42.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:42.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:42.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:42.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0345002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:44.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:44.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:44.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:46.226 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0029a0) allocated [ CSSD]2013-05-23 13:47:46.227 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:47:46.227 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0029a0 - 1,2,3 [ CSSD]2013-05-23 13:47:46.227 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac0029a0) pid(31224) version 11:1:1:4 [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0029a0), client(1/0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004ab0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:47:46.234 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:46.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004ab0) [ CSSD]2013-05-23 13:47:46.242 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:47:46.242 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:47:46.242 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:47:46.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:46.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:46.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0029a0 [ CSSD]2013-05-23 13:47:46.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0029a0) con(0x7f82ac001040) skgpid ospid 31224 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:46.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:46.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef150) [ CSSD]2013-05-23 13:47:46.662 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef150), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:47:46.662 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef150), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:47:46.662 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 13:47:46.667 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427c5d0) skgpid 25693 ospid 25693 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:47:47.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:47.831 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:48.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:48.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:48.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:49.153 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:47:50.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:50.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:50.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:51.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0346002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:51.848 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:47:51.848 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:47:51.848 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0008c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:47:51.848 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:47:51.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0347002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:51.855 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:47:51.856 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac000cb0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:47:52.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:52.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:52.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:52.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:52.834 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:52.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0348002b) incarnation(174631051) [ CSSD]2013-05-23 13:47:54.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:54.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:54.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:56.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:56.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:56.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:57.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:47:57.837 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:47:58.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:47:58.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:47:58.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:47:59.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:00.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:00.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:00.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:01.480 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002990) allocated [ CSSD]2013-05-23 13:48:01.481 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:48:01.482 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002990 - 1,2,3 [ CSSD]2013-05-23 13:48:01.482 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001040) proc(0x7f82ac002990) pid(31408) version 11:1:1:4 [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac002990), client(1/0x7f82ac004aa0) [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac004aa0) [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac004aa0 with con 0x7f82ac0028e0, requested num -1 [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:01.489 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:01.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac004aa0) [ CSSD]2013-05-23 13:48:01.496 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac004aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:48:01.496 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:01.496 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:01.699 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002990 [ CSSD]2013-05-23 13:48:01.699 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002990) con(0x7f82ac001040) skgpid ospid 31408 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:01.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:01.840 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:48:02.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:02.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:02.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:03.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0349002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:04.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:04.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:04.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0192d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0192d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac068c20 [ CSSD]2013-05-23 13:48:05.141 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac068c20) con(0x7f82ac06de50) skgpid 28258 ospid 28258 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:06.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:06.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:06.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:06.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:06.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:07.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034a002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:07.098 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:48:07.098 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:48:07.098 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:48:07.098 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:07.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034b002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:07.107 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:48:07.107 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c160) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:48:08.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:08.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:08.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:09.199 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:10.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:10.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:10.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:11.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:11.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:12.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:12.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:12.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:13.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034c002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:14.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:14.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:14.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:16.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:16.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:16.735 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06d7e0) allocated [ CSSD]2013-05-23 13:48:16.736 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:48:16.736 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06d7e0 - 1,2,3 [ CSSD]2013-05-23 13:48:16.736 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de40) proc(0x7f82ac06d7e0) pid(31560) version 11:1:1:4 [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac06d7e0), client(1/0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0024b0 with con 0x7f82ac001e30, requested num -1 [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac002620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:16.753 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:16.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:16.760 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0024b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:48:16.760 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002920) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:16.760 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:16.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:16.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:16.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:16.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06d7e0 [ CSSD]2013-05-23 13:48:16.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06d7e0) con(0x7f82ac06de40) skgpid ospid 31560 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:18.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:18.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:18.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:19.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:20.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:20.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:20.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:21.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:21.853 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:22.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034d002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:22.350 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:48:22.350 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:48:22.350 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:48:22.350 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:22.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034e002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:22.359 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:48:22.359 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c160) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:48:22.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:22.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:22.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:23.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034f002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:24.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:24.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:24.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:26.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:26.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:26.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:26.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:26.856 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:28.328 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:48:28.329 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:28.329 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:48:28.329 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0191b0) proc(0x7f82ac001ee0) pid(31681/31681) version 11:1:1:4 [ CSSD]2013-05-23 13:48:28.346 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.346 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:48:28.346 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:48:28.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac0191b0) skgpid 31681 ospid 31681 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:28.562 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:48:28.563 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:28.563 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:48:28.563 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0191b0) proc(0x7f82ac001ee0) pid(31684/31684) version 11:1:1:4 [ CSSD]2013-05-23 13:48:28.579 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.579 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:48:28.579 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:48:28.625 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac0191b0) skgpid 31684 ospid 31684 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:28.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:28.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:28.799 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06d7e0) allocated [ CSSD]2013-05-23 13:48:28.800 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:28.800 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06d7e0 - 1,2,3 [ CSSD]2013-05-23 13:48:28.800 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de40) proc(0x7f82ac06d7e0) pid(31688) version 11:1:1:4 [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac06d7e0), client(1/0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac0024b0 with con 0x7f82ac001e30, requested num -1 [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac002620/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:28.808 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:28.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0024b0) [ CSSD]2013-05-23 13:48:28.815 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0024b0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:48:28.815 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002920) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:48:28.815 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac002920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:28.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:28.929 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:48:28.930 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:28.930 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:48:28.930 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0025c0) proc(0x7f82ac0364b0) pid(31693) version 11:1:1:4 [ CSSD]2013-05-23 13:48:28.957 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:48:28.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:48:28.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:48:28.962 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:48:28.962 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0025c0) skgpid ospid 31693 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:29.118 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06d7e0 [ CSSD]2013-05-23 13:48:29.118 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06d7e0) con(0x7f82ac06de40) skgpid ospid 31688 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:29.244 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:30.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:30.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:30.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:31.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:31.860 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:32.004 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:48:32.005 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:48:32.005 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:48:32.005 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0191b0) proc(0x7f82ac001ee0) pid(31720) version 11:1:1:4 [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac002560) [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002560) [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002560 with con 0x7f82ac001e30, requested num -1 [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0026d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:32.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:32.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002560) [ CSSD]2013-05-23 13:48:32.029 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:48:32.029 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:32.029 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:32.231 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:48:32.231 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac0191b0) skgpid ospid 31720 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:32.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:32.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:32.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:33.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0350002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:34.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:34.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:34.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:35.650 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:48:35.651 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:35.652 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:48:35.652 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0191b0) proc(0x7f82ac001ee0) pid(31790) version 11:1:1:4 [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac002560) [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002560) [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002560 with con 0x7f82ac001e30, requested num -1 [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0026d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:35.660 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:35.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002560) [ CSSD]2013-05-23 13:48:35.667 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:48:35.667 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:35.667 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:35.869 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:48:35.869 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac0191b0) skgpid ospid 31790 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:36.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:36.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:36.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:36.863 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:36.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:37.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0351002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:37.602 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:48:37.602 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:48:37.602 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:48:37.602 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:37.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0352002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:37.609 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:48:37.609 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c160) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:48:38.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:38.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:38.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:39.266 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:39.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0353002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:39.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:48:39.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:48:39.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:48:39.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:39.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0354002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:39.701 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:48:39.702 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c160) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:48:40.756 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06d7e0) allocated [ CSSD]2013-05-23 13:48:40.757 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:40.757 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06d7e0 - 1,2,3 [ CSSD]2013-05-23 13:48:40.757 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de40) proc(0x7f82ac06d7e0) pid(31855) version 11:1:1:4 [ CSSD]2013-05-23 13:48:40.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:40.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:40.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:41.315 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06d7e0 [ CSSD]2013-05-23 13:48:41.315 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06d7e0) con(0x7f82ac06de40) skgpid ospid 31855 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:41.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:41.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:42.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:42.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:42.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:43.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0355002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:44.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:44.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:45.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:46.869 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:46.870 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:46.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:46.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:47.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:47.276 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:48:47.277 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:48:47.277 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:48:47.277 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0191b0) proc(0x7f82ac001ee0) pid(32067) version 11:1:1:4 [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac0020e0) [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0020e0) [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0020e0 with con 0x7f82ac001e30, requested num -1 [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac002250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:48:47.284 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:47.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0020e0) [ CSSD]2013-05-23 13:48:47.292 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0020e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:48:47.292 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:48:47.292 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:48:47.494 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:48:47.494 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac0191b0) skgpid ospid 32067 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:48.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:48.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:49.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:49.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:48:50.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:50.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:51.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:51.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26e4d00) [ CSSD]2013-05-23 13:48:51.263 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26e4d00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:48:51.263 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26e4d00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:48:51.264 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:48:51.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 13:48:51.271 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:48:51.271 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:48:51.271 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:48:51.272 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:48:51.272 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid 22558 ospid 22558 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:48:51.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:51.873 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:52.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0356002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:52.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:48:52.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:48:52.854 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:48:52.854 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:48:52.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0357002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:52.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:48:52.862 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac06c160) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:48:52.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:52.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:53.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:53.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0358002b) incarnation(174631051) [ CSSD]2013-05-23 13:48:54.179 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06d7e0) allocated [ CSSD]2013-05-23 13:48:54.179 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:48:54.180 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06d7e0 - 1,2,3 [ CSSD]2013-05-23 13:48:54.180 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06de40) proc(0x7f82ac06d7e0) pid(32154/32154) version 11:1:1:4 [ CSSD]2013-05-23 13:48:54.186 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac06d7e0), client(1/0x7f82ac001e30) [ CSSD]2013-05-23 13:48:54.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:48:54.186 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:48:54.186 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:48:54.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:54.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:55.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:56.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:48:56.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:48:57.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:57.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:57.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:59.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:48:59.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:48:59.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:48:59.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:01.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:01.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:01.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:01.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:01.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:02.533 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:02.534 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:49:02.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:02.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac003b80) proc(0x7f82ac0364b0) pid(32227) version 11:1:1:4 [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac036b50) [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac036b50) [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac036b50 with con 0x7f82ac005d70, requested num -1 [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036cc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:02.541 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:02.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac036b50) [ CSSD]2013-05-23 13:49:02.549 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac036b50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:49:02.549 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:02.549 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:02.752 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:02.752 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac003b80) skgpid ospid 32227 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:03.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:03.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:03.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0359002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:03.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:05.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:05.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:05.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:06.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:06.882 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:07.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:07.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:07.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:08.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035a002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:08.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:49:08.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:49:08.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0021c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:49:08.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:08.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035b002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:08.114 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:49:08.114 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002990) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:49:09.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:09.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:09.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:09.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:11.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:11.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:11.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:11.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:11.886 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:13.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035c002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:13.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:13.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:13.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:15.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:15.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:15.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:15.450 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:15.451 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:49:15.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:15.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002670) proc(0x7f82ac0364b0) pid(32350) version 11:1:1:4 [ CSSD]2013-05-23 13:49:15.584 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac063a90) allocated [ CSSD]2013-05-23 13:49:15.585 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:49:15.586 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac063a90 - 1,2,3 [ CSSD]2013-05-23 13:49:15.586 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036c00) proc(0x7f82ac063a90) pid(32360) version 11:1:1:4 [ CSSD]2013-05-23 13:49:15.613 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:49:15.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:49:15.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac063a90 [ CSSD]2013-05-23 13:49:15.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac063a90) con(0x7f82ac036c00) skgpid ospid 32360 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5314/0x7f82ac036af0) [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5314 (0x7f82ac036af0) [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac036af0 with con 0x7f82ac005da0, requested num -1 [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac036c60/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:15.784 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:49:15.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5314 (0x7f82ac036af0) [ CSSD]2013-05-23 13:49:15.791 [1199044928] >TRACE: clssgmExitGrock: client 5314 (0x7f82ac036af0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:49:15.791 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036f60) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:49:15.791 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac036f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:15.792 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:15.792 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac002670) skgpid ospid 32350 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:16.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:16.889 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:17.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:17.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:17.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:17.785 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:17.786 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:49:17.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:17.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002670) proc(0x7f82ac0364b0) pid(32393) version 11:1:1:4 [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac036af0) [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac036af0) [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac036af0 with con 0x7f82ac005da0, requested num -1 [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:17.793 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:17.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac036af0) [ CSSD]2013-05-23 13:49:17.799 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac036af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:49:17.799 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:17.799 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:18.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:18.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac002670) skgpid ospid 32393 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:19.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:19.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:19.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:19.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:20.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:20.892 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:49:21.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:21.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:21.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:23.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035d002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:23.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035e002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:23.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:49:23.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:49:23.357 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002270/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:49:23.357 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:23.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035f002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:23.365 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:49:23.365 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002570) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:49:23.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:23.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:23.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:25.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:25.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:25.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:25.895 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:25.895 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:27.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:27.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:27.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:29.381 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:29.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:29.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:29.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:30.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:30.898 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:31.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:31.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:31.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:33.035 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:33.036 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:49:33.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:33.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0020f0) proc(0x7f82ac0364b0) pid(32539) version 11:1:1:4 [ CSSD]2013-05-23 13:49:33.042 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:49:33.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:33.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002a30 with con 0x7f82ac002670, requested num -1 [ CSSD]2013-05-23 13:49:33.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:33.042 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:49:33.043 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:33.043 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:33.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:33.049 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:49:33.049 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036e40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:33.049 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036e40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:33.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0360002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:33.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:33.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0020f0) skgpid ospid 32539 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:33.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:33.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:33.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:35.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:35.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:35.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:35.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:35.901 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:35.915 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:35.920 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:49:35.921 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:35.921 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0020f0) proc(0x7f82ac0364b0) pid(32603) version 11:1:1:4 [ CSSD]2013-05-23 13:49:35.927 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:49:35.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:35.927 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002a30 with con 0x7f82ac002670, requested num -1 [ CSSD]2013-05-23 13:49:35.927 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:35.927 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:49:35.928 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:35.928 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:35.934 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:35.935 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:49:35.935 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036e40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:35.935 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036e40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:36.137 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:36.137 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0020f0) skgpid ospid 32603 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:37.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:37.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:37.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:38.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0361002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:38.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:49:38.618 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:49:38.618 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0021c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:49:38.618 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:38.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0362002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:38.625 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:49:38.625 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002990) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:49:39.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:39.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:39.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:39.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:39.904 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:39.904 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:49:39.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0363002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:39.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:49:39.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:49:39.969 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0021c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:49:39.969 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:39.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0364002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:39.976 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:49:39.976 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002990) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:49:41.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:41.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:41.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:43.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0365002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:43.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:43.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:43.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:44.907 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:44.907 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:45.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:45.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:45.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:47.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:47.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:47.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:48.290 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:49:48.291 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:49:48.292 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:49:48.292 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0020f0) proc(0x7f82ac0364b0) pid(32698) version 11:1:1:4 [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002a30 with con 0x7f82ac002670, requested num -1 [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:49:48.298 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:48.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:49:48.304 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:49:48.304 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036e40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:49:48.305 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036e40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:49:48.507 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:49:48.507 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0020f0) skgpid ospid 32698 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:49:49.435 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:49.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:49.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:49.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:49.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:49.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:51.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:51.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:51.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:53.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0366002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:53.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:53.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:53.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:53.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0367002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:53.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:49:53.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:49:53.870 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0021c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:49:53.870 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:49:53.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0368002b) incarnation(174631051) [ CSSD]2013-05-23 13:49:53.877 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:49:53.877 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002990) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:49:54.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:54.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:49:55.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:55.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:55.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:57.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:57.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:57.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:49:58.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:49:58.917 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:49:59.457 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:49:59.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:49:59.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:49:59.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:01.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:01.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:01.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:03.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0369002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:03.540 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:50:03.541 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:50:03.541 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:50:03.541 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0020f0) proc(0x7f82ac0364b0) pid(560) version 11:1:1:4 [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002a30 with con 0x7f82ac002670, requested num -1 [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036b40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:50:03.547 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:03.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:03.553 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:50:03.553 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac036e40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:03.553 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac036e40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:50:03.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:03.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:03.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:03.756 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:50:03.756 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0020f0) skgpid ospid 560 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:03.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:03.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:04.535 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 13:50:04.536 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:50:04.537 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 13:50:04.537 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0020f0) proc(0x7f82ac0364b0) pid(609/609) version 11:1:1:4 [ CSSD]2013-05-23 13:50:04.542 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0364b0), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:50:04.542 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:04.542 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:50:04.542 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac002a30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac002a30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 13:50:04.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac0020f0) skgpid 609 ospid 609 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:05.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:05.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:05.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:07.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:07.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:07.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:08.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:08.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:09.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036a002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:09.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:09.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:09.121 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0021c0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:09.121 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:09.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036b002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:09.130 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:09.130 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002990) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:09.480 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:50:09.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:09.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:09.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:11.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:11.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:11.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:13.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036c002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:13.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:13.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:13.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:13.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:13.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:15.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:15.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:15.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac006ab0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac006ab0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b60 [ CSSD]2013-05-23 13:50:16.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b60) con(0x7f82ac0076c0) skgpid 27622 ospid 27622 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:17.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:17.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:17.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:17.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:17.929 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:50:18.794 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b50) allocated [ CSSD]2013-05-23 13:50:18.795 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:50:18.795 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b50 - 1,2,3 [ CSSD]2013-05-23 13:50:18.795 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac006b50) pid(714) version 11:1:1:4 [ CSSD]2013-05-23 13:50:18.802 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac006b50), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:50:18.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:18.802 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002a30 with con 0x7f82ac006e20, requested num -1 [ CSSD]2013-05-23 13:50:18.802 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:18.802 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:50:18.803 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:50:18.803 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:18.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:18.811 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002a30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:50:18.811 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:18.811 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:50:19.013 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b50 [ CSSD]2013-05-23 13:50:19.013 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b50) con(0x7f82ac0076c0) skgpid ospid 714 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:19.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:50:19.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:19.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:19.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:21.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:21.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:21.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:22.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:22.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:23.236 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006b50) allocated [ CSSD]2013-05-23 13:50:23.236 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:50:23.237 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006b50 - 1,2,3 [ CSSD]2013-05-23 13:50:23.237 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0076c0) proc(0x7f82ac006b50) pid(706/706) version 11:1:1:4 [ CSSD]2013-05-23 13:50:23.253 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac006b50), client(1/0x7f82ac002a30) [ CSSD]2013-05-23 13:50:23.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:50:23.253 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:50:23.253 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:50:23.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036d002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:23.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:23.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:23.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:24.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036e002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:24.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:24.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:24.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:24.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:24.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036f002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:24.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:24.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0021e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:25.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:25.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:25.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:27.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:27.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:27.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:27.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:27.936 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:29.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:50:29.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:29.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:29.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:31.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:31.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:31.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:32.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:32.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:33.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0370002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:33.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:33.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:33.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:34.050 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0366e0) allocated [ CSSD]2013-05-23 13:50:34.051 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:50:34.051 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0366e0 - 1,2,3 [ CSSD]2013-05-23 13:50:34.051 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0023e0) proc(0x7f82ac0366e0) pid(865) version 11:1:1:4 [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0366e0), client(1/0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006ab0 with con 0x7f82ac036630, requested num -1 [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:50:34.058 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:34.066 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:34.066 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:50:34.066 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037130) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:34.066 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037130) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:50:34.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0366e0 [ CSSD]2013-05-23 13:50:34.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0366e0) con(0x7f82ac0023e0) skgpid ospid 865 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:35.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:36.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:36.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:36.176 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0366e0) allocated [ CSSD]2013-05-23 13:50:36.177 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:50:36.177 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0366e0 - 1,2,3 [ CSSD]2013-05-23 13:50:36.177 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0023e0) proc(0x7f82ac0366e0) pid(924) version 11:1:1:4 [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0366e0), client(1/0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006ab0 with con 0x7f82ac036630, requested num -1 [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:50:36.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:36.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:36.190 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006ab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:50:36.190 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037130) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:36.190 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037130) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:50:36.392 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0366e0 [ CSSD]2013-05-23 13:50:36.392 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0366e0) con(0x7f82ac0023e0) skgpid ospid 924 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:37.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:37.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:37.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:38.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:38.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:39.553 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:50:39.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0371002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:39.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:39.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:39.625 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0023e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:39.625 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:39.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0372002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:39.633 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:39.633 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0021e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:39.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:40.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:40.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:40.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0373002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:40.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:40.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:40.237 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:40.237 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:40.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0374002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:40.244 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:40.244 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0021e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:41.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:42.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:42.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:42.945 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:42.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:43.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0375002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:44.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:44.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:44.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:46.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:46.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:46.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:47.070 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac006b50), client(2/0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:47.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:50:47.070 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:50:47.070 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:50:47.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:47.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:48.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:48.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:48.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:49.306 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b20) allocated [ CSSD]2013-05-23 13:50:49.307 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:50:49.307 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b20 - 1,2,3 [ CSSD]2013-05-23 13:50:49.307 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b20) pid(1026) version 11:1:1:4 [ CSSD]2013-05-23 13:50:49.323 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b20), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:50:49.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:50:49.323 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005a70, requested num -1 [ CSSD]2013-05-23 13:50:49.323 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:49.323 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:50:49.324 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:50:49.324 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:49.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:50:49.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:50:49.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:50:49.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:50:49.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b20 [ CSSD]2013-05-23 13:50:49.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b20) con(0x7f82ac002630) skgpid ospid 1026 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:50:49.578 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:50:50.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:50.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:50.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:51.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0376002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:51.517 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:51.517 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:51.517 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:51.517 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:51.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0377002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:51.526 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:51.526 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:52.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:52.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:52.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:52.952 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:52.952 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:53.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0378002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:54.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:54.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:54.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:54.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0379002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:54.880 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:50:54.880 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:50:54.880 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:50:54.880 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:50:54.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037a002b) incarnation(174631051) [ CSSD]2013-05-23 13:50:54.888 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:50:54.888 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:50:56.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:56.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:56.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:57.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:50:57.955 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:50:58.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:50:58.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:50:58.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:50:59.603 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:00.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:00.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:00.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:02.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:02.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:02.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:02.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:02.959 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:03.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037b002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:04.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:04.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:04.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:04.566 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b20) allocated [ CSSD]2013-05-23 13:51:04.567 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:51:04.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b20 - 1,2,3 [ CSSD]2013-05-23 13:51:04.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b20) pid(1214) version 11:1:1:4 [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b20), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005a70, requested num -1 [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:51:04.574 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:04.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:04.580 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:51:04.580 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:04.580 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:51:04.783 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b20 [ CSSD]2013-05-23 13:51:04.783 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b20) con(0x7f82ac002630) skgpid ospid 1214 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:06.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:06.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:06.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:07.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:07.962 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:08.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:08.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037c002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:08.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:08.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:08.281 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:51:08.281 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:08.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037d002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:08.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:08.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:08.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:08.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:08.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:51:08.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:51:08.422 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:51:08.422 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:51:09.631 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:10.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037e002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:10.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:10.132 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:10.132 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:51:10.132 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:10.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037f002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:10.139 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:10.139 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003e80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:10.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:10.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:10.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:12.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:12.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:12.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:12.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:12.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:13.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0380002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:14.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:14.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:14.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:15.725 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b80) allocated [ CSSD]2013-05-23 13:51:15.726 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:51:15.726 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b80 - 1,2,3 [ CSSD]2013-05-23 13:51:15.726 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b80) pid(1341/1341) version 11:1:1:4 [ CSSD]2013-05-23 13:51:15.744 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b80), client(1/0x7f82ac037030) [ CSSD]2013-05-23 13:51:15.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac037030) [ CSSD]2013-05-23 13:51:15.744 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:51:15.744 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac037030) [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac037030), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac037030), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b80 [ CSSD]2013-05-23 13:51:15.767 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b80) con(0x7f82ac002630) skgpid 1341 ospid 1341 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:16.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:16.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:16.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:16.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:16.968 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:51:18.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:18.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:18.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:19.669 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:19.826 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b60) allocated [ CSSD]2013-05-23 13:51:19.827 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:51:19.828 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b60 - 1,2,3 [ CSSD]2013-05-23 13:51:19.828 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac004210) proc(0x7f82ac005b60) pid(1374) version 11:1:1:4 [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b60), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005ab0, requested num -1 [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:51:19.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:19.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:19.840 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:51:19.840 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:19.840 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:51:20.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b60 [ CSSD]2013-05-23 13:51:20.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b60) con(0x7f82ac004210) skgpid ospid 1374 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:20.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:20.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:20.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:21.972 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:21.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:22.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:22.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:22.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:23.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0381002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:24.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:24.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:24.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:25.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0382002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:25.383 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:25.383 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:25.383 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:51:25.383 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:25.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0383002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:25.391 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:25.391 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:26.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:26.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:26.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:26.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:26.975 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:28.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:28.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:28.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:29.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:30.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:30.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:30.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:31.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:31.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:32.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:32.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:32.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:33.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0384002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:34.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:34.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:34.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:35.081 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b20) allocated [ CSSD]2013-05-23 13:51:35.082 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:51:35.082 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b20 - 1,2,3 [ CSSD]2013-05-23 13:51:35.082 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b20) pid(1527) version 11:1:1:4 [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b20), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005a70, requested num -1 [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:51:35.089 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:35.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:35.095 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:51:35.095 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:35.095 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:51:35.297 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b20 [ CSSD]2013-05-23 13:51:35.298 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b20) con(0x7f82ac002630) skgpid ospid 1527 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:36.435 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac037430) allocated [ CSSD]2013-05-23 13:51:36.436 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:51:36.436 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac037430 - 1,2,3 [ CSSD]2013-05-23 13:51:36.436 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac037430) pid(1578) version 11:1:1:4 [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac037430), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac037380, requested num -1 [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004a20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:51:36.442 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:36.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:36.449 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:51:36.449 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004d20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:36.449 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004d20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:51:36.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:36.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:36.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:36.652 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac037430 [ CSSD]2013-05-23 13:51:36.652 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac037430) con(0x7f82ac002630) skgpid ospid 1578 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:36.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:36.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:38.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:38.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:38.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:39.724 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:40.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0385002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:40.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:40.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:40.494 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:51:40.495 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:40.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0386002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:40.501 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:40.501 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003e80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:40.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:40.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0387002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:40.634 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:40.634 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:40.634 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:51:40.634 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:40.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0388002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:40.642 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:40.642 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:40.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:40.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:41.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:41.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:42.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:42.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:42.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:43.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0389002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:44.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:44.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:44.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:46.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:46.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:46.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:46.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:46.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:48.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:48.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:48.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:49.746 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:51:50.338 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b60) allocated [ CSSD]2013-05-23 13:51:50.339 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:51:50.339 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b60 - 1,2,3 [ CSSD]2013-05-23 13:51:50.339 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac004210) proc(0x7f82ac005b60) pid(1712) version 11:1:1:4 [ CSSD]2013-05-23 13:51:50.346 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b60), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:51:50.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:50.346 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005ab0, requested num -1 [ CSSD]2013-05-23 13:51:50.346 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:50.346 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:51:50.347 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:51:50.347 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:50.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:51:50.353 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:51:50.353 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:51:50.353 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:51:50.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b60 [ CSSD]2013-05-23 13:51:50.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b60) con(0x7f82ac004210) skgpid ospid 1712 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:51:50.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:50.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:50.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:51.991 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:51.991 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:51:52.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:52.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:52.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:53.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038a002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:54.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:54.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:54.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:55.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038b002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:55.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:51:55.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:51:55.885 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:51:55.885 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:51:55.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038c002b) incarnation(174631051) [ CSSD]2013-05-23 13:51:55.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:51:55.892 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:51:55.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:51:55.994 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:51:56.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:56.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:56.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:58.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:51:58.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:51:58.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:51:59.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:00.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:00.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:00.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:01.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:01.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:01.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038d002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:01.486 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:01.486 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:01.486 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:01.486 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:01.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038e002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:01.494 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:01.494 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:02.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:03.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:03.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:03.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038f002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:04.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:05.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:05.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:05.646 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b20) allocated [ CSSD]2013-05-23 13:52:05.647 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:52:05.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b20 - 1,2,3 [ CSSD]2013-05-23 13:52:05.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b20) pid(1857) version 11:1:1:4 [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b20), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005a70, requested num -1 [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:52:05.652 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:05.658 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:05.658 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:52:05.658 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:05.658 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:52:05.861 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b20 [ CSSD]2013-05-23 13:52:05.861 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b20) con(0x7f82ac002630) skgpid ospid 1857 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:06.001 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:06.001 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:06.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:52:06.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:52:06.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:52:06.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:52:06.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0390002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:06.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:06.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:06.113 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac037b70/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:52:06.113 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:52:06.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0391002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:06.120 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:06.120 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac037e70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:06.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:07.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:07.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:08.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:09.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:09.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:09.795 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:10.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:11.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:11.004 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:11.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:11.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:11.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0392002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:11.141 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:11.141 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:11.142 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:11.142 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:11.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0393002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:11.149 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:11.149 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:11.473 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b80) allocated [ CSSD]2013-05-23 13:52:11.474 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:52:11.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b80 - 1,2,3 [ CSSD]2013-05-23 13:52:11.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b80) pid(1980) version 11:1:1:4 [ CSSD]2013-05-23 13:52:12.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:13.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:13.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:13.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0394002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:14.428 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b80 [ CSSD]2013-05-23 13:52:14.428 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b80) con(0x7f82ac002630) skgpid ospid 1980 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:14.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:15.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:15.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:16.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:16.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:16.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:17.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:17.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:18.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:19.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:19.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:19.815 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:20.008 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:20.009 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:52:20.893 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b60) allocated [ CSSD]2013-05-23 13:52:20.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:52:20.894 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b60 - 1,2,3 [ CSSD]2013-05-23 13:52:20.894 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac004210) proc(0x7f82ac005b60) pid(2352) version 11:1:1:4 [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b60), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005ab0, requested num -1 [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:52:20.900 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:20.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:20.906 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:52:20.906 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:20.906 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:52:20.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:21.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b60 [ CSSD]2013-05-23 13:52:21.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b60) con(0x7f82ac004210) skgpid ospid 2352 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:21.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:21.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:22.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:23.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:23.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:23.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0395002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:24.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:25.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:25.012 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:25.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:25.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:26.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0396002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:26.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:26.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:26.403 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:26.403 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:26.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0397002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:26.411 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:26.411 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:26.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:27.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:27.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:29.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:29.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:29.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:29.840 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:30.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:30.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:31.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:31.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:31.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:33.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:33.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:33.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:33.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0398002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:35.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:35.018 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:35.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:35.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:35.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:36.146 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005b20) allocated [ CSSD]2013-05-23 13:52:36.147 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:52:36.147 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005b20 - 1,2,3 [ CSSD]2013-05-23 13:52:36.147 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac005b20) pid(2495) version 11:1:1:4 [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac005b20), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac005a70, requested num -1 [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037280/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:52:36.153 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:36.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.160 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:52:36.160 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:36.160 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:52:36.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005b20 [ CSSD]2013-05-23 13:52:36.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005b20) con(0x7f82ac002630) skgpid ospid 2495 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:36.699 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac037490) allocated [ CSSD]2013-05-23 13:52:36.700 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:52:36.700 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac037490 - 1,2,3 [ CSSD]2013-05-23 13:52:36.700 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002630) proc(0x7f82ac037490) pid(2536) version 11:1:1:4 [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac037490), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac002270 with con 0x7f82ac037690, requested num -1 [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac004950/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:52:36.707 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:36.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:52:36.714 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac002270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:52:36.714 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac004c50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:36.714 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac004c50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:52:36.916 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac037490 [ CSSD]2013-05-23 13:52:36.916 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac037490) con(0x7f82ac002630) skgpid ospid 2536 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:37.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:37.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:37.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:39.021 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:39.021 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:52:39.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:39.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:39.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:39.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:40.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0399002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:40.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:40.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:40.754 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:40.754 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:40.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039a002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:40.761 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:40.761 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003e80) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:41.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:41.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:41.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:41.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039b002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:41.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:41.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:41.655 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:41.655 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:41.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039c002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:41.663 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:41.663 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac003f50) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:43.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:43.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:43.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:43.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039d002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:44.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:44.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:45.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:45.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:45.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:46.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac014120) [ CSSD]2013-05-23 13:52:46.740 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac014120), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:52:46.740 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac014120), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:52:46.741 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:52:46.741 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe70 [ CSSD]2013-05-23 13:52:46.741 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe70) con(0x7f82ac013110) skgpid 29382 ospid 29382 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:46.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac003880) [ CSSD]2013-05-23 13:52:46.746 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac003880), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:52:46.746 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac003880), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:52:46.746 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 13:52:46.755 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac06d530) skgpid 29384 ospid 29384 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:47.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:47.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:47.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:48.660 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac012cd0) allocated [ CSSD]2013-05-23 13:52:48.661 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:52:48.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac012cd0 - 1,2,3 [ CSSD]2013-05-23 13:52:48.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06d530) proc(0x7f82ac012cd0) pid(2616/2616) version 11:1:1:4 [ CSSD]2013-05-23 13:52:48.678 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82ac012cd0), client(1/0x7f82ac007130) [ CSSD]2013-05-23 13:52:48.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 13:52:48.678 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:52:48.678 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 13:52:49.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:49.027 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:49.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:49.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:49.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:49.882 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:52:51.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:51.402 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00f6a0) allocated [ CSSD]2013-05-23 13:52:51.403 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:52:51.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00f6a0 - 1,2,3 [ CSSD]2013-05-23 13:52:51.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c750) proc(0x7f82ac00f6a0) pid(2655) version 11:1:1:4 [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac00f6a0), client(1/0x7f82ac012c30) [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012c30 with con 0x7f82ac00f810, requested num -1 [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:52:51.411 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:51.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:52:51.420 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:52:51.420 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00f570) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:52:51.420 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00f570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:52:51.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:51.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:51.622 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00f6a0 [ CSSD]2013-05-23 13:52:51.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00f6a0) con(0x7f82ac06c750) skgpid ospid 2655 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:52:53.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:53.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:53.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:53.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039e002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:54.030 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:54.030 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:55.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:55.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:55.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:56.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039f002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:56.910 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:52:56.910 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:52:56.910 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06c290/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:52:56.910 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:52:56.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a0002b) incarnation(174631051) [ CSSD]2013-05-23 13:52:56.918 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:52:56.918 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0036b0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:52:57.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:57.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:57.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:59.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:52:59.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:52:59.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:52:59.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:52:59.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:52:59.905 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:01.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:01.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:01.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:03.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:03.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:03.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:03.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a1002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:04.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:04.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:05.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:05.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:05.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:06.659 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06c970) allocated [ CSSD]2013-05-23 13:53:06.660 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:53:06.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06c970 - 1,2,3 [ CSSD]2013-05-23 13:53:06.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c670) proc(0x7f82ac06c970) pid(2794) version 11:1:1:4 [ CSSD]2013-05-23 13:53:06.667 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac06c970), client(1/0x7f82ac012c30) [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012c30 with con 0x7f82ac00f820, requested num -1 [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:06.668 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:06.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:53:06.675 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:53:06.675 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00f570) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:06.675 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00f570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:06.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06c970 [ CSSD]2013-05-23 13:53:06.877 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06c970) con(0x7f82ac06c670) skgpid ospid 2794 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:07.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:07.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:07.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:09.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:09.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:09.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:09.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:09.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:09.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:11.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:11.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:11.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:12.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a2002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:12.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:53:12.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:53:12.162 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06c290/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:53:12.162 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:12.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a3002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:12.171 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:53:12.171 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0036b0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:53:13.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:13.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:13.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:13.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a4002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:14.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:14.041 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:15.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:15.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:15.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:17.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:17.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:17.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:19.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:19.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:19.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:19.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:19.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:19.947 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:21.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:21.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:21.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:21.911 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06c970) allocated [ CSSD]2013-05-23 13:53:21.912 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:53:21.913 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06c970 - 1,2,3 [ CSSD]2013-05-23 13:53:21.913 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c670) proc(0x7f82ac06c970) pid(2937) version 11:1:1:4 [ CSSD]2013-05-23 13:53:21.919 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac06c970), client(1/0x7f82ac012c30) [ CSSD]2013-05-23 13:53:21.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:53:21.919 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac012c30 with con 0x7f82ac00f840, requested num -1 [ CSSD]2013-05-23 13:53:21.919 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:21.919 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac003c50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:53:21.920 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:21.920 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:21.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:53:21.927 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac012c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:53:21.927 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00f570) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:21.927 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00f570) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:22.129 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06c970 [ CSSD]2013-05-23 13:53:22.129 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06c970) con(0x7f82ac06c670) skgpid ospid 2937 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:23.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:23.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:23.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:23.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a5002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:24.047 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:24.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:25.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:25.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:25.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:27.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a6002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:27.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:53:27.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:53:27.415 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06c290/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:53:27.415 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:27.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a7002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:27.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:53:27.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0036b0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:53:27.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:27.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:27.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:28.872 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06c970) allocated [ CSSD]2013-05-23 13:53:28.873 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:28.874 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06c970 - 1,2,3 [ CSSD]2013-05-23 13:53:28.874 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac06c670) proc(0x7f82ac06c970) pid(1436/1436) version 11:1:1:4 [ CSSD]2013-05-23 13:53:28.890 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac06c970), client(1/0x7f82ac012c30) [ CSSD]2013-05-23 13:53:28.890 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 13:53:28.890 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:53:28.890 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 13:53:29.049 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:29.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:29.192 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0367b0) allocated [ CSSD]2013-05-23 13:53:29.193 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:29.193 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0367b0 - 1,2,3 [ CSSD]2013-05-23 13:53:29.193 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fd60) proc(0x7f82ac0367b0) pid(3027) version 11:1:1:4 [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0367b0), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac06caa0 with con 0x7f82ac036700, requested num -1 [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036fd0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:29.200 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:29.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:29.206 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:53:29.206 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0372d0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:53:29.206 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac0372d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:29.314 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac064310) allocated [ CSSD]2013-05-23 13:53:29.315 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:29.315 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac064310 - 1,2,3 [ CSSD]2013-05-23 13:53:29.315 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac037010) proc(0x7f82ac064310) pid(3032) version 11:1:1:4 [ CSSD]2013-05-23 13:53:29.331 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:53:29.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:53:29.335 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:53:29.337 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac064310 [ CSSD]2013-05-23 13:53:29.337 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac064310) con(0x7f82ac037010) skgpid ospid 3032 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:29.409 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0367b0 [ CSSD]2013-05-23 13:53:29.409 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0367b0) con(0x7f82ac00fd60) skgpid ospid 3027 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:29.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:29.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:29.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:29.969 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:31.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:32.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:32.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:33.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:33.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a8002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:34.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:34.053 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:34.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:34.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:35.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:36.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:36.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:36.966 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac036810) allocated [ CSSD]2013-05-23 13:53:36.967 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:36.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac036810 - 1,2,3 [ CSSD]2013-05-23 13:53:36.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fd60) proc(0x7f82ac036810) pid(3109) version 11:1:1:4 [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac036810), client(1/0x7f82ac00f600) [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00f600) [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00f600 with con 0x7f82ac036700, requested num -1 [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:36.974 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:36.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00f600) [ CSSD]2013-05-23 13:53:36.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00f600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:53:36.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac037330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:36.981 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac037330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:37.162 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac064310) allocated [ CSSD]2013-05-23 13:53:37.163 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:53:37.164 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac064310 - 1,2,3 [ CSSD]2013-05-23 13:53:37.164 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac037070) proc(0x7f82ac064310) pid(3118) version 11:1:1:4 [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac064310), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac037440, requested num -1 [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064a60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:37.170 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:37.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:37.177 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:53:37.177 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0641d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:37.177 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0641d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:37.183 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac036810 [ CSSD]2013-05-23 13:53:37.183 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac036810) con(0x7f82ac00fd60) skgpid ospid 3109 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:37.379 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac064310 [ CSSD]2013-05-23 13:53:37.379 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac064310) con(0x7f82ac037070) skgpid ospid 3118 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:37.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:38.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:38.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:39.055 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:39.056 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:39.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:39.993 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:40.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:40.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:41.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a9002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:41.010 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:53:41.010 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:53:41.010 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:53:41.010 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:41.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03aa002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:41.018 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:53:41.018 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00f9a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:53:41.202 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac036810) allocated [ CSSD]2013-05-23 13:53:41.203 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:41.203 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac036810 - 1,2,3 [ CSSD]2013-05-23 13:53:41.203 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fd60) proc(0x7f82ac036810) pid(3202) version 11:1:1:4 [ CSSD]2013-05-23 13:53:41.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:41.792 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac036810 [ CSSD]2013-05-23 13:53:41.792 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac036810) con(0x7f82ac00fd60) skgpid ospid 3202 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:42.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:42.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:42.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ab002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:42.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:53:42.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:53:42.681 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac003b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:53:42.681 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:42.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ac002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:42.689 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:53:42.689 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac00f9a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:53:43.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:43.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ad002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:44.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:44.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:44.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:44.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:45.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:46.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:46.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:47.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:48.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:48.061 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:53:48.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:48.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:49.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:50.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:53:50.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:50.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:51.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:52.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:52.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:52.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0367b0) allocated [ CSSD]2013-05-23 13:53:52.413 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:53:52.413 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0367b0 - 1,2,3 [ CSSD]2013-05-23 13:53:52.413 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fd60) proc(0x7f82ac0367b0) pid(3438) version 11:1:1:4 [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0367b0), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac036700, requested num -1 [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac036fd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:53:52.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:52.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:53:52.426 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:53:52.426 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0372d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:53:52.426 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0372d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:53:52.629 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0367b0 [ CSSD]2013-05-23 13:53:52.629 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0367b0) con(0x7f82ac00fd60) skgpid ospid 3438 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:53:53.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:53.064 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:53.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:53.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ae002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:54.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:54.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:54.967 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac036810) allocated [ CSSD]2013-05-23 13:53:54.968 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:54.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac036810 - 1,2,3 [ CSSD]2013-05-23 13:53:54.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac00fd60) proc(0x7f82ac036810) pid(3430/3430) version 11:1:1:4 [ CSSD]2013-05-23 13:53:54.973 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac036810), client(1/0x7f82ac002270) [ CSSD]2013-05-23 13:53:54.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 13:53:54.973 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:53:54.973 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 13:53:55.330 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac036810), client(2/0x7f82ac00f600) [ CSSD]2013-05-23 13:53:55.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac00f600) [ CSSD]2013-05-23 13:53:55.330 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 13:53:55.330 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 13:53:55.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:55.794 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0387a0) allocated [ CSSD]2013-05-23 13:53:55.795 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:53:55.795 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0387a0 - 1,2,3 [ CSSD]2013-05-23 13:53:55.795 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac037890) proc(0x7f82ac0387a0) pid(3384/3384) version 11:1:1:4 [ CSSD]2013-05-23 13:53:55.811 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0387a0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:53:55.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:53:55.811 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:53:55.811 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:53:56.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:56.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:57.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:53:57.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03af002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:57.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:53:57.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:53:57.943 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac064b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:53:57.943 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:53:57.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b0002b) incarnation(174631051) [ CSSD]2013-05-23 13:53:57.951 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:53:57.951 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac064f70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:53:58.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:53:58.068 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:53:58.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:53:58.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:53:59.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:00.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:00.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:00.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:01.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:02.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:02.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:03.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:03.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:03.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:03.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b1002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:04.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:04.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:05.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:06.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:06.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:07.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:07.074 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:54:07.677 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d520) allocated [ CSSD]2013-05-23 13:54:07.678 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:54:07.679 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d520 - 1,2,3 [ CSSD]2013-05-23 13:54:07.679 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac07d520) pid(3635) version 11:1:1:4 [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac07d520), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac07d460, requested num -1 [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07dc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:07.685 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:07.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:07.692 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:54:07.692 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07df30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:07.693 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac07df30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:07.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:07.895 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d520 [ CSSD]2013-05-23 13:54:07.895 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d520) con(0x7f82ac036d20) skgpid ospid 3635 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:08.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:08.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:09.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:10.058 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:10.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:10.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:11.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:12.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:12.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:12.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:12.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:13.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b2002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:13.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:54:13.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:54:13.204 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac064b80/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:54:13.204 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:13.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b3002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:13.212 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:54:13.212 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac064f70) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:54:13.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:13.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b4002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:14.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:14.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:15.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d520) allocated [ CSSD]2013-05-23 13:54:15.869 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:54:15.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d520 - 1,2,3 [ CSSD]2013-05-23 13:54:15.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac07d520) pid(3726) version 11:1:1:4 [ CSSD]2013-05-23 13:54:15.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:15.989 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac078d60) allocated [ CSSD]2013-05-23 13:54:15.990 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:54:15.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac078d60 - 1,2,3 [ CSSD]2013-05-23 13:54:15.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac07dd10) proc(0x7f82ac078d60) pid(3736) version 11:1:1:4 [ CSSD]2013-05-23 13:54:16.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:54:16.010 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:54:16.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac078d60 [ CSSD]2013-05-23 13:54:16.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac078d60) con(0x7f82ac07dd10) skgpid ospid 3736 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:16.091 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5315/0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:16.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5315 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:16.091 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac06caa0 with con 0x7f82ac079030, requested num -1 [ CSSD]2013-05-23 13:54:16.092 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:54:16.092 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac079640/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:54:16.092 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:16.092 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:54:16.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5315 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:16.098 [1199044928] >TRACE: clssgmExitGrock: client 5315 (0x7f82ac06caa0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:54:16.098 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07d3d0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:54:16.098 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac07d3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:16.099 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d520 [ CSSD]2013-05-23 13:54:16.099 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d520) con(0x7f82ac036d20) skgpid ospid 3726 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:16.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:16.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:17.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:17.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:18.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:18.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:18.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:20.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:20.079 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:20.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:20.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:22.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:22.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:22.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:22.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:22.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:22.934 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d520) allocated [ CSSD]2013-05-23 13:54:22.935 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:54:22.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d520 - 1,2,3 [ CSSD]2013-05-23 13:54:22.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac07d520) pid(3815) version 11:1:1:4 [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac07d520), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac07d460, requested num -1 [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07dc30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:22.943 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:22.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:22.950 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:54:22.950 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07df30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:22.950 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac07df30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:23.153 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d520 [ CSSD]2013-05-23 13:54:23.153 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d520) con(0x7f82ac036d20) skgpid ospid 3815 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:24.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b5002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:24.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:24.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:24.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:25.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:54:25.867 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac003a60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:54:25.867 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac003a60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:54:25.867 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:54:25.868 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0387a0 [ CSSD]2013-05-23 13:54:25.868 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0387a0) con(0x7f82ac037890) skgpid 3384 ospid 3384 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:26.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:26.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:26.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:27.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:27.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:28.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:28.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b6002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:28.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:54:28.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:54:28.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:54:28.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:28.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b7002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:28.462 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:54:28.462 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:54:28.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:28.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:30.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:30.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:30.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:30.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:31.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:31.089 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:54:32.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:32.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:32.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:34.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b8002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:34.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:34.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:34.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:36.091 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:36.091 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:36.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:36.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:36.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:37.231 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0646f0) allocated [ CSSD]2013-05-23 13:54:37.232 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:54:37.232 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0646f0 - 1,2,3 [ CSSD]2013-05-23 13:54:37.232 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0646f0) pid(3960) version 11:1:1:4 [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0646f0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0645e0, requested num -1 [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:37.249 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:37.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:54:37.256 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:54:37.256 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0651d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:37.256 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0651d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:37.458 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0646f0 [ CSSD]2013-05-23 13:54:37.458 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0646f0) con(0x7f82ac036d20) skgpid ospid 3960 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:38.194 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac064f20) allocated [ CSSD]2013-05-23 13:54:38.195 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:54:38.195 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac064f20 - 1,2,3 [ CSSD]2013-05-23 13:54:38.195 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac064f20) pid(3975) version 11:1:1:4 [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac064f20), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac0645b0, requested num -1 [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac038030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:38.201 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:38.207 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:54:38.207 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:54:38.208 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0652a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:38.208 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0652a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:38.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:38.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac064f20 [ CSSD]2013-05-23 13:54:38.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac064f20) con(0x7f82ac036d20) skgpid ospid 3975 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:38.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:38.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:40.126 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:40.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:40.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:40.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:41.094 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:41.094 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:41.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b9002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:41.266 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:54:41.266 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:54:41.266 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:54:41.266 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:41.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ba002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:41.273 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:54:41.273 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:54:42.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:42.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:42.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:43.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03bb002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:43.717 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:54:43.717 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:54:43.717 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:54:43.717 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:43.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bc002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:43.726 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:54:43.726 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:54:44.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03bd002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:44.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:44.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:44.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:46.097 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:46.097 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:46.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:46.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:46.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:48.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:48.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:48.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:50.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:50.100 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:54:50.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:54:50.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:50.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:50.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:52.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:52.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:52.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:53.444 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0646f0) allocated [ CSSD]2013-05-23 13:54:53.445 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:54:53.446 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0646f0 - 1,2,3 [ CSSD]2013-05-23 13:54:53.446 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0646f0) pid(4151) version 11:1:1:4 [ CSSD]2013-05-23 13:54:53.462 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0646f0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:54:53.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:54:53.462 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0645e0, requested num -1 [ CSSD]2013-05-23 13:54:53.462 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:53.462 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:54:53.463 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:54:53.463 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:53.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:54:53.469 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:54:53.469 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0651d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:54:53.469 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0651d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:54:53.671 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0646f0 [ CSSD]2013-05-23 13:54:53.671 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0646f0) con(0x7f82ac036d20) skgpid ospid 4151 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:54:54.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03be002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:54.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:54.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:54.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:55.103 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:54:55.103 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:54:56.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:56.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:56.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:54:58.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:54:58.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03bf002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:58.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:54:58.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:54:58.969 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:54:58.969 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:54:58.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c0002b) incarnation(174631051) [ CSSD]2013-05-23 13:54:58.977 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:54:58.977 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:54:58.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:54:58.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:00.106 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:00.106 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:00.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:00.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:01.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:01.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:02.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:03.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:03.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:04.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c1002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:04.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:05.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:05.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:05.026 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0646f0) allocated [ CSSD]2013-05-23 13:55:05.026 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:55:05.027 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0646f0 - 1,2,3 [ CSSD]2013-05-23 13:55:05.027 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0646f0) pid(4302/4302) version 11:1:1:4 [ CSSD]2013-05-23 13:55:05.032 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0646f0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:55:05.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:05.032 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:55:05.032 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:55:05.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:05.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:06.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:06.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:06.641 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac038b80), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:55:06.641 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac038b80), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:55:06.641 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:55:06.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0646f0 [ CSSD]2013-05-23 13:55:06.642 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0646f0) con(0x7f82ac036d20) skgpid 4302 ospid 4302 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:07.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:07.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:08.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:08.708 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038740) allocated [ CSSD]2013-05-23 13:55:08.709 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:55:08.710 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038740 - 1,2,3 [ CSSD]2013-05-23 13:55:08.710 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac037890) proc(0x7f82ac038740) pid(4322) version 11:1:1:4 [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038740), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac038690, requested num -1 [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:55:08.716 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:08.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:55:08.723 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:55:08.723 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac065180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:08.724 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac065180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:55:08.926 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038740 [ CSSD]2013-05-23 13:55:08.926 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038740) con(0x7f82ac037890) skgpid ospid 4322 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:09.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:09.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:09.112 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:09.113 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:55:10.202 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:10.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:11.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:11.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:12.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:13.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:13.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:14.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:14.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:14.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c2002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:14.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c3002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:14.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:55:14.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:55:14.220 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:55:14.220 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:14.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c4002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:14.227 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:55:14.227 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:55:14.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:15.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:15.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:16.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:17.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:17.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:18.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:19.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:19.119 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:19.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:19.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:20.227 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:20.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:21.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:21.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:22.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:23.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:23.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:23.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0646f0) allocated [ CSSD]2013-05-23 13:55:23.964 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:55:23.964 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0646f0 - 1,2,3 [ CSSD]2013-05-23 13:55:23.964 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0646f0) pid(4464) version 11:1:1:4 [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0646f0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0645e0, requested num -1 [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:55:23.970 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:23.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:23.977 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:55:23.977 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0651d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:23.977 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0651d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:55:24.122 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:24.122 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:24.179 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0646f0 [ CSSD]2013-05-23 13:55:24.179 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0646f0) con(0x7f82ac036d20) skgpid ospid 4464 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:24.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c5002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:24.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:25.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:25.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:26.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:27.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:27.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:28.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:29.125 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:29.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:29.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:29.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:29.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c6002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:29.480 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:55:29.480 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:55:29.480 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:55:29.480 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:29.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c7002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:29.488 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:55:29.488 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:55:30.250 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:30.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:31.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:31.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:32.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:33.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:33.128 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:55:33.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:33.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:34.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c8002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:34.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:35.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:35.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:36.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:37.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:37.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:37.507 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac064690) allocated [ CSSD]2013-05-23 13:55:37.508 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:55:37.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac064690 - 1,2,3 [ CSSD]2013-05-23 13:55:37.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac064690) pid(4603) version 11:1:1:4 [ CSSD]2013-05-23 13:55:37.515 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac064690), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:55:37.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:37.515 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0645e0, requested num -1 [ CSSD]2013-05-23 13:55:37.515 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:37.515 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064e70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:55:37.516 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:55:37.516 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:37.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:37.522 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:55:37.522 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac065170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:37.522 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac065170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:55:37.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac064690 [ CSSD]2013-05-23 13:55:37.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac064690) con(0x7f82ac036d20) skgpid ospid 4603 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:38.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:38.132 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:38.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:39.208 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038a30) allocated [ CSSD]2013-05-23 13:55:39.209 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:55:39.209 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038a30 - 1,2,3 [ CSSD]2013-05-23 13:55:39.209 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac065cd0) proc(0x7f82ac038a30) pid(4618) version 11:1:1:4 [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038a30), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac065f10, requested num -1 [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0646d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:55:39.216 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:39.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:55:39.222 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:55:39.222 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0388f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:39.223 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0388f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:55:39.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:39.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:39.425 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038a30 [ CSSD]2013-05-23 13:55:39.425 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038a30) con(0x7f82ac065cd0) skgpid ospid 4618 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:40.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:40.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:41.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:41.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:41.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c9002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:41.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:55:41.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:55:41.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:55:41.532 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:41.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ca002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:41.539 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:55:41.539 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:55:42.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:43.135 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:43.135 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:43.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:43.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:44.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03cb002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:44.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03cc002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:44.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:55:44.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:55:44.742 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac037320/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:55:44.742 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:44.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cd002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:44.750 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:55:44.750 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0370f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:55:44.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:45.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:45.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:46.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:47.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:47.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:48.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:48.139 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:48.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:49.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:49.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:50.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:55:50.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:51.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:51.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:52.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:52.141 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:55:52.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:53.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:53.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:54.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ce002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:54.472 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac064690) allocated [ CSSD]2013-05-23 13:55:54.473 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:55:54.474 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac064690 - 1,2,3 [ CSSD]2013-05-23 13:55:54.474 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac064690) pid(4770) version 11:1:1:4 [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac064690), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0645e0, requested num -1 [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac064e70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:55:54.481 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:55:54.482 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:55:54.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:55:54.488 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:55:54.488 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac065170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:55:54.489 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac065170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:55:54.691 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac064690 [ CSSD]2013-05-23 13:55:54.691 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac064690) con(0x7f82ac036d20) skgpid ospid 4770 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:55:54.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:55.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:55.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:55.875 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0646f0) allocated [ CSSD]2013-05-23 13:55:55.876 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:55:55.876 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0646f0 - 1,2,3 [ CSSD]2013-05-23 13:55:55.876 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0646f0) pid(4817/4817) version 11:1:1:4 [ CSSD]2013-05-23 13:55:55.882 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0646f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:55:55.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:55:55.882 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:55:55.882 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 13:55:57.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:57.144 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:55:57.144 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:55:57.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:57.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:59.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:55:59.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:55:59.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:55:59.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03cf002b) incarnation(174631051) [ CSSD]2013-05-23 13:55:59.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:55:59.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:55:59.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac064e00/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:55:59.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:00.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d0002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:00.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:00.001 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac064bf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:00.320 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:01.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:01.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:01.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:02.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:02.147 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:03.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:03.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:03.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:04.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d1002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:05.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:05.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:05.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:07.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:07.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:07.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:07.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:07.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:08.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d2002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:08.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:56:08.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:56:08.575 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac064b00/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 13:56:08.575 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:08.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d3002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:08.583 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:08.583 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac064ed0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:08.716 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:56:08.716 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:56:08.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:56:08.718 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:56:09.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:09.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:09.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:09.726 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d520) allocated [ CSSD]2013-05-23 13:56:09.727 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:56:09.728 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d520 - 1,2,3 [ CSSD]2013-05-23 13:56:09.728 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0652a0) proc(0x7f82ac07d520) pid(4918) version 11:1:1:4 [ CSSD]2013-05-23 13:56:09.734 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac07d520), client(1/0x7f82ac06caa0) [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac06caa0 with con 0x7f82ac07d460, requested num -1 [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac07dd10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:56:09.735 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:09.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac06caa0) [ CSSD]2013-05-23 13:56:09.742 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac06caa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:56:09.742 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07e010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:09.742 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac07e010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:56:09.944 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d520 [ CSSD]2013-05-23 13:56:09.944 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d520) con(0x7f82ac0652a0) skgpid ospid 4918 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:10.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:11.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:11.153 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:56:11.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:11.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:11.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:13.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:13.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:13.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:14.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d4002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:15.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d5002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:15.245 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:56:15.245 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:56:15.245 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac064e00/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:56:15.245 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:15.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d6002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:15.253 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:15.253 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac064bf0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:15.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:15.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:15.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:16.017 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07d520) allocated [ CSSD]2013-05-23 13:56:16.018 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:56:16.018 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07d520 - 1,2,3 [ CSSD]2013-05-23 13:56:16.018 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0652a0) proc(0x7f82ac07d520) pid(5002/5002) version 11:1:1:4 [ CSSD]2013-05-23 13:56:16.026 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac07d520), client(1/0x7f82ac065f20) [ CSSD]2013-05-23 13:56:16.026 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac065f20) [ CSSD]2013-05-23 13:56:16.026 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 13:56:16.026 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac065f20) [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac065f20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac065f20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07d520 [ CSSD]2013-05-23 13:56:16.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07d520) con(0x7f82ac0652a0) skgpid 5002 ospid 5002 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:16.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:16.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:17.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:17.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:17.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:19.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:19.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:19.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:20.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:21.159 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:21.159 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:21.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001e30) [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001e30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06d7e0 [ CSSD]2013-05-23 13:56:21.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06d7e0) con(0x7f82ac06de40) skgpid 32154 ospid 32154 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:21.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:21.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:23.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:23.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:23.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:24.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d7002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:24.977 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac06cc80) allocated [ CSSD]2013-05-23 13:56:24.978 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:56:24.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac06cc80 - 1,2,3 [ CSSD]2013-05-23 13:56:24.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0027f0) proc(0x7f82ac06cc80) pid(5332) version 11:1:1:4 [ CSSD]2013-05-23 13:56:24.995 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac06cc80), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 13:56:24.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:56:24.996 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac000a40, requested num -1 [ CSSD]2013-05-23 13:56:24.996 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:24.996 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001040/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:56:24.996 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:56:24.996 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:25.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 13:56:25.002 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:56:25.002 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:25.002 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:56:25.204 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06cc80 [ CSSD]2013-05-23 13:56:25.204 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06cc80) con(0x7f82ac0027f0) skgpid ospid 5332 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:25.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:25.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:25.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac003a60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac003a60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0646f0 [ CSSD]2013-05-23 13:56:25.978 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0646f0) con(0x7f82ac036d20) skgpid 4817 ospid 4817 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:26.163 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:26.163 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:27.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:27.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:27.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:29.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:29.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:29.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:30.166 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:30.166 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:56:30.391 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:30.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d8002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:30.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:56:30.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:56:30.496 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:56:30.496 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:30.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d9002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:30.504 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:30.504 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:31.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:31.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:31.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:33.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:33.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:33.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:34.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03da002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:35.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:35.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:35.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:35.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:35.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:37.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:37.773 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001cb0) allocated [ CSSD]2013-05-23 13:56:37.774 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:56:37.775 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001cb0 - 1,2,3 [ CSSD]2013-05-23 13:56:37.775 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0027f0) proc(0x7f82ac001cb0) pid(5476) version 11:1:1:4 [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001cb0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0371a0, requested num -1 [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:56:37.782 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:37.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:37.789 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:56:37.789 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:37.789 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:56:37.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:37.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:37.992 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001cb0 [ CSSD]2013-05-23 13:56:37.992 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001cb0) con(0x7f82ac0027f0) skgpid ospid 5476 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:39.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:39.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:39.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:40.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:40.172 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:40.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:56:40.248 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:56:40.249 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:56:40.249 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001ee0) pid(5497) version 11:1:1:4 [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0371a0, requested num -1 [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:56:40.255 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:40.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:40.261 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:56:40.261 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:40.261 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:56:40.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:40.463 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:56:40.463 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac036d20) skgpid ospid 5497 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:41.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:41.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03db002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:41.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:56:41.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:56:41.787 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:56:41.787 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:41.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03dc002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:41.794 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:41.795 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:41.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:41.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:43.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:43.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:43.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:44.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03dd002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:45.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:45.175 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:45.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:45.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03de002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:45.748 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:56:45.748 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:56:45.748 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:56:45.748 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:45.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03df002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:45.756 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:56:45.756 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:56:45.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:45.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:47.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:47.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:47.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:49.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:49.178 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:56:49.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:49.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:49.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:50.438 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:56:51.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:52.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:52.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:53.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:54.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:54.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:54.181 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:54.181 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:54.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e0002b) incarnation(174631051) [ CSSD]2013-05-23 13:56:55.508 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001cb0) allocated [ CSSD]2013-05-23 13:56:55.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:56:55.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001cb0 - 1,2,3 [ CSSD]2013-05-23 13:56:55.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001cb0) pid(5672) version 11:1:1:4 [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001cb0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0027f0, requested num -1 [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:56:55.526 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:56:55.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:56:55.532 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:56:55.532 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:56:55.532 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:56:55.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:55.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001cb0 [ CSSD]2013-05-23 13:56:55.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001cb0) con(0x7f82ac036d20) skgpid ospid 5672 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:56:56.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:56.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:57.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:56:58.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:56:58.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:56:59.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:56:59.184 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:56:59.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:00.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:00.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:00.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:00.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e1002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:00.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:00.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:00.998 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:57:00.998 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:01.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e2002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:01.006 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:01.006 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:01.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:02.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:02.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:03.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:04.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:04.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:04.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:04.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:04.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e3002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:05.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:06.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:06.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:06.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:57:06.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:57:06.363 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:57:06.364 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:57:06.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e4002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:06.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:06.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:06.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac06d600/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 13:57:06.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 13:57:06.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e5002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:06.452 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:06.453 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:07.078 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:57:07.079 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:57:07.080 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:57:07.080 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001ee0) pid(5834) version 11:1:1:4 [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0371a0, requested num -1 [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:07.097 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:07.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:07.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:07.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:07.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:07.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:57:07.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac036d20) skgpid ospid 5834 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:07.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:08.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:08.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:09.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:09.191 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:09.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:10.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:10.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:10.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:10.772 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001cb0) allocated [ CSSD]2013-05-23 13:57:10.773 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:57:10.774 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001cb0 - 1,2,3 [ CSSD]2013-05-23 13:57:10.774 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001cb0) pid(5879) version 11:1:1:4 [ CSSD]2013-05-23 13:57:10.790 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001cb0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:10.790 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:10.790 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0027f0, requested num -1 [ CSSD]2013-05-23 13:57:10.790 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:10.790 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:10.791 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:10.791 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:10.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:10.797 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:10.797 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:10.797 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:11.000 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001cb0 [ CSSD]2013-05-23 13:57:11.000 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001cb0) con(0x7f82ac036d20) skgpid ospid 5879 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:11.846 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038af0) allocated [ CSSD]2013-05-23 13:57:11.847 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:57:11.847 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038af0 - 1,2,3 [ CSSD]2013-05-23 13:57:11.847 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac038af0) pid(5951) version 11:1:1:4 [ CSSD]2013-05-23 13:57:11.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:12.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:12.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:13.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:14.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:14.195 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:14.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:14.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:14.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e6002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:14.814 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038af0 [ CSSD]2013-05-23 13:57:14.814 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038af0) con(0x7f82ac036d20) skgpid ospid 5951 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:15.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:16.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e7002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:16.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:16.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:16.254 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:57:16.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:16.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e8002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:16.261 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:16.261 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:16.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:16.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:17.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:18.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:18.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:19.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:19.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:19.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:20.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:20.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:20.507 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:21.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:22.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:22.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:23.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:24.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:24.201 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:24.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:24.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:24.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e9002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:25.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:26.038 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001cb0) allocated [ CSSD]2013-05-23 13:57:26.039 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:57:26.039 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001cb0 - 1,2,3 [ CSSD]2013-05-23 13:57:26.039 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0027f0) proc(0x7f82ac001cb0) pid(6389) version 11:1:1:4 [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001cb0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0371a0, requested num -1 [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:26.046 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:26.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:26.055 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:26.055 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:26.055 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:26.257 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001cb0 [ CSSD]2013-05-23 13:57:26.257 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001cb0) con(0x7f82ac0027f0) skgpid ospid 6389 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:26.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:26.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:27.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:28.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:28.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:29.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:29.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:29.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:30.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:30.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:30.531 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:31.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ea002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:31.514 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:31.514 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:31.514 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:57:31.515 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:31.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03eb002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:31.522 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:31.522 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:31.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:32.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:32.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:34.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:34.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:34.208 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:34.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:34.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:34.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ec002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:36.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:36.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:36.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:36.555 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001cb0) allocated [ CSSD]2013-05-23 13:57:36.556 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:57:36.557 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001cb0 - 1,2,3 [ CSSD]2013-05-23 13:57:36.557 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001cb0) pid(6498) version 11:1:1:4 [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001cb0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0027f0, requested num -1 [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:36.564 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:36.572 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:36.572 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:36.572 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac002000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:36.573 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac002000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:36.775 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001cb0 [ CSSD]2013-05-23 13:57:36.775 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001cb0) con(0x7f82ac036d20) skgpid ospid 6498 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:38.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0388c0) allocated [ CSSD]2013-05-23 13:57:38.028 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:57:38.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0388c0 - 1,2,3 [ CSSD]2013-05-23 13:57:38.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0388c0) pid(6521) version 11:1:1:4 [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac0388c0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0027f0, requested num -1 [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0376e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:38.035 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:38.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:38.041 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:38.042 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001210) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:38.042 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001210) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:38.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:38.244 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0388c0 [ CSSD]2013-05-23 13:57:38.244 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0388c0) con(0x7f82ac036d20) skgpid ospid 6521 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:38.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:38.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:39.211 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:39.211 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:40.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:40.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:40.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:40.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:41.290 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac001ee0) allocated [ CSSD]2013-05-23 13:57:41.291 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:57:41.292 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac001ee0 - 1,2,3 [ CSSD]2013-05-23 13:57:41.292 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac001ee0) pid(6557) version 11:1:1:4 [ CSSD]2013-05-23 13:57:41.308 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac001ee0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0371a0, requested num -1 [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac037620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:41.309 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:41.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:41.316 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:41.316 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:41.316 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:41.519 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac001ee0 [ CSSD]2013-05-23 13:57:41.519 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac001ee0) con(0x7f82ac036d20) skgpid ospid 6557 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:42.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ed002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:42.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:42.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:42.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:57:42.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:42.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ee002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:42.063 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:42.063 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:42.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:42.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:42.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:44.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:44.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:44.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:44.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:44.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:44.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ef002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:46.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:46.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:46.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:46.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f0002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:46.777 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:57:46.777 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:57:46.777 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac06d600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:57:46.777 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:46.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f1002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:46.785 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:57:46.785 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac002720) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:57:46.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac006ab0) [ CSSD]2013-05-23 13:57:46.842 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac006ab0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 13:57:46.842 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac006ab0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 13:57:46.842 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac002a30) [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac002a30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac002a30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006b50 [ CSSD]2013-05-23 13:57:46.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006b50) con(0x7f82ac0076c0) skgpid 706 ospid 706 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:48.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:48.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:48.217 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:57:48.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:48.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:50.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:50.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:50.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:50.578 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:57:52.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:52.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:52.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:53.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:53.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:54.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:54.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:54.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:54.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f2002b) incarnation(174631051) [ CSSD]2013-05-23 13:57:56.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:56.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:56.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:57:56.553 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:57:56.554 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:57:56.554 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:57:56.554 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(6753) version 11:1:1:4 [ CSSD]2013-05-23 13:57:56.560 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:57:56.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:56.560 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:57:56.560 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:56.560 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:57:56.561 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:57:56.561 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:57:56.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:57:56.567 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:57:56.567 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:57:56.567 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:57:56.769 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:57:56.769 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 6753 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:57:58.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:57:58.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:57:58.224 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:57:58.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:57:58.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:00.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:00.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:00.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:00.603 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:02.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f3002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:02.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:58:02.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:58:02.039 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:58:02.039 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:02.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f4002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:02.047 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:58:02.047 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:58:02.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:02.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:02.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:03.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:03.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:04.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:04.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:04.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:04.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f5002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:06.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:06.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:06.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:08.229 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:08.229 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:08.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:08.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:08.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:10.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:10.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:10.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:10.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:11.807 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:11.808 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:58:11.809 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:11.809 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(6898) version 11:1:1:4 [ CSSD]2013-05-23 13:58:11.815 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:11.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:11.815 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:11.815 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:11.815 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:58:11.816 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:11.816 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:11.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:11.822 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:58:11.822 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:11.822 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:12.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:12.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 6898 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:12.231 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:12.232 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:58:12.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:12.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:12.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:14.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:14.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f6002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:14.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:14.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:16.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:16.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:16.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:17.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:17.235 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:17.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f7002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:17.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:58:17.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:58:17.290 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:58:17.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:17.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f8002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:17.297 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:58:17.298 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:58:18.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:18.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:18.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:20.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:20.656 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:20.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:20.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:22.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:22.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:22.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:22.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:22.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:24.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:24.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f9002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:24.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:24.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:26.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:26.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:26.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:27.058 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:27.059 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:58:27.060 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:27.060 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7046) version 11:1:1:4 [ CSSD]2013-05-23 13:58:27.076 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:27.077 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:27.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:27.085 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:58:27.085 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:27.085 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:27.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:27.241 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:27.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:27.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7046 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:28.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:28.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:28.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:29.494 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:29.495 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:58:29.496 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:29.496 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7105) version 11:1:1:4 [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:29.503 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:29.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:29.510 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 13:58:29.510 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 13:58:29.510 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:29.618 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002720) allocated [ CSSD]2013-05-23 13:58:29.619 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:58:29.620 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002720 - 1,2,3 [ CSSD]2013-05-23 13:58:29.620 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac077260) proc(0x7f82ac002720) pid(7110) version 11:1:1:4 [ CSSD]2013-05-23 13:58:29.636 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:58:29.639 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:58:29.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:58:29.642 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002720 [ CSSD]2013-05-23 13:58:29.642 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002720) con(0x7f82ac077260) skgpid ospid 7110 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:29.712 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:29.712 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7105 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:30.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:30.678 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:31.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:31.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:32.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:32.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:32.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:32.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03fa002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:32.542 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:58:32.542 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:58:32.542 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:58:32.542 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:32.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fb002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:32.549 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:58:32.549 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:58:33.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:33.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:34.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:34.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fc002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:35.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:35.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:36.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:37.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:37.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:37.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:37.248 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:38.288 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:38.289 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:58:38.290 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:38.290 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7167) version 11:1:1:4 [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:38.307 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:38.314 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:38.314 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:58:38.314 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:38.314 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:38.516 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:38.516 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7167 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:38.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:39.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:39.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:40.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:40.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:40.735 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:40.736 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:58:40.736 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:40.736 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac01c840) proc(0x7f82ac0024f0) pid(7205) version 11:1:1:4 [ CSSD]2013-05-23 13:58:41.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:41.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:41.322 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:41.322 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac01c840) skgpid ospid 7205 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:42.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:42.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:42.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03fd002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:42.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:58:42.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:58:42.312 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:58:42.312 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:42.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fe002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:42.319 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:58:42.319 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:58:42.320 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:42.321 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:58:42.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:42.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7356) version 11:1:1:4 [ CSSD]2013-05-23 13:58:42.327 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:42.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:42.327 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:42.327 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:42.327 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:58:42.328 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:42.328 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:42.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:42.333 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:58:42.333 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:42.333 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:42.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:42.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7356 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:42.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:43.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:43.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:44.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:44.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ff002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:45.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:45.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:46.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:47.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:47.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:47.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:47.254 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:47.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0400002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:47.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:58:47.802 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:58:47.802 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:58:47.802 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:47.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0401002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:47.809 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:58:47.809 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:58:48.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:49.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:49.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:50.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:51.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:51.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:51.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:51.257 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:58:52.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:52.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:58:53.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:53.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:54.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0402002b) incarnation(174631051) [ CSSD]2013-05-23 13:58:54.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:55.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:55.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:56.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:58:56.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:58:56.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:57.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:57.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:58:57.573 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:58:57.574 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:58:57.575 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:58:57.575 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7517) version 11:1:1:4 [ CSSD]2013-05-23 13:58:57.591 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:58:57.591 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:57.591 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:58:57.591 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:57.591 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:58:57.592 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:58:57.592 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:58:57.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:58:57.599 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:58:57.599 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:58:57.599 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:58:57.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:58:57.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7517 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:58:58.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:58:59.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:58:59.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:00.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:01.262 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:01.263 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:01.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:01.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:02.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:02.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:03.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0403002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:03.052 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:59:03.052 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:59:03.052 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:59:03.052 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:03.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0404002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:03.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:59:03.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:59:03.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:03.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:04.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0405002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:04.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:05.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:05.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:06.266 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:06.266 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:06.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:07.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:07.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:08.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:09.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:09.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:10.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:11.269 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:11.269 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:11.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:11.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:12.838 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:59:12.839 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:59:12.839 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:59:12.839 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7670) version 11:1:1:4 [ CSSD]2013-05-23 13:59:12.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82ac0024f0), client(1/0x7f82ac003a60) [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003a60 with con 0x7f82ac0370e0, requested num -1 [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:12.856 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:12.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a60) [ CSSD]2013-05-23 13:59:12.863 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:59:12.863 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac077180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:12.863 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac077180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:12.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:13.065 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:59:13.065 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7670 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:13.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:13.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:14.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0406002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:14.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:15.272 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:15.272 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:59:15.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:15.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:16.179 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0024f0) allocated [ CSSD]2013-05-23 13:59:16.180 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:59:16.180 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0024f0 - 1,2,3 [ CSSD]2013-05-23 13:59:16.180 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036d20) proc(0x7f82ac0024f0) pid(7733) version 11:1:1:4 [ CSSD]2013-05-23 13:59:16.299 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:59:16.300 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:59:16.301 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:59:16.301 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(7743) version 11:1:1:4 [ CSSD]2013-05-23 13:59:16.318 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:59:16.319 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 13:59:16.323 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:59:16.323 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 7743 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:16.401 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5316/0x7f82b41bf650) [ CSSD]2013-05-23 13:59:16.401 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5316 (0x7f82b41bf650) [ CSSD]2013-05-23 13:59:16.401 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:59:16.401 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:59:16.401 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 13:59:16.402 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:16.402 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 13:59:16.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5316 (0x7f82b41bf650) [ CSSD]2013-05-23 13:59:16.408 [1199044928] >TRACE: clssgmExitGrock: client 5316 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 13:59:16.408 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 13:59:16.409 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:16.409 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0024f0 [ CSSD]2013-05-23 13:59:16.409 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0024f0) con(0x7f82ac036d20) skgpid ospid 7733 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:17.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:17.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:17.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:18.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0407002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:18.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:59:18.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:59:18.302 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:59:18.302 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:18.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0408002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:18.308 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:59:18.308 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:59:19.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:19.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:19.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:20.275 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:20.275 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:21.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:21.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:21.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:22.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:23.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:23.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:23.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:24.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0409002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:25.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:25.279 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:25.279 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:25.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:25.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:27.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:27.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:27.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:28.105 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:59:28.106 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:59:28.106 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:59:28.106 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(7838) version 11:1:1:4 [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:28.113 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:28.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 13:59:28.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:59:28.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:28.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:28.322 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:59:28.322 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 7838 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:29.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:29.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:29.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:30.282 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:30.282 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:31.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:31.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:31.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:32.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:33.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:33.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040a002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:33.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:59:33.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:59:33.552 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:59:33.552 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:33.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040b002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:33.560 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:59:33.560 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:59:33.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:33.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:34.285 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:34.285 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:59:34.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040c002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:35.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:35.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:35.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:37.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:37.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:37.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:38.559 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:59:38.560 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 13:59:38.560 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:59:38.560 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(7963) version 11:1:1:4 [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:38.567 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:38.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 13:59:38.575 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:59:38.575 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:38.575 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:38.777 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:59:38.777 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 7963 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:39.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:39.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:39.288 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:39.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:39.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:41.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:41.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:41.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:42.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040d002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:42.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:59:42.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:59:42.563 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:59:42.564 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:42.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040e002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:42.570 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:59:42.570 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:59:42.924 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:43.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:43.364 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 13:59:43.365 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:59:43.366 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 13:59:43.366 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(8007) version 11:1:1:4 [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:43.372 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:43.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 13:59:43.379 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:59:43.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:43.379 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:43.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 13:59:43.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 8007 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:43.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:43.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:44.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:44.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:44.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040f002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:45.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:45.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:45.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:47.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:47.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:47.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:48.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0410002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:48.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 13:59:48.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 13:59:48.803 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 13:59:48.803 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:48.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0411002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:48.810 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 13:59:48.811 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 13:59:49.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:49.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:49.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:49.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:49.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:51.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:51.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:51.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:52.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 13:59:53.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:53.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:53.296 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 13:59:53.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:53.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:54.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0412002b) incarnation(174631051) [ CSSD]2013-05-23 13:59:55.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:55.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:55.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:57.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:57.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:57.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 13:59:58.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 13:59:58.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 13:59:58.626 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 13:59:58.626 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 13:59:58.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 13:59:58.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(8184) version 11:1:1:4 [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 13:59:58.644 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 13:59:58.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 13:59:58.651 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 13:59:58.651 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 13:59:58.651 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 13:59:58.854 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 13:59:58.854 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 8184 with 0 clients, refcount 0 [ CSSD]2013-05-23 13:59:59.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 13:59:59.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 13:59:59.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:01.045 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:00:01.046 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:01.046 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:00:01.046 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(6743/6743) version 11:1:1:4 [ CSSD]2013-05-23 14:00:01.064 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:00:01.064 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:00:01.064 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:00:01.064 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:00:01.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:01.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:01.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:02.964 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:03.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:03.302 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:03.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:03.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:03.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:04.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0413002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:04.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:04.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:04.054 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac002310/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:04.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:04.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0414002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:04.061 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:04.061 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:04.568 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 14:00:04.568 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:04.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 14:00:04.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4286740) pid(8475/8475) version 11:1:1:4 [ CSSD]2013-05-23 14:00:04.585 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4286740), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:00:04.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:00:04.585 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:00:04.585 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 14:00:04.921 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42c6340) skgpid 8475 ospid 8475 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:04.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0415002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:05.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:05.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:05.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:07.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:07.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:07.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:08.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:08.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:09.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:09.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:09.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:11.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:12.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:12.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:13.006 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:13.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:13.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:13.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:13.901 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 14:00:13.902 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:00:13.902 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 14:00:13.902 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b427c510) pid(8537) version 11:1:1:4 [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b427c510), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:00:13.909 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:13.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:13.917 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:00:13.917 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:13.917 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:00:14.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:14.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:14.120 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 14:00:14.120 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42a5440) skgpid ospid 8537 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:14.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0416002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:15.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:16.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:16.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac007130) [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac007130), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac012cd0 [ CSSD]2013-05-23 14:00:16.886 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac012cd0) con(0x7f82ac06d530) skgpid 2616 ospid 2616 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:17.310 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:17.310 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:00:17.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:18.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:18.066 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:19.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0417002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:19.304 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:19.304 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:19.304 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:19.304 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:19.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0418002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:19.311 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:19.311 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:19.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:20.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:20.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:21.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:22.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:22.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:22.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:22.314 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:22.420 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 14:00:22.420 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:22.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 14:00:22.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d9690) pid(8649/8649) version 11:1:1:4 [ CSSD]2013-05-23 14:00:22.437 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42d9690), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:00:22.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:00:22.437 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:00:22.437 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:00:22.699 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42d9690), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 14:00:22.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:00:22.699 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:00:22.699 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:00:23.031 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:23.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:24.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:24.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:25.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0419002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:25.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:26.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:26.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:27.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:27.317 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:27.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:28.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:28.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:29.155 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:00:29.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:00:29.156 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:00:29.156 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42c5f40) pid(8692) version 11:1:1:4 [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42c5f40), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:00:29.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:29.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:00:29.169 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:00:29.169 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:29.169 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:00:29.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:00:29.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b427c5d0) skgpid ospid 8692 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:29.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:30.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:30.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:31.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:00:31.579 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:00:31.579 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:00:31.579 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 14:00:31.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:00:31.587 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:00:31.588 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:00:31.588 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:00:31.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 14:00:31.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42c6340) skgpid 8649 ospid 8649 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:31.600 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 14:00:31.600 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:31.601 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 14:00:31.601 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207e50) pid(8752/8752) version 11:1:1:4 [ CSSD]2013-05-23 14:00:31.617 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207e50), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:00:31.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:00:31.617 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:00:31.617 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:00:31.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:32.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:32.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:32.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:32.320 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:33.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:33.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:34.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:34.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 14:00:34.429 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b427d8a0) skgpid 8752 ospid 8752 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:34.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041a002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:34.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:34.554 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:34.554 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:34.554 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:34.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041b002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:34.561 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:34.561 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:35.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041c002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:35.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:36.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:36.323 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:00:36.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:36.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:37.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:38.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:38.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:38.818 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 14:00:38.819 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:38.820 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 14:00:38.820 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b427c510) pid(8857) version 11:1:1:4 [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b427c510), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:00:38.837 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:38.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:00:38.844 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:00:38.844 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:38.844 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:00:39.046 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 14:00:39.046 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42c6340) skgpid ospid 8857 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:39.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:40.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:40.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:41.326 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:41.326 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:41.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:42.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:42.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:42.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041d002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:42.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:42.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:42.825 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:42.825 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:42.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041e002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:42.832 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:42.832 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:43.093 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:43.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:44.410 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 14:00:44.411 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:00:44.412 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 14:00:44.412 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5440) proc(0x7f82b42cbe70) pid(8925) version 11:1:1:4 [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42cbe70), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:00:44.418 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:44.425 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:00:44.425 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:00:44.425 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:44.425 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:00:44.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:44.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:44.627 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 14:00:44.627 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42a5440) skgpid ospid 8925 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:45.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041f002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:45.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:46.328 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:46.329 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:46.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:46.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:47.883 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 14:00:47.883 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:00:47.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 14:00:47.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4286740) pid(9020/9020) version 11:1:1:4 [ CSSD]2013-05-23 14:00:47.900 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4286740), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:00:47.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:00:47.900 [1199044928] >TRACE: clssgmRegisterShared: grp DG_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:00:47.900 [1199044928] >TRACE: clssgmRegisterShared: global grock DG_DATA member 0 share type 1, refcount 8 [ CSSD]2013-05-23 14:00:47.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_DATA, member 0 [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DG_DATA member 0 refcount is 7 [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 14:00:47.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b427d8a0) skgpid 9020 ospid 9020 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:00:48.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:48.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:49.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0420002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:49.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:49.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:49.805 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:49.805 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:49.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0421002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:49.811 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:49.812 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:49.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:50.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:50.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:51.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:51.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:51.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0422002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:51.852 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:00:51.852 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:00:51.852 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:00:51.852 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:51.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0423002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:51.860 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:00:51.861 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:00:51.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:52.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:52.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:53.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:00:53.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:54.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:54.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:55.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0424002b) incarnation(174631051) [ CSSD]2013-05-23 14:00:55.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:56.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:00:56.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:00:56.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:56.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:58.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:00:58.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:00:58.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:00:59.663 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 14:00:59.664 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:00:59.665 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 14:00:59.665 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d9690) pid(9105) version 11:1:1:4 [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42d9690), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:00:59.671 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:00:59.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:00:59.678 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:00:59.678 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:00:59.678 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:00:59.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 14:00:59.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42c6340) skgpid ospid 9105 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:00.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:00.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:00.337 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:01:00.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:00.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:02.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:02.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:02.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:03.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:04.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:04.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:04.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:05.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0425002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:05.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:05.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:05.054 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:01:05.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:05.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0426002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:05.061 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:05.061 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:05.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0427002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:05.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:05.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:06.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:06.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:06.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:08.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:08.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:08.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:08.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0428002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:08.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:08.865 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:08.865 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:01:08.865 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:08.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0429002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:08.872 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:08.872 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:08.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:01:09.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:01:09.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:01:09.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:01:10.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:10.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:10.343 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:10.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:10.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:12.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:12.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:12.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:13.180 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:14.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:14.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:14.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:14.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 14:01:14.917 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:01:14.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 14:01:14.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207c10) pid(9272) version 11:1:1:4 [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207c10), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:01:14.924 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:14.931 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:01:14.931 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:01:14.931 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:14.931 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:01:15.134 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 14:01:15.134 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d8a0) skgpid ospid 9272 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:15.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042a002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:15.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:15.346 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:15.518 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 14:01:15.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:01:15.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 14:01:15.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(9318/9318) version 11:1:1:4 [ CSSD]2013-05-23 14:01:15.536 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42cbe70), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:01:15.536 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:01:15.536 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:01:15.536 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 14:01:15.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid 9318 ospid 9318 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:16.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:16.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:16.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:18.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:18.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:18.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:20.208 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207e50) allocated [ CSSD]2013-05-23 14:01:20.208 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:01:20.209 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207e50 - 1,2,3 [ CSSD]2013-05-23 14:01:20.209 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207e50) pid(7475/7475) version 11:1:1:4 [ CSSD]2013-05-23 14:01:20.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:20.225 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207e50), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:01:20.225 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:01:20.225 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:01:20.225 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:01:20.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042b002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:20.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:20.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:20.315 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:01:20.315 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:20.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042c002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:20.321 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:20.321 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007600) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:20.349 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:20.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:20.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:20.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac012c30) [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac012c30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac012c30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac00f600) [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac00f600), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac00f600), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:01:21.413 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 14:01:21.414 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac06c970 [ CSSD]2013-05-23 14:01:21.414 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac06c970) con(0x7f82ac06c670) skgpid 1436 ospid 1436 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:21.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac002270) [ CSSD]2013-05-23 14:01:21.418 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac002270), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:01:21.418 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac002270), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:01:21.419 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 14:01:21.419 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac036810 [ CSSD]2013-05-23 14:01:21.419 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac036810) con(0x7f82ac00fd60) skgpid 3430 ospid 3430 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:22.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:22.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:22.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:23.205 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:24.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:24.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:24.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:25.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042d002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:25.351 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:25.352 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:26.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:26.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:26.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:28.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:28.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:28.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:30.167 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:01:30.168 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:01:30.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:01:30.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(9430) version 11:1:1:4 [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a3ea0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:01:30.175 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:30.182 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:01:30.182 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:01:30.182 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42833d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:30.182 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42833d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:01:30.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:30.355 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:30.355 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:30.384 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:01:30.384 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid ospid 9430 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:30.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:30.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:32.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:32.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:32.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:33.228 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:34.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:34.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:34.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:35.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042e002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:35.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:35.358 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:35.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042f002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:35.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:35.564 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:35.564 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:01:35.564 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:35.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0430002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:35.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:35.571 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:36.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:36.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:36.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:38.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:38.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:38.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:39.093 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:01:39.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:01:39.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:01:39.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42c5f40) pid(9531) version 11:1:1:4 [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:01:39.101 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:39.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:01:39.109 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:01:39.109 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:39.109 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:01:39.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:01:39.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b427d8a0) skgpid ospid 9531 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:40.361 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:40.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:40.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:40.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:40.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:42.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:42.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:42.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:43.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0431002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:43.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:43.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:43.084 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:01:43.084 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:43.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0432002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:43.091 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:43.091 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:43.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:44.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:44.364 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:01:44.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:44.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:44.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:45.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0433002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:45.419 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 14:01:45.420 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:01:45.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 14:01:45.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42583a0) pid(9595) version 11:1:1:4 [ CSSD]2013-05-23 14:01:45.437 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42583a0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:01:45.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:01:45.437 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 14:01:45.437 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:45.437 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:01:45.438 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:01:45.438 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:45.444 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:01:45.445 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:01:45.445 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:01:45.445 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:01:45.647 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 14:01:45.647 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b427d8a0) skgpid ospid 9595 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:01:46.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:46.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:46.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:48.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:48.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:48.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:49.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:49.367 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:50.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:50.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0434002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:50.814 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:01:50.814 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:01:50.814 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:01:50.814 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:01:50.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0435002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:50.822 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:01:50.822 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:01:50.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:50.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:52.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:52.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:52.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:53.283 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:01:54.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:54.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:01:54.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:54.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:54.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:55.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0436002b) incarnation(174631051) [ CSSD]2013-05-23 14:01:56.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:57.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:57.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:58.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:01:59.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:01:59.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:01:59.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:01:59.372 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:00.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:00.681 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 14:02:00.682 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:02:00.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 14:02:00.682 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42833d0) pid(9747) version 11:1:1:4 [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42833d0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42b3cd0, requested num -1 [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:02:00.688 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:00.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 14:02:00.694 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:02:00.694 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:00.694 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:02:00.897 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 14:02:00.897 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42cbf30) skgpid ospid 9747 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:01.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:01.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:01.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0437002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:01.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:01.826 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:01.826 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:01.826 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:01.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0438002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:01.833 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:01.833 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:02.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:03.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:03.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:03.305 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:04.089 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:02:04.089 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:02:04.090 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:02:04.090 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(9834/9834) version 11:1:1:4 [ CSSD]2013-05-23 14:02:04.106 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a3ea0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:02:04.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:02:04.106 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:02:04.106 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 14:02:04.122 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:02:04.122 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:02:04.122 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:02:04.122 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 14:02:04.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:02:04.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid 9834 ospid 9834 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:04.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:04.376 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:04.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:05.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:05.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:05.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0439002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:06.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043a002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:06.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:06.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:06.067 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:06.067 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:06.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043b002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:06.074 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:06.074 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:06.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:02:06.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:02:06.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:02:06.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:02:06.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:06.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043c002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:06.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:06.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:06.751 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:02:06.751 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:02:06.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043d002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:06.759 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:06.759 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:06.994 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207e50), client(2/0x7f82b4286810) [ CSSD]2013-05-23 14:02:06.994 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 14:02:06.994 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:02:06.994 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 14:02:07.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:07.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:08.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:09.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:09.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:09.378 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:09.379 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:10.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:11.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:11.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:11.413 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:02:11.413 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:02:11.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:02:11.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(9920) version 11:1:1:4 [ CSSD]2013-05-23 14:02:12.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:13.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:13.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:13.327 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:14.110 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:02:14.110 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid ospid 9920 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:14.381 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:14.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:14.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:15.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:15.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:15.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043e002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:15.930 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:02:15.930 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:02:15.931 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:02:15.931 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(10291) version 11:1:1:4 [ CSSD]2013-05-23 14:02:15.936 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a3ea0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:02:15.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:02:15.936 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ae3f0, requested num -1 [ CSSD]2013-05-23 14:02:15.937 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:15.937 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:02:15.937 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:02:15.937 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:15.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:02:15.943 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:02:15.943 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:15.943 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:02:16.146 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:02:16.146 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid ospid 10291 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:16.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:17.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:17.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:18.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:19.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:19.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:19.384 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:19.384 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:20.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:21.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:21.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:21.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043f002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:21.321 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:21.321 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:21.321 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:21.321 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:21.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0440002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:21.327 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:21.327 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:22.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:23.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:23.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:23.348 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:24.387 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:24.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:24.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:25.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:25.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:25.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0441002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:26.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:27.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:27.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:28.390 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:28.390 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:02:28.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:29.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:29.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:30.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:31.179 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 14:02:31.180 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:02:31.181 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 14:02:31.181 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42583a0) proc(0x7f82b42b3cd0) pid(10479) version 11:1:1:4 [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42b3cd0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d340, requested num -1 [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:02:31.187 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:31.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:02:31.194 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:02:31.194 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:31.194 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:02:31.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:31.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:31.396 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 14:02:31.396 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42583a0) skgpid ospid 10479 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:32.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:33.370 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:33.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:33.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:33.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:33.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:34.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:35.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:35.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:35.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0442002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:36.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0443002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:36.570 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:36.570 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:36.570 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:36.570 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:36.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0444002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:36.578 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:36.578 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:37.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:37.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:37.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:38.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:38.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:39.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:39.359 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:02:39.360 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:02:39.361 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:02:39.361 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(10572) version 11:1:1:4 [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ae3f0, requested num -1 [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:02:39.367 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:39.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:02:39.374 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:02:39.374 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:39.374 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:02:39.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:39.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:39.577 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:02:39.577 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 10572 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:41.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:41.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:41.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:43.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:43.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0445002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:43.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:43.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:43.352 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:43.352 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:43.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0446002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:43.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:43.360 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:43.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:43.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:43.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:43.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:43.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:45.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:45.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0447002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:45.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:45.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:46.440 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:02:46.441 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:02:46.442 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:02:46.442 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(10633) version 11:1:1:4 [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a3ea0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:02:46.448 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:46.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:02:46.456 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:02:46.456 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:02:46.456 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:02:46.658 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:02:46.658 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid ospid 10633 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:47.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:47.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:47.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:48.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:48.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:49.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:49.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:49.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:51.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:51.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:51.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:51.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0448002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:51.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:02:51.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:02:51.821 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:02:51.822 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:02:51.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0449002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:51.829 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:02:51.829 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:02:52.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:52.405 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:02:53.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:53.428 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:02:53.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:53.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:55.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:55.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044a002b) incarnation(174631051) [ CSSD]2013-05-23 14:02:55.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:55.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 31 [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:02:56.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 6743 ospid 6743 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:02:57.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:57.407 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:02:57.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:02:57.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:57.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:02:59.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:02:59.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:02:59.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:01.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:01.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:03:01.693 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:03:01.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:03:01.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(10815) version 11:1:1:4 [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207a80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:01.700 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:01.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:01.707 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:03:01.707 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:01.707 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:01.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:01.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:01.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:03:01.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 10815 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:02.410 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:02.411 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:03.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:03.453 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:03.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:03.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:05.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:05.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044b002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:05.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:05.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:07.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044c002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:07.072 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:03:07.072 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:03:07.072 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:03:07.072 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:07.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044d002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:07.079 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:03:07.079 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:03:07.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:07.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:07.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:07.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:07.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:09.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:09.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:09.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:11.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:11.416 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:11.416 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:03:11.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:11.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:13.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:13.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:13.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:13.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:15.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:15.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044e002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:15.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:15.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:16.419 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:16.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:16.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:03:16.944 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:03:16.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:03:16.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(10968) version 11:1:1:4 [ CSSD]2013-05-23 14:03:16.950 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:16.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:16.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 14:03:16.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:16.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:03:16.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:16.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:16.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:16.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:03:16.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42db990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:16.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42db990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:17.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:03:17.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 10968 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:17.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:17.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:17.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:19.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:19.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:19.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:21.422 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:21.422 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:21.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:21.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:21.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:22.213 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:03:22.214 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:22.214 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:03:22.214 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(10677/10677) version 11:1:1:4 [ CSSD]2013-05-23 14:03:22.230 [1199044928] >TRACE: clssgmRegisterClient: proc(62/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:03:22.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:03:22.230 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:03:22.230 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 32 [ CSSD]2013-05-23 14:03:22.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044f002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:22.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:03:22.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:03:22.334 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:03:22.334 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:22.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0450002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:22.341 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:03:22.342 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:03:23.510 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:23.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:23.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:23.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:25.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:25.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0451002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:25.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:25.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:26.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:26.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:27.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:27.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:27.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:28.810 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 14:03:28.811 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:28.811 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 14:03:28.811 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42583a0) pid(11093/11093) version 11:1:1:4 [ CSSD]2013-05-23 14:03:28.817 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42583a0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:28.817 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:28.818 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:03:28.818 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 14:03:28.855 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4257120) skgpid 11093 ospid 11093 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:29.045 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:03:29.046 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:29.047 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:03:29.047 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a3ea0) pid(11096/11096) version 11:1:1:4 [ CSSD]2013-05-23 14:03:29.052 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a3ea0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:03:29.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:03:29.052 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:03:29.052 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:03:29.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4257120) skgpid 11096 ospid 11096 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:29.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:29.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 14:03:29.796 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:29.797 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 14:03:29.797 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c5f40) proc(0x7f82b42b3cd0) pid(11106) version 11:1:1:4 [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42b3cd0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b00d0 with con 0x7f82b427d340, requested num -1 [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:29.804 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:29.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:03:29.812 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:03:29.812 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:03:29.812 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:29.922 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 14:03:29.923 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:29.924 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 14:03:29.924 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d340) proc(0x7f82b429dfe0) pid(11111) version 11:1:1:4 [ CSSD]2013-05-23 14:03:29.938 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:03:29.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:03:29.941 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:03:29.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 14:03:29.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b427d340) skgpid ospid 11111 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:29.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:29.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:30.014 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 14:03:30.014 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c5f40) skgpid ospid 11106 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:31.429 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:31.429 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:31.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:31.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:31.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:32.200 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:03:32.201 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:03:32.202 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:03:32.202 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11130) version 11:1:1:4 [ CSSD]2013-05-23 14:03:32.208 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:32.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:32.208 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ae3f0, requested num -1 [ CSSD]2013-05-23 14:03:32.208 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:32.208 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:03:32.209 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:32.209 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:32.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:03:32.216 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:03:32.216 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:32.216 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:32.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:03:32.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11130 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:33.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:33.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:34.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:34.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:35.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:35.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0452002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:36.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:36.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:36.432 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:36.432 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:37.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0453002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:37.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:03:37.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:03:37.595 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:03:37.595 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:37.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0454002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:37.602 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:03:37.602 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:03:37.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:38.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:38.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:39.624 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:03:39.625 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:39.625 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:03:39.625 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(11229) version 11:1:1:4 [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:39.632 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:39.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:39.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:03:39.639 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:03:39.639 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:39.639 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:39.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:03:39.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid ospid 11229 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:40.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:40.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:41.238 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:03:41.239 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:03:41.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:03:41.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11261) version 11:1:1:4 [ CSSD]2013-05-23 14:03:41.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:41.436 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:41.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:41.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:03:41.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11261 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:42.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:42.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:43.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:43.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0455002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:43.616 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:03:43.616 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:03:43.616 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:03:43.616 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:43.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0456002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:43.624 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:03:43.624 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:03:43.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:44.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:44.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:45.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0457002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:45.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:46.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:46.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:46.439 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:46.439 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:47.459 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:03:47.461 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:03:47.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:03:47.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11469) version 11:1:1:4 [ CSSD]2013-05-23 14:03:47.467 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:47.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:47.467 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 14:03:47.467 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:47.467 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:03:47.468 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:03:47.468 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:47.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:03:47.474 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:03:47.474 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:03:47.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:03:47.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:03:47.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11469 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:03:47.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:48.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:48.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:49.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:50.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:50.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:51.442 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:51.442 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:51.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:52.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:52.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:52.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0458002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:52.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:03:52.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:03:52.847 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:03:52.847 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:03:52.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0459002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:52.854 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:03:52.854 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:03:53.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:54.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:54.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:55.671 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:03:55.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045a002b) incarnation(174631051) [ CSSD]2013-05-23 14:03:55.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:56.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:56.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:56.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:03:56.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:03:57.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:03:58.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:03:58.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:03:59.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:00.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:00.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:01.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:01.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:01.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:02.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:02.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:02.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:04:02.714 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:04:02.714 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:04:02.714 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11653) version 11:1:1:4 [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ae3d0, requested num -1 [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:02.720 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:02.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:04:02.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:04:02.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:02.729 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:02.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:04:02.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11653 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:03.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:04.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:04.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:05.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045b002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:05.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:05.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:06.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:06.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:06.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:06.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:07.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:08.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045c002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:08.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:04:08.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:04:08.097 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:04:08.097 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:08.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045d002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:08.104 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:04:08.104 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:04:08.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:08.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:09.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:10.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:10.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:11.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:11.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:11.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:12.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:12.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:13.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:14.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:14.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:15.723 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:15.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045e002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:15.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:16.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:16.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:16.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:16.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:16.498 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:04:16.499 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:04:16.500 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:04:16.500 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11792) version 11:1:1:4 [ CSSD]2013-05-23 14:04:16.619 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ad0) allocated [ CSSD]2013-05-23 14:04:16.620 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:04:16.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ad0 - 1,2,3 [ CSSD]2013-05-23 14:04:16.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d400) proc(0x7f82b42a3ad0) pid(11802) version 11:1:1:4 [ CSSD]2013-05-23 14:04:16.637 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:04:16.638 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:04:16.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ad0 [ CSSD]2013-05-23 14:04:16.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ad0) con(0x7f82b427d400) skgpid ospid 11802 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5317/0x7f82b41bf650) [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5317 (0x7f82b41bf650) [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:16.721 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:04:16.729 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5317 (0x7f82b41bf650) [ CSSD]2013-05-23 14:04:16.729 [1199044928] >TRACE: clssgmExitGrock: client 5317 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:04:16.729 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:04:16.729 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:16.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:04:16.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11792 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:17.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:17.976 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:04:17.977 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:04:17.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:04:17.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f60) proc(0x7f82b42c5f40) pid(11825) version 11:1:1:4 [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ae3f0, requested num -1 [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:17.984 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:17.992 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:04:17.992 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:04:17.992 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:17.992 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:18.194 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:04:18.194 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42a3f60) skgpid ospid 11825 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:18.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:18.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:19.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:20.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:20.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:21.461 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:21.461 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:21.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:22.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:22.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:23.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045f002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:23.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:04:23.347 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:04:23.347 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:04:23.348 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:23.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0460002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:23.356 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:04:23.356 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:04:23.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:24.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:24.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:25.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0461002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:25.754 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:25.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:26.464 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:26.464 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:26.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:26.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:28.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:28.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:28.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:30.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:30.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:30.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:31.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:31.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:32.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:32.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:32.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:33.232 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:04:33.233 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:04:33.233 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:04:33.233 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c5f40) pid(11973) version 11:1:1:4 [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b3dc0, requested num -1 [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:33.250 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:33.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:04:33.257 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:04:33.257 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:33.257 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:33.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:04:33.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4207cd0) skgpid ospid 11973 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:34.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:34.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:34.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:35.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:35.469 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:04:35.815 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:35.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0462002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:36.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:36.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:36.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:38.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:38.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:38.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:38.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0463002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:38.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:04:38.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:04:38.598 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:04:38.598 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:38.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0464002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:38.605 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:04:38.605 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:04:39.474 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 14:04:39.475 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:04:39.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 14:04:39.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(11581/11581) version 11:1:1:4 [ CSSD]2013-05-23 14:04:39.480 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42c5f40), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:04:39.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:04:39.481 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:04:39.481 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 14:04:39.886 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:04:39.887 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:04:39.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:04:39.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3ad0) proc(0x7f82b42c7c00) pid(12052) version 11:1:1:4 [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257560, requested num -1 [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:39.895 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:39.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:04:39.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:04:39.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:39.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:40.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:04:40.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a3ad0) skgpid ospid 12052 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:40.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:40.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:40.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:40.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:40.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:42.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:42.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:42.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:43.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0465002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:43.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:04:43.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:04:43.870 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:04:43.870 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:43.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0466002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:43.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:04:43.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:04:44.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:44.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:44.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:45.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:45.475 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:45.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:45.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0467002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:46.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:46.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:46.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:48.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:48.501 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 14:04:48.502 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:04:48.503 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 14:04:48.503 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42574b0) proc(0x7f82b429dfe0) pid(12121) version 11:1:1:4 [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429dfe0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b429dc40, requested num -1 [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:04:48.509 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:48.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:04:48.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:04:48.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5b40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:04:48.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5b40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:04:48.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:48.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:48.719 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 14:04:48.719 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b42574b0) skgpid ospid 12121 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:04:50.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:50.478 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:50.478 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:50.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:50.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:52.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:52.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:52.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:53.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0468002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:53.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:04:53.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:04:53.851 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:04:53.851 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:04:53.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0469002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:53.859 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:04:53.859 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:04:54.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:54.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:54.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:55.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:04:55.482 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:04:55.866 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:04:55.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046a002b) incarnation(174631051) [ CSSD]2013-05-23 14:04:56.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:56.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:56.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:04:58.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:04:58.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:04:58.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:00.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:00.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:00.485 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:00.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:00.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:02.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:02.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:02.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:03.766 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:03.767 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:05:03.768 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:03.768 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42573d0) proc(0x7f82b42c7c00) pid(12272) version 11:1:1:4 [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:05:03.784 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:03.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:05:03.791 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:05:03.791 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:03.791 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:05:03.994 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:03.994 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42573d0) skgpid ospid 12272 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:04.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:04.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:04.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:05.038 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:05.038 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:05:05.039 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:05.039 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3ad0) proc(0x7f82b42c7c00) pid(12324/12324) version 11:1:1:4 [ CSSD]2013-05-23 14:05:05.045 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:05:05.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:05:05.045 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:05:05.045 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:05:05.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:05:05.348 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:05:05.348 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:05:05.348 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:05:05.349 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:05.349 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a3ad0) skgpid 12324 ospid 12324 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:05.488 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:05.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:05.889 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:05.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046b002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:06.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:06.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:06.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:08.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:08.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:08.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:09.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046c002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:09.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:05:09.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:05:09.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:05:09.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:09.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046d002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:09.112 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:05:09.112 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:05:10.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:10.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:10.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:10.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:10.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:12.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:12.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:12.811 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:14.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:14.494 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:14.495 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:05:14.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:14.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:15.914 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:15.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046e002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:16.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:16.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:16.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:18.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:18.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:18.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:19.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:19.029 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:05:19.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:19.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42c7c00) pid(12427) version 11:1:1:4 [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b429dac0, requested num -1 [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:05:19.036 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:19.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:05:19.043 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:05:19.043 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:19.043 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:05:19.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:19.245 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a8fc0) skgpid ospid 12427 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:19.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:19.498 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:20.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:20.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:20.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:22.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:22.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:22.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:24.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046f002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:24.356 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:05:24.356 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:05:24.357 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:05:24.357 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:24.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0470002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:24.365 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:05:24.365 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:05:24.501 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:24.502 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:24.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:24.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:24.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:25.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:25.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0471002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:26.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:26.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:26.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:28.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:28.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:28.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:29.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:29.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:30.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:30.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:30.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:32.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:33.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:33.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:33.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:33.508 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:05:34.278 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:34.279 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:05:34.279 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:34.279 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42573d0) proc(0x7f82b42c7c00) pid(12580) version 11:1:1:4 [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b42a3c60, requested num -1 [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:05:34.296 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:34.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:05:34.303 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:05:34.303 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:34.303 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:05:34.506 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:34.506 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42573d0) skgpid ospid 12580 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:34.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:35.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:35.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:35.963 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:35.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0472002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:36.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:37.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:37.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:38.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:38.511 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:38.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:39.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:39.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:39.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0473002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:39.608 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:05:39.608 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:05:39.608 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:05:39.608 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:39.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0474002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:39.616 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:05:39.616 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:05:40.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:40.143 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:05:40.144 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:40.144 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c7c00) pid(12663) version 11:1:1:4 [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b429dac0, requested num -1 [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:05:40.150 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:40.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:05:40.157 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:05:40.157 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e0b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:40.157 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e0b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:05:40.360 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:40.360 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b4207cd0) skgpid ospid 12663 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:40.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:41.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:41.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:42.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:43.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:43.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:43.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:43.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:44.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0475002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:44.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:05:44.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:05:44.129 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:05:44.130 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:44.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0476002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:44.137 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:05:44.137 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:05:44.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:45.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:45.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:45.990 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:46.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0477002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:46.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:47.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:47.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:48.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:48.517 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:48.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:49.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:49.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:49.543 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:05:49.543 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:05:49.544 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:05:49.544 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42c7c00) pid(12741) version 11:1:1:4 [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b429dfe0, requested num -1 [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:05:49.549 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:49.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:05:49.556 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:05:49.556 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:05:49.556 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:05:49.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:05:49.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b4207cd0) skgpid ospid 12741 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:05:50.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:51.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:51.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:52.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:53.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:53.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:53.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:53.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:54.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:54.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0478002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:54.861 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:05:54.861 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:05:54.861 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:05:54.862 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:05:54.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0479002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:54.869 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:05:54.869 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:05:55.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:55.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:56.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:05:56.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047a002b) incarnation(174631051) [ CSSD]2013-05-23 14:05:56.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:57.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:57.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:05:58.524 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:05:58.524 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:05:58.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:05:59.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:05:59.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:00.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:01.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:01.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:02.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:03.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:03.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:03.527 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:03.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:04.802 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dac0) allocated [ CSSD]2013-05-23 14:06:04.803 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:06:04.803 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dac0 - 1,2,3 [ CSSD]2013-05-23 14:06:04.803 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429dac0) pid(12931) version 11:1:1:4 [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b429dac0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c7cb0, requested num -1 [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:06:04.810 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:04.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:06:04.816 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:06:04.816 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:04.816 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:06:04.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:05.018 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dac0 [ CSSD]2013-05-23 14:06:05.018 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dac0) con(0x7f82b42a9150) skgpid ospid 12931 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:05.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:05.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:06.036 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:06.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047b002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:06.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:07.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:07.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:08.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:08.531 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:08.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:09.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047c002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:09.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:09.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:09.164 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:06:09.164 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:09.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047d002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:09.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:09.171 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:09.301 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:06:09.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:06:09.303 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:06:09.304 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:06:09.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:09.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:10.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047e002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:10.115 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:10.115 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:10.115 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:06:10.115 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:10.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047f002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:10.122 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:10.122 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:10.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:11.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:11.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:12.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:13.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:13.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:13.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:13.534 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:14.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:15.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:15.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:16.023 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:06:16.023 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:06:16.024 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:06:16.024 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42c7c00) pid(13044/13044) version 11:1:1:4 [ CSSD]2013-05-23 14:06:16.041 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:06:16.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:06:16.041 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:06:16.041 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:06:16.060 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:06:16.062 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a8fc0) skgpid 13044 ospid 13044 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:16.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0480002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:16.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:17.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:17.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:18.537 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:18.537 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:18.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:19.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:19.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:20.055 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:06:20.056 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:06:20.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:06:20.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42c7c00) pid(13073) version 11:1:1:4 [ CSSD]2013-05-23 14:06:20.062 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:06:20.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:06:20.063 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42cf950, requested num -1 [ CSSD]2013-05-23 14:06:20.063 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:20.063 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:06:20.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:06:20.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:20.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:06:20.070 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:06:20.070 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429db90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:20.070 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429db90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:06:20.273 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:06:20.273 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a8fc0) skgpid ospid 13073 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:21.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:21.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:21.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:23.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:23.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:23.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:23.540 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:23.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:25.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:25.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0481002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:25.365 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:25.365 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:25.365 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:06:25.365 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:25.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0482002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:25.373 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:25.373 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:25.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:25.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:26.084 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:26.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0483002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:27.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:27.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:27.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:28.544 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:28.544 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:29.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:29.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:29.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:31.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:31.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:31.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:32.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:32.547 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:06:33.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:33.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:33.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:35.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:35.318 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 14:06:35.319 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:06:35.320 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 14:06:35.320 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42573d0) proc(0x7f82b42c7c00) pid(13226) version 11:1:1:4 [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7c00), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b42a3c60, requested num -1 [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:06:35.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:35.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:06:35.344 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:06:35.344 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:35.344 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:06:35.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 14:06:35.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42573d0) skgpid ospid 13226 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:35.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:35.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:35.638 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:06:35.639 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:06:35.640 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:06:35.640 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42573d0) pid(13128/13128) version 11:1:1:4 [ CSSD]2013-05-23 14:06:35.660 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42573d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:06:35.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:06:35.660 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:06:35.660 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:06:36.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:36.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0484002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:37.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:37.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:37.550 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:37.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:37.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:39.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:39.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:39.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:40.402 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 14:06:40.403 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:06:40.403 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 14:06:40.403 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cfa20) proc(0x7f82b42b45f0) pid(13304) version 11:1:1:4 [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b45f0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:06:40.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:40.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:06:40.417 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:06:40.417 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:40.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:06:40.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0485002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:40.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:40.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:40.615 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:06:40.615 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:40.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 14:06:40.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b42cfa20) skgpid ospid 13304 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:40.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0486002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:40.624 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:40.624 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:41.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:41.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:41.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:42.553 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:42.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:43.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:43.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:43.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:44.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0487002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:44.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:44.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:44.388 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:06:44.388 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:44.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0488002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:44.395 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:44.395 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:45.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:45.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:45.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:46.131 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:46.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0489002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:47.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:47.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:47.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:47.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:47.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:49.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:49.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:49.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:50.583 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:06:50.584 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:06:50.585 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:06:50.585 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(13403) version 11:1:1:4 [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b429e6d0, requested num -1 [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:06:50.591 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:50.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:06:50.596 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:06:50.597 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:06:50.597 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:06:50.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:06:50.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 13403 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:06:51.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:51.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:51.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:52.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:52.558 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:06:53.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:53.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:53.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:55.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:55.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:55.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:55.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048a002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:55.868 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:06:55.868 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:06:55.868 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:06:55.868 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:06:55.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048b002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:55.876 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:06:55.876 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:06:56.158 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:06:56.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048c002b) incarnation(174631051) [ CSSD]2013-05-23 14:06:56.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:06:56.561 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:06:57.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:57.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:57.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:06:59.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:06:59.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:06:59.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:01.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:01.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:01.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:01.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:01.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:03.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:03.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:03.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:05.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:05.833 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:07:05.834 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:07:05.835 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:07:05.835 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e0c0) proc(0x7f82b429e6d0) pid(13557) version 11:1:1:4 [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:05.840 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:05.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:05.846 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:05.846 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:05.846 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:05.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:05.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:06.049 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:07:06.049 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429e0c0) skgpid ospid 13557 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:06.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:06.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048d002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:06.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:06.568 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:06.976 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:07:06.976 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:07:06.977 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:07:06.978 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:07:07.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048e002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:07.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:07.054 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:07.054 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:07:07.054 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:07:07.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048f002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:07.063 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:07.063 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:07.426 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 14:07:07.427 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:07:07.428 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 14:07:07.428 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7bf0) proc(0x7f82b42b45f0) pid(13614) version 11:1:1:4 [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b45f0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:07.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:07.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:07.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:07.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:07.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:07.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:07.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 14:07:07.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b42c7bf0) skgpid ospid 13614 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:07.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:07.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:09.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:09.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:09.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:11.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0490002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:11.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:11.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:11.125 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:07:11.125 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:11.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0491002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:11.132 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:11.132 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:11.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:11.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:11.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:11.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:11.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:11.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:07:11.990 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:07:11.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:07:11.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(13688) version 11:1:1:4 [ CSSD]2013-05-23 14:07:13.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:13.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:13.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:14.562 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:07:14.562 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 13688 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:15.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:15.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:15.574 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:07:15.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:15.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:16.213 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:16.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0492002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:17.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:17.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:17.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:19.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:20.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:20.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:20.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:20.577 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:21.091 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:07:21.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:07:21.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:07:21.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14045) version 11:1:1:4 [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:21.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:21.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:07:21.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:21.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:21.107 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:21.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:07:21.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 14045 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:21.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:22.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:22.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:23.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:24.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:24.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:25.581 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:25.581 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:25.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:26.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:26.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:26.234 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:26.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0493002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:26.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0494002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:26.375 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:26.375 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:26.375 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:07:26.375 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:26.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0495002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:26.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:26.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:27.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:28.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:28.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:29.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:30.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:30.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:30.584 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:30.584 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:31.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:32.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:32.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:33.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:34.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:34.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:34.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:34.587 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:07:35.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:36.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:36.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:36.256 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:36.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0496002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:36.344 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:07:36.345 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:07:36.346 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:07:36.346 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14201) version 11:1:1:4 [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:36.352 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:36.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:07:36.360 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:36.360 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:36.360 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:36.562 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:07:36.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 14201 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:36.906 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e0b0) allocated [ CSSD]2013-05-23 14:07:36.906 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:07:36.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e0b0 - 1,2,3 [ CSSD]2013-05-23 14:07:36.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cfae0) proc(0x7f82b429e0b0) pid(14242) version 11:1:1:4 [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e0b0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42a51d0, requested num -1 [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:36.913 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:36.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:07:36.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:36.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:36.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:37.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e0b0 [ CSSD]2013-05-23 14:07:37.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e0b0) con(0x7f82b42cfae0) skgpid ospid 14242 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:37.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:38.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:38.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:39.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:39.591 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:39.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:40.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:40.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:40.657 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:07:40.658 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:07:40.658 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:07:40.658 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14274) version 11:1:1:4 [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:40.665 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:40.672 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:07:40.672 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:40.672 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e6d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:40.672 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e6d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:40.874 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:07:40.874 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 14274 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:41.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0497002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:41.624 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:41.624 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:41.624 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:07:41.624 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:41.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0498002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:41.632 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:41.632 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:41.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:42.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:42.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:43.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:44.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:44.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:44.594 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:44.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:44.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0499002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:44.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:44.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:44.646 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:07:44.646 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:44.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049a002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:44.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:44.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:45.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:46.277 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:46.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:46.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:46.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049b002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:47.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:48.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:48.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:49.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:49.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:49.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:50.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:50.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:51.602 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:07:51.604 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:07:51.604 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:07:51.604 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cfa20) proc(0x7f82b429e6d0) pid(14361) version 11:1:1:4 [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:07:51.612 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:51.621 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:07:51.621 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:07:51.621 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:07:51.621 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:07:51.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:51.824 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:07:51.824 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42cfa20) skgpid ospid 14361 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:07:52.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:52.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:53.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:53.600 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:07:53.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:54.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:54.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:55.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:56.299 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:07:56.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049c002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:56.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:56.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:56.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049d002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:56.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:07:56.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:07:56.876 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:07:56.876 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:07:56.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049e002b) incarnation(174631051) [ CSSD]2013-05-23 14:07:56.882 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:07:56.882 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:07:57.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:07:58.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:07:58.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:07:58.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:07:58.603 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:07:59.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:00.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:00.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:01.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:02.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:02.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:03.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:03.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:03.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:04.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:04.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:05.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:06.321 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:06.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049f002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:06.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:06.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:06.857 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:08:06.858 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:08:06.859 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:08:06.859 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14506) version 11:1:1:4 [ CSSD]2013-05-23 14:08:06.865 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:06.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:06.866 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b429e850, requested num -1 [ CSSD]2013-05-23 14:08:06.866 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:06.866 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:08:06.866 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:06.866 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:06.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:06.873 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:08:06.873 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e6d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:06.874 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e6d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:07.076 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:08:07.076 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 14506 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:07.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:08.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:08.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:08.610 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:08.610 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:09.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:10.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:10.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:11.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:12.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a0002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:12.124 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:08:12.124 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:08:12.124 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:08:12.124 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:12.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a1002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:12.131 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:08:12.131 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:08:12.613 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:12.613 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:08:12.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:12.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:13.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:14.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:14.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:15.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:16.348 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:16.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a2002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:16.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:16.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:17.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:17.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:17.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:18.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:18.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:19.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:20.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:20.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:21.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:22.110 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:08:22.111 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:08:22.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:08:22.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dfe0) proc(0x7f82b429e330) pid(14644) version 11:1:1:4 [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e330), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b429e550, requested num -1 [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:22.117 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:22.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:08:22.123 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:08:22.123 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:22.124 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:22.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:08:22.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b429dfe0) skgpid ospid 14644 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:22.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:22.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:22.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:22.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:23.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:24.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:24.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:25.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:26.371 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:26.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a3002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:26.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:26.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:27.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a4002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:27.375 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:08:27.375 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:08:27.375 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:08:27.375 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:27.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a5002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:27.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:08:27.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:08:27.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:27.623 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:28.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:28.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:28.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:30.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:30.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:08:30.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:30.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:08:30.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dfe0) proc(0x7f82b429e330) pid(14746) version 11:1:1:4 [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e330), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42b00d0 with con 0x7f82b42cbcf0, requested num -1 [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:30.101 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:30.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:08:30.108 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:08:30.108 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbb70) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:08:30.108 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cbb70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:30.222 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a50f0) allocated [ CSSD]2013-05-23 14:08:30.223 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:30.224 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a50f0 - 1,2,3 [ CSSD]2013-05-23 14:08:30.224 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad30) proc(0x7f82b42a50f0) pid(14751) version 11:1:1:4 [ CSSD]2013-05-23 14:08:30.240 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:08:30.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:08:30.244 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:08:30.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a50f0 [ CSSD]2013-05-23 14:08:30.245 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a50f0) con(0x7f82b42bad30) skgpid ospid 14751 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:30.310 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:08:30.310 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b429dfe0) skgpid ospid 14746 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:30.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:30.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:31.625 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:31.626 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:08:32.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:32.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:32.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:34.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:34.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:34.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:36.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:36.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:36.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a6002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:36.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:36.629 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:36.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:36.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:37.366 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:08:37.367 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:08:37.367 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:08:37.367 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14819) version 11:1:1:4 [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b429e330, requested num -1 [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:37.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:37.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:08:37.380 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:08:37.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:37.380 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:37.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:08:37.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid ospid 14819 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:38.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:38.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:38.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:40.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:40.322 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:08:40.323 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:40.324 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:08:40.324 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dfe0) proc(0x7f82b429e6d0) pid(14883/14883) version 11:1:1:4 [ CSSD]2013-05-23 14:08:40.339 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:08:40.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:08:40.339 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:08:40.339 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:08:40.355 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429dfe0) skgpid 14883 ospid 14883 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:40.683 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:08:40.684 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:40.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:08:40.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7b30) proc(0x7f82b429e330) pid(14899) version 11:1:1:4 [ CSSD]2013-05-23 14:08:40.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:40.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:40.916 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:08:40.917 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:40.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:08:40.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5d20) proc(0x7f82b42cd1c0) pid(14967) version 11:1:1:4 [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cfa20, requested num -1 [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c7f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:40.924 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:40.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:08:40.930 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:08:40.930 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:40.930 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:41.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:08:41.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42c7b30) skgpid ospid 14899 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:41.132 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:08:41.132 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b5d20) skgpid ospid 14967 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:41.632 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:41.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:42.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:42.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a7002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:42.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:08:42.625 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:08:42.625 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:08:42.625 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:42.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a8002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:42.631 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:08:42.631 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:08:42.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:42.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:43.351 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:08:43.351 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:43.352 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:08:43.352 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42b5c10) pid(14927/14927) version 11:1:1:4 [ CSSD]2013-05-23 14:08:43.369 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:08:43.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:08:43.369 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:08:43.369 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:08:44.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:44.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:44.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:44.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a9002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:44.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:08:44.905 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:08:44.905 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:08:44.905 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:44.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04aa002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:44.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:08:44.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:08:46.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:46.416 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:46.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ab002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:46.635 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:46.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:46.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:46.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:48.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:48.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:48.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:50.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:50.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:50.638 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:08:50.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:50.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:51.507 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4286810) [ CSSD]2013-05-23 14:08:51.507 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4286810), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:08:51.507 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4286810), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:08:51.507 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207e50 [ CSSD]2013-05-23 14:08:51.513 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207e50) con(0x7f82b42c6340) skgpid 7475 ospid 7475 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:51.878 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 14:08:51.879 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:08:51.880 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 14:08:51.880 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a2930) pid(15136/15136) version 11:1:1:4 [ CSSD]2013-05-23 14:08:51.896 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:08:51.896 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:08:51.896 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:08:51.896 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:08:52.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:52.631 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:08:52.632 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:08:52.633 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:08:52.633 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42cd1c0) pid(15144) version 11:1:1:4 [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c7f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:08:52.639 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:52.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:08:52.647 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:08:52.647 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:08:52.647 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:08:52.850 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:08:52.850 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b59f0) skgpid ospid 15144 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:08:52.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:52.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:54.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:54.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:54.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:55.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:08:55.642 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:08:56.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:56.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:08:56.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ac002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:56.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:56.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:08:57.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ad002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:57.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:08:57.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:08:57.875 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:08:57.875 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:08:57.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ae002b) incarnation(174631051) [ CSSD]2013-05-23 14:08:57.882 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:08:57.882 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:08:58.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:08:58.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:08:58.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:00.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:00.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:00.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:00.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:00.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:02.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:02.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:02.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:04.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:04.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:04.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:05.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:05.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:06.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:06.476 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:06.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04af002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:07.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:07.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:07.886 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:09:07.887 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:09:07.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:09:07.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42cd1c0) pid(15349) version 11:1:1:4 [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c7f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:07.895 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:07.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:09:07.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:09:07.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:07.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:08.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:09:08.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b59f0) skgpid ospid 15349 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:08.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:09.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:09.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:09.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:09.652 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:09:10.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:11.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:11.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:12.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:13.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:13.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:13.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b0002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:13.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:09:13.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:09:13.135 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:09:13.135 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:13.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b1002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:13.142 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:09:13.143 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:09:14.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:14.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:14.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:15.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:15.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:16.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:16.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:16.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b2002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:16.818 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:09:16.819 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:09:16.819 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:09:16.819 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59f0) proc(0x7f82b42cd1c0) pid(15443) version 11:1:1:4 [ CSSD]2013-05-23 14:09:16.942 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 14:09:16.942 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:09:16.943 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 14:09:16.943 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42a1690) pid(15453) version 11:1:1:4 [ CSSD]2013-05-23 14:09:16.960 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:09:16.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:09:16.964 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 14:09:16.964 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42be650) skgpid ospid 15453 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5318/0x7f82b42cbf40) [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5318 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cbf40 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42c8020/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:17.041 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:09:17.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5318 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:09:17.048 [1199044928] >TRACE: clssgmExitGrock: client 5318 (0x7f82b42cbf40), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:09:17.048 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1690) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:09:17.048 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a1690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:17.049 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:09:17.049 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42b59f0) skgpid ospid 15443 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:17.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:17.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:18.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:19.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:19.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:19.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:19.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:20.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:21.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:21.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:22.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:23.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:23.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:23.136 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:09:23.137 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:09:23.137 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:09:23.137 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42cd1c0) pid(15508) version 11:1:1:4 [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:23.144 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:23.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:09:23.151 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:09:23.151 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:23.151 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:23.353 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:09:23.353 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42aee40) skgpid ospid 15508 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:24.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:24.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:24.663 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:25.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:25.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:26.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:26.527 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:26.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b3002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:27.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:27.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:28.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b4002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:28.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:09:28.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:09:28.385 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:09:28.385 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:28.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b5002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:28.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:09:28.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:09:28.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:29.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:29.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:29.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:29.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:30.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:31.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:31.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:32.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:33.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:33.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:34.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:34.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:34.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:35.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:35.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:36.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:36.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:36.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b6002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:37.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:37.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:38.387 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:09:38.388 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:09:38.389 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:09:38.389 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42cd1c0) pid(15653) version 11:1:1:4 [ CSSD]2013-05-23 14:09:38.395 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:09:38.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:09:38.395 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:09:38.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:38.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:09:38.396 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:38.396 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:38.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:09:38.402 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:09:38.402 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:38.402 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:38.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:38.605 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:09:38.605 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42aee40) skgpid ospid 15653 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:39.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:39.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:39.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:39.672 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:40.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:41.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1c0) allocated [ CSSD]2013-05-23 14:09:41.173 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:09:41.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1c0 - 1,2,3 [ CSSD]2013-05-23 14:09:41.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42cd1c0) pid(15715) version 11:1:1:4 [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd1c0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cd110, requested num -1 [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:41.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:41.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:09:41.187 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:09:41.187 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:41.187 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:41.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:41.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:41.390 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1c0 [ CSSD]2013-05-23 14:09:41.390 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1c0) con(0x7f82b42be650) skgpid ospid 15715 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:42.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:43.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:43.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:43.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b7002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:43.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:09:43.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:09:43.646 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:09:43.646 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:43.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b8002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:43.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:09:43.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:09:44.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:44.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:44.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:45.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b9002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:45.167 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:09:45.167 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:09:45.167 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:09:45.167 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:45.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ba002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:45.173 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:09:45.173 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:09:45.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:45.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:46.574 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:46.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bb002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:46.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:47.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:47.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:48.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:48.677 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:09:48.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:49.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:49.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:50.476 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(2/0x7f82b4204870) [ CSSD]2013-05-23 14:09:50.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 14:09:50.476 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:09:50.476 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 14:09:50.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:51.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:51.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:52.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:53.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:53.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:53.644 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b34e0) allocated [ CSSD]2013-05-23 14:09:53.645 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:09:53.646 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b34e0 - 1,2,3 [ CSSD]2013-05-23 14:09:53.646 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42b34e0) pid(15827) version 11:1:1:4 [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b34e0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:09:53.652 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:53.659 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:09:53.659 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:09:53.659 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:09:53.659 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:09:53.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:53.681 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:53.862 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b34e0 [ CSSD]2013-05-23 14:09:53.862 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b34e0) con(0x7f82b42aee40) skgpid ospid 15827 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:09:54.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:55.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:55.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:56.675 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:09:56.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bc002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:56.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:57.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:57.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:09:58.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:09:58.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:09:58.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:09:58.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04bd002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:58.895 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:09:58.895 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:09:58.895 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:09:58.895 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:09:58.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04be002b) incarnation(174631051) [ CSSD]2013-05-23 14:09:58.902 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:09:58.902 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:09:59.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:09:59.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:00.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:01.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:01.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:02.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:03.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:03.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:03.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:03.686 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:04.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:05.001 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd170) allocated [ CSSD]2013-05-23 14:10:05.002 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:10:05.002 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd170 - 1,2,3 [ CSSD]2013-05-23 14:10:05.002 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e790) proc(0x7f82b42cd170) pid(16149/16149) version 11:1:1:4 [ CSSD]2013-05-23 14:10:05.018 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd170), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:10:05.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:10:05.018 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:10:05.018 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:10:05.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:10:05.323 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:10:05.323 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:10:05.323 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:10:05.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd170 [ CSSD]2013-05-23 14:10:05.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd170) con(0x7f82b429e790) skgpid 16149 ospid 16149 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:05.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:05.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:06.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:06.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bf002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:06.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:07.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:07.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:08.689 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:08.689 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:08.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:08.897 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd170) allocated [ CSSD]2013-05-23 14:10:08.898 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:10:08.899 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd170 - 1,2,3 [ CSSD]2013-05-23 14:10:08.899 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e790) proc(0x7f82b42cd170) pid(16177) version 11:1:1:4 [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cd170), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42ba890, requested num -1 [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:10:08.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:08.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:10:08.912 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:10:08.912 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bac40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:08.912 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bac40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:10:09.114 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd170 [ CSSD]2013-05-23 14:10:09.114 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd170) con(0x7f82b429e790) skgpid ospid 16177 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:09.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:09.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:10.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:11.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:11.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:12.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:12.691 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:10:12.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:13.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:13.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:14.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c0002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:14.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:14.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:14.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:14.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:14.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c1002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:14.162 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:14.162 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:10:14.709 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42c7cc0) skgpid 14927 ospid 14927 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:14.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:15.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:15.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:16.719 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:16.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c2002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:16.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:10:17.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 10677 ospid 10677 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:17.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:17.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:17.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:17.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:18.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:19.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:19.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:20.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:21.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:21.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:22.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:22.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:22.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:23.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:10:23.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:10:23.594 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:10:23.594 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(16271/16271) version 11:1:1:4 [ CSSD]2013-05-23 14:10:23.598 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:10:23.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:10:23.598 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:10:23.598 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:10:23.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:23.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:24.153 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbb70) allocated [ CSSD]2013-05-23 14:10:24.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:10:24.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbb70 - 1,2,3 [ CSSD]2013-05-23 14:10:24.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42cbb70) pid(16319) version 11:1:1:4 [ CSSD]2013-05-23 14:10:24.161 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42cbb70), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:10:24.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:10:24.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:10:24.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:24.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:10:24.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:10:24.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:24.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:10:24.169 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:10:24.169 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:24.169 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:10:24.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbb70 [ CSSD]2013-05-23 14:10:24.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbb70) con(0x7f82b427d8a0) skgpid ospid 16319 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:24.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:25.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:25.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:26.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:26.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c3002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:26.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:27.701 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:27.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:27.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:27.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:28.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:29.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c4002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:29.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:29.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:29.406 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:29.406 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:29.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c5002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:29.412 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:29.412 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:10:29.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:29.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:30.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:31.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:31.704 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:10:31.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:31.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:32.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:33.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:33.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:34.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:35.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:35.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:36.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:36.707 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:36.780 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:36.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c6002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:36.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:37.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:37.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:38.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:39.397 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:10:39.398 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:10:39.399 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:10:39.399 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dfe0) proc(0x7f82b429e6d0) pid(16463) version 11:1:1:4 [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:10:39.405 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:39.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:10:39.411 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:10:39.411 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:39.411 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:10:39.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:10:39.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b429dfe0) skgpid ospid 16463 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:39.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:39.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:41.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:41.446 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5c10) allocated [ CSSD]2013-05-23 14:10:41.447 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:10:41.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5c10 - 1,2,3 [ CSSD]2013-05-23 14:10:41.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42b5c10) pid(16517) version 11:1:1:4 [ CSSD]2013-05-23 14:10:41.454 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b5c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:10:41.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:10:41.454 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42b46a0, requested num -1 [ CSSD]2013-05-23 14:10:41.454 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:41.454 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ccf90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:10:41.455 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:10:41.455 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:41.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:10:41.461 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:10:41.461 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:41.461 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:10:41.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5c10 [ CSSD]2013-05-23 14:10:41.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5c10) con(0x7f82b42be650) skgpid ospid 16517 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:41.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:41.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:41.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:41.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:43.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:43.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:43.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:44.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c7002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:44.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:44.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:44.655 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:44.655 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:44.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c8002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:44.661 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:44.661 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:10:45.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:45.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c9002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:45.425 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:45.425 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:45.425 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:45.425 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:45.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ca002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:45.432 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:45.432 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:10:45.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:45.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:46.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:46.715 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:46.801 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:46.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04cb002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:47.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:48.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:48.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:49.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:50.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:50.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:50.717 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:50.717 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:10:51.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:52.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:52.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:52.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04cc002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:52.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:52.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:52.204 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:52.204 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:52.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04cd002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:52.211 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:52.211 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:10:53.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:54.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:54.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:54.649 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:10:54.650 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:10:54.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:10:54.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b429e6d0) pid(16620) version 11:1:1:4 [ CSSD]2013-05-23 14:10:54.666 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:10:54.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:10:54.666 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 14:10:54.666 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:54.666 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:10:54.667 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:10:54.667 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:54.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:10:54.674 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:10:54.674 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:10:54.674 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:10:54.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:10:54.877 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42be650) skgpid ospid 16620 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:10:55.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:55.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:10:55.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:10:56.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:56.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:56.821 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:10:56.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ce002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:57.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:58.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:10:58.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:10:59.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:10:59.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04cf002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:59.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:10:59.914 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:10:59.914 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:10:59.914 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:10:59.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d0002b) incarnation(174631051) [ CSSD]2013-05-23 14:10:59.921 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:10:59.921 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:00.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:00.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:00.723 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:00.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:01.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:02.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:02.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:03.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:04.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:04.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:05.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:05.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:05.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:06.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:06.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:06.846 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:06.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d1002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:07.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:08.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:08.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:09.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:09.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d2002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:09.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:11:09.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:11:09.465 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:11:09.465 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:09.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d3002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:09.471 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:11:09.472 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:09.604 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:11:09.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:11:09.608 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:11:09.608 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:11:09.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:09.730 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:11:09.911 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:11:09.911 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:11:09.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:11:09.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e330) pid(16765) version 11:1:1:4 [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e330), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:11:09.918 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:09.924 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:11:09.924 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:11:09.924 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b4520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:09.924 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b4520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:11:10.127 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:11:10.127 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b427d8a0) skgpid ospid 16765 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:10.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:10.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:11.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:12.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:12.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:13.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:14.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:14.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:14.733 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:14.733 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:15.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d4002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:15.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:11:15.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:11:15.175 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:11:15.175 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:15.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d5002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:15.182 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:11:15.182 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:15.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:15.566 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:11:15.566 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:11:15.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:11:15.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b429e6d0) pid(16838/16838) version 11:1:1:4 [ CSSD]2013-05-23 14:11:15.583 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b429e6d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:11:15.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:11:15.583 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:11:15.583 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:11:15.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:11:15.602 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:11:15.602 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:11:15.602 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:11:15.603 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:11:15.603 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b42be650) skgpid 16838 ospid 16838 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:16.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:16.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:16.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:16.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d6002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:17.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:18.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:18.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:19.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:19.736 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:19.736 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:20.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:20.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:21.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:21.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:11:21.556 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:11:21.556 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:11:21.556 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 14:11:21.557 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 14:11:21.557 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid 11581 ospid 11581 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:22.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:22.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:23.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:24.286 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 14:11:24.287 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:11:24.288 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 14:11:24.288 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42583a0) pid(16895/16895) version 11:1:1:4 [ CSSD]2013-05-23 14:11:24.294 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:11:24.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:11:24.294 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:11:24.294 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 14:11:24.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:24.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:24.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:24.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:25.173 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 14:11:25.174 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:11:25.175 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 14:11:25.175 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42b45f0) pid(16919) version 11:1:1:4 [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b45f0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42b5d20, requested num -1 [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:11:25.181 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:25.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:11:25.189 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:11:25.189 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ccf90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:25.189 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:11:25.392 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 14:11:25.392 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b42be650) skgpid ospid 16919 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:25.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:26.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:26.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:26.893 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:26.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d7002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:27.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:28.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:28.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:28.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:28.742 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:11:29.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:30.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d8002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:30.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:11:30.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:11:30.424 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:11:30.424 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:30.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d9002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:30.431 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:11:30.431 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:30.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:30.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:31.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:32.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:32.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:33.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:33.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:33.745 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:34.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:34.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:35.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:36.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:36.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:36.917 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:36.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04da002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:37.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:38.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:38.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:38.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:38.748 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:39.243 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b45f0) allocated [ CSSD]2013-05-23 14:11:39.244 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:11:39.245 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b45f0 - 1,2,3 [ CSSD]2013-05-23 14:11:39.245 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b45f0) pid(16893/16893) version 11:1:1:4 [ CSSD]2013-05-23 14:11:39.261 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b45f0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:11:39.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:11:39.261 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:11:39.261 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:11:39.299 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 14:11:39.299 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:11:39.300 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 14:11:39.300 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e880) proc(0x7f82b42d3c90) pid(16891/16891) version 11:1:1:4 [ CSSD]2013-05-23 14:11:39.317 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d3c90), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:11:39.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:11:39.317 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:11:39.317 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:11:39.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:40.428 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 14:11:40.429 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:11:40.429 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 14:11:40.429 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b41fe180) pid(17078) version 11:1:1:4 [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b41fe180), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b41fe2b0, requested num -1 [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:11:40.436 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:40.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:11:40.443 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:11:40.443 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:40.443 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:11:40.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:40.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:40.646 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 14:11:40.646 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42c80f0) skgpid ospid 17078 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:41.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:41.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d51e0) allocated [ CSSD]2013-05-23 14:11:41.714 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:11:41.715 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d51e0 - 1,2,3 [ CSSD]2013-05-23 14:11:41.715 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d51e0) pid(17126) version 11:1:1:4 [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d51e0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d8300, requested num -1 [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b429ecb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:11:41.731 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:41.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:11:41.738 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:11:41.738 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:41.738 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:11:41.941 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d51e0 [ CSSD]2013-05-23 14:11:41.941 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d51e0) con(0x7f82b42be650) skgpid ospid 17126 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:42.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:42.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:43.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:43.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:43.752 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:44.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:44.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:45.592 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 14:11:45.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:11:45.592 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:11:45.592 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:11:45.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04db002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04dc002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmAddMember: granted member(1) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:11:45.686 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(1/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:45.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04dd002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:45.693 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:11:45.693 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:45.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04de002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:45.699 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:11:45.699 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 1 (0x7f82ac01c910) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:11:46.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:46.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:46.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:46.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04df002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:47.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:48.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:48.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:48.755 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:48.755 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:49.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:50.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:50.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:51.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:52.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:52.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:53.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:53.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:53.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:54.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:54.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:55.684 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5240) allocated [ CSSD]2013-05-23 14:11:55.711 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:11:55.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5240 - 1,2,3 [ CSSD]2013-05-23 14:11:55.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d5240) pid(17228) version 11:1:1:4 [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5240), client(1/0x7f82b429e190) [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429e190) [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429e190 with con 0x7f82b42d8680, requested num -1 [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5980/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:11:55.718 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:11:55.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429e190) [ CSSD]2013-05-23 14:11:55.725 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429e190), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:11:55.725 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:11:55.725 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:11:55.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:55.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5240 [ CSSD]2013-05-23 14:11:55.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5240) con(0x7f82b42be650) skgpid ospid 17228 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:11:56.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:56.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:56.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:11:56.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e0002b) incarnation(174631051) [ CSSD]2013-05-23 14:11:57.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:11:58.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:11:58.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:11:58.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:11:58.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:11:59.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:00.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:00.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:00.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e1002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:00.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:00.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:00.952 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:00.952 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:00.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e2002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:00.959 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:00.959 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:01.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:02.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e3002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:02.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:02.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:02.173 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:02.173 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:02.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e4002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:02.180 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:02.180 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:02.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:02.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:03.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:03.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:03.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:04.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:04.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:05.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:06.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:06.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:06.981 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:07.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e5002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:07.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:12:07.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:12:07.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:12:07.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:12:07.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e6002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:07.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:07.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:07.369 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:12:07.369 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:12:07.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e7002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:07.376 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:07.377 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:07.768 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:07.768 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:12:07.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:08.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:08.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:09.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:10.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:10.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:10.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8580) allocated [ CSSD]2013-05-23 14:12:10.961 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:12:10.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8580 - 1,2,3 [ CSSD]2013-05-23 14:12:10.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b42d8580) pid(17450) version 11:1:1:4 [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d8580), client(1/0x7f82b429e560) [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429e560 with con 0x7f82b429ea70, requested num -1 [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5a50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:12:10.968 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:10.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:12:10.974 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429e560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:12:10.974 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:10.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:12:11.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8580 [ CSSD]2013-05-23 14:12:11.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8580) con(0x7f82b42a1690) skgpid ospid 17450 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:11.440 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5240) allocated [ CSSD]2013-05-23 14:12:11.441 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:12:11.441 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5240 - 1,2,3 [ CSSD]2013-05-23 14:12:11.441 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b42d5240) pid(17499) version 11:1:1:4 [ CSSD]2013-05-23 14:12:11.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:12.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:12.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:12.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:12.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:13.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:14.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5240 [ CSSD]2013-05-23 14:12:14.171 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5240) con(0x7f82b42a1690) skgpid ospid 17499 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:14.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:14.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:15.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:16.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e8002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:16.197 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:16.197 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:16.197 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:16.197 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:16.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e9002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:16.204 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:16.205 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:16.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:16.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:17.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:17.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ea002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:17.774 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:17.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:17.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:18.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:18.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:19.614 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b45f0), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 14:12:19.614 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:12:19.614 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:12:19.614 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:12:19.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:20.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:20.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:21.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:22.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:22.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:22.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:22.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:24.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:24.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:24.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:26.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:26.219 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5240) allocated [ CSSD]2013-05-23 14:12:26.220 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:12:26.221 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5240 - 1,2,3 [ CSSD]2013-05-23 14:12:26.221 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ea70) proc(0x7f82b42d5240) pid(17903) version 11:1:1:4 [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5240), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d5180, requested num -1 [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:12:26.227 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:26.233 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:12:26.233 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:12:26.233 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d61e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:26.233 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d61e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:12:26.435 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5240 [ CSSD]2013-05-23 14:12:26.436 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5240) con(0x7f82b429ea70) skgpid ospid 17903 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:26.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:26.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:27.023 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:27.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04eb002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:27.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:27.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:28.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:28.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:28.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:30.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:31.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:31.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:31.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ec002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:31.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:31.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:31.467 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:31.467 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:31.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ed002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:31.475 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:31.475 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:31.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:31.783 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:12:32.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:33.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:33.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:34.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:35.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:35.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:36.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:36.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:36.786 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:37.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:37.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:37.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:37.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ee002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:38.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:39.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:39.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:40.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:41.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:41.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:41.468 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef00) allocated [ CSSD]2013-05-23 14:12:41.469 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:12:41.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef00 - 1,2,3 [ CSSD]2013-05-23 14:12:41.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b00) proc(0x7f82b429ef00) pid(18056) version 11:1:1:4 [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429ef00), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b429ee40, requested num -1 [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5e10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:12:41.476 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:41.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:12:41.483 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:12:41.483 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6110) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:41.483 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:12:41.685 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef00 [ CSSD]2013-05-23 14:12:41.685 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef00) con(0x7f82b42a1b00) skgpid ospid 18056 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:41.789 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:41.789 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:41.988 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef00) allocated [ CSSD]2013-05-23 14:12:41.989 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:12:41.990 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef00 - 1,2,3 [ CSSD]2013-05-23 14:12:41.990 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1750) proc(0x7f82b429ef00) pid(18097) version 11:1:1:4 [ CSSD]2013-05-23 14:12:41.996 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429ef00), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:12:41.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:12:41.996 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a18d0, requested num -1 [ CSSD]2013-05-23 14:12:41.996 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:41.996 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5020/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:12:41.997 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:12:41.997 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:42.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:12:42.003 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:12:42.003 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd830) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:42.003 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd830) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:12:42.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:42.205 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef00 [ CSSD]2013-05-23 14:12:42.205 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef00) con(0x7f82b42a1750) skgpid ospid 18097 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:43.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:43.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:44.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:45.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:45.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:45.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ef002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:45.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:45.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:45.998 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:45.998 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:46.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f0002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:46.005 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:46.005 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:46.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:46.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f1002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:46.728 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:12:46.728 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:12:46.728 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:12:46.728 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:46.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f2002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:46.736 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:12:46.736 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:12:46.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:46.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:47.065 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:47.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f3002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:47.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:47.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:48.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:49.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:49.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:50.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:50.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:50.795 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:12:51.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:51.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:52.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:53.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:53.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:54.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:55.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:55.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:55.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:12:55.799 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:12:56.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:56.723 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429ef00) allocated [ CSSD]2013-05-23 14:12:56.724 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:12:56.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429ef00 - 1,2,3 [ CSSD]2013-05-23 14:12:56.724 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1a50) proc(0x7f82b429ef00) pid(18247) version 11:1:1:4 [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429ef00), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b429ee40, requested num -1 [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d5e10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:12:56.731 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:12:56.737 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:12:56.737 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:12:56.737 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d6110) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:12:56.737 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d6110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:12:56.939 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429ef00 [ CSSD]2013-05-23 14:12:56.939 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429ef00) con(0x7f82b42a1a50) skgpid ospid 18247 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:12:57.086 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:12:57.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f4002b) incarnation(174631051) [ CSSD]2013-05-23 14:12:57.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:57.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:12:58.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:12:59.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:12:59.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:00.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:00.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:00.802 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:01.052 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5240) allocated [ CSSD]2013-05-23 14:13:01.053 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:13:01.054 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5240 - 1,2,3 [ CSSD]2013-05-23 14:13:01.054 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429ea70) proc(0x7f82b42d5240) pid(18151/18151) version 11:1:1:4 [ CSSD]2013-05-23 14:13:01.059 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5240), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:13:01.059 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:13:01.059 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:13:01.059 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:13:01.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:01.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:01.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f5002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:01.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:13:01.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:13:01.990 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:13:01.990 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:01.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f6002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:01.998 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:13:01.998 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:13:02.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:03.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:03.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:04.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:05.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:05.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:05.805 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:05.805 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:06.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:07.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:07.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f7002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:07.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:07.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:08.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:09.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:09.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:09.808 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:09.808 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:13:10.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:11.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:11.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:11.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e90) allocated [ CSSD]2013-05-23 14:13:11.971 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:13:11.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e90 - 1,2,3 [ CSSD]2013-05-23 14:13:11.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b00) proc(0x7f82b42d6e90) pid(18386) version 11:1:1:4 [ CSSD]2013-05-23 14:13:11.988 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6e90), client(1/0x7f82b42baa20) [ CSSD]2013-05-23 14:13:11.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42baa20) [ CSSD]2013-05-23 14:13:11.988 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42baa20 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:13:11.988 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:11.988 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:13:11.989 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:11.989 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:11.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42baa20) [ CSSD]2013-05-23 14:13:11.995 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42baa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:13:11.995 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:11.995 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:12.197 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6e90 [ CSSD]2013-05-23 14:13:12.197 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6e90) con(0x7f82b42a1b00) skgpid ospid 18386 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:12.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:13.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:13.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:14.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:14.811 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:14.811 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:15.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:15.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:16.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:17.148 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:17.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f8002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:17.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f9002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:17.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:13:17.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:13:17.241 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:13:17.241 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:17.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fa002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:17.249 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:13:17.249 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:13:17.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:17.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:18.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:19.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:19.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:19.814 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:19.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:20.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:21.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:21.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:22.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:23.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:23.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:24.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:24.817 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:24.817 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:25.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:25.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:26.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:27.167 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:27.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04fb002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:27.233 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 14:13:27.234 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:13:27.235 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 14:13:27.235 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b42042d0) pid(18532) version 11:1:1:4 [ CSSD]2013-05-23 14:13:27.241 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42042d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:13:27.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:13:27.241 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4204700, requested num -1 [ CSSD]2013-05-23 14:13:27.241 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:27.241 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:13:27.242 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:27.242 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:27.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:13:27.248 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:13:27.248 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cde40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:27.249 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cde40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:27.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 14:13:27.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d5bd0) skgpid ospid 18532 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:27.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:27.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:28.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:28.820 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:28.820 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:13:29.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:29.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:30.386 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e90) allocated [ CSSD]2013-05-23 14:13:30.387 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:13:30.388 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e90 - 1,2,3 [ CSSD]2013-05-23 14:13:30.388 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b00) proc(0x7f82b42d6e90) pid(18595) version 11:1:1:4 [ CSSD]2013-05-23 14:13:30.395 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6e90), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42ccac0 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc00/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:30.396 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:30.403 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:13:30.403 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:13:30.403 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:13:30.403 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:30.513 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf7a0) allocated [ CSSD]2013-05-23 14:13:30.514 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:13:30.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf7a0 - 1,2,3 [ CSSD]2013-05-23 14:13:30.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdc30) proc(0x7f82b42cf7a0) pid(18600) version 11:1:1:4 [ CSSD]2013-05-23 14:13:30.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:30.541 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:13:30.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:13:30.544 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:13:30.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf7a0 [ CSSD]2013-05-23 14:13:30.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf7a0) con(0x7f82b42cdc30) skgpid ospid 18600 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:30.706 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6e90 [ CSSD]2013-05-23 14:13:30.706 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6e90) con(0x7f82b42a1b00) skgpid ospid 18595 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:31.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:31.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:32.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04fc002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:32.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:13:32.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:13:32.492 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:13:32.492 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:32.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fd002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:32.499 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:13:32.499 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:13:32.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:33.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:33.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:33.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:33.823 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:34.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:35.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:35.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:36.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:37.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:37.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04fe002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:37.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:37.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:38.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:38.827 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:38.827 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:39.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:39.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:40.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:41.225 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204510) allocated [ CSSD]2013-05-23 14:13:41.226 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:13:41.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204510 - 1,2,3 [ CSSD]2013-05-23 14:13:41.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d62c0) proc(0x7f82b4204510) pid(18696) version 11:1:1:4 [ CSSD]2013-05-23 14:13:41.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:41.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:41.796 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204510 [ CSSD]2013-05-23 14:13:41.796 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204510) con(0x7f82b42d62c0) skgpid ospid 18696 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:42.258 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 14:13:42.259 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:13:42.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 14:13:42.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b42042d0) pid(18797) version 11:1:1:4 [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42042d0), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b42d6dc0, requested num -1 [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:42.266 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:42.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:13:42.273 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:13:42.273 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42046b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:42.274 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42046b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:42.476 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 14:13:42.476 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d5bd0) skgpid ospid 18797 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:42.495 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6ec0) allocated [ CSSD]2013-05-23 14:13:42.496 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:13:42.496 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6ec0 - 1,2,3 [ CSSD]2013-05-23 14:13:42.496 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b42d6ec0) pid(18806) version 11:1:1:4 [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6ec0), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b42039b0, requested num -1 [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4204120/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:42.502 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:42.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:13:42.509 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:13:42.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4203830) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:42.509 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4203830) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:42.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:42.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6ec0 [ CSSD]2013-05-23 14:13:42.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6ec0) con(0x7f82b42d5bd0) skgpid ospid 18806 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:43.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:43.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:43.830 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:43.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:44.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:45.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:45.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:46.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ff002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:46.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:13:46.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:13:46.253 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:13:46.253 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:46.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0500002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:46.260 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:13:46.260 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:13:46.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:47.218 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:47.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0501002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:47.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0502002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:47.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:13:47.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:13:47.743 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:13:47.744 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:47.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0503002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:47.751 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:13:47.751 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:13:47.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:47.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:48.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:48.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:48.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:49.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:49.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:50.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:51.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:51.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:52.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:53.836 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:53.836 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:53.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:53.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:54.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:55.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:55.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:56.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:57.239 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:13:57.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0504002b) incarnation(174631051) [ CSSD]2013-05-23 14:13:57.748 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 14:13:57.749 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:13:57.750 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 14:13:57.750 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1a50) proc(0x7f82b42042d0) pid(19016) version 11:1:1:4 [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42042d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42d5bd0, requested num -1 [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cda80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:13:57.757 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:13:57.763 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:13:57.763 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:13:57.763 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdd80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:13:57.764 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdd80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:13:57.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 14:13:57.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42a1a50) skgpid ospid 19016 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:13:57.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:57.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:13:58.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:13:58.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:13:58.839 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:13:59.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:13:59.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:00.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:02.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:02.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:02.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:02.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0505002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:02.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:14:02.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:14:02.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:14:02.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:03.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0506002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:03.000 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:14:03.000 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:14:03.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:03.842 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:04.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:04.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:04.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:06.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:06.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:06.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:07.259 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:07.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0507002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:08.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:08.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:08.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:08.846 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:08.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:10.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:10.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:10.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:12.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:12.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:12.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:13.000 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204510) allocated [ CSSD]2013-05-23 14:14:13.001 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:14:13.002 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204510 - 1,2,3 [ CSSD]2013-05-23 14:14:13.002 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d62e0) proc(0x7f82b4204510) pid(19167) version 11:1:1:4 [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4204510), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:13.018 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:13.026 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:14:13.026 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:14:13.026 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:13.026 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:13.229 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204510 [ CSSD]2013-05-23 14:14:13.229 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204510) con(0x7f82b42d62e0) skgpid ospid 19167 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:13.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:13.849 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:14.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:14.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:14.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:16.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:16.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:16.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:17.136 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204510) allocated [ CSSD]2013-05-23 14:14:17.137 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:14:17.137 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204510 - 1,2,3 [ CSSD]2013-05-23 14:14:17.138 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d62e0) proc(0x7f82b4204510) pid(19233) version 11:1:1:4 [ CSSD]2013-05-23 14:14:17.260 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf5a0) allocated [ CSSD]2013-05-23 14:14:17.261 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:14:17.262 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf5a0 - 1,2,3 [ CSSD]2013-05-23 14:14:17.262 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdc30) proc(0x7f82b42cf5a0) pid(19243) version 11:1:1:4 [ CSSD]2013-05-23 14:14:17.278 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:14:17.279 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:17.280 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:14:17.283 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf5a0 [ CSSD]2013-05-23 14:14:17.283 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf5a0) con(0x7f82b42cdc30) skgpid ospid 19243 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5319/0x7f82b429e190) [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5319 (0x7f82b429e190) [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b429e190 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42cdc00/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:17.359 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:14:17.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0508002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:17.365 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5319 (0x7f82b429e190) [ CSSD]2013-05-23 14:14:17.365 [1199044928] >TRACE: clssgmExitGrock: client 5319 (0x7f82b429e190), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:14:17.365 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:14:17.365 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:17.366 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204510 [ CSSD]2013-05-23 14:14:17.366 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204510) con(0x7f82b42d62e0) skgpid ospid 19233 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:18.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:18.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:18.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0509002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:18.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:14:18.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:14:18.253 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:14:18.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:18.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050a002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:18.261 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:14:18.261 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:14:18.852 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:18.852 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:19.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:20.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:20.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:21.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:22.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:22.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:23.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:23.855 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:23.855 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:24.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:24.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:25.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:26.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:26.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:27.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:27.300 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:27.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050b002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:28.265 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e90) allocated [ CSSD]2013-05-23 14:14:28.266 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:14:28.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e90 - 1,2,3 [ CSSD]2013-05-23 14:14:28.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6210) proc(0x7f82b42d6e90) pid(19334) version 11:1:1:4 [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6e90), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:28.284 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:28.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:14:28.291 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:14:28.291 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:28.291 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:28.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:28.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:28.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6e90 [ CSSD]2013-05-23 14:14:28.493 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6e90) con(0x7f82b42d6210) skgpid ospid 19334 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:28.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:28.859 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:29.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:30.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:30.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:31.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:32.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:32.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:33.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:33.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050c002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:33.524 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:14:33.524 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:14:33.524 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:14:33.524 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:33.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050d002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:33.532 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:14:33.532 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:14:33.862 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:33.862 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:34.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:34.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:35.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:36.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:36.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:37.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:37.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:37.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050e002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:38.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:38.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:38.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:38.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:39.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:40.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:40.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:41.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:42.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:42.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:42.517 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e90) allocated [ CSSD]2013-05-23 14:14:42.518 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:14:42.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e90 - 1,2,3 [ CSSD]2013-05-23 14:14:42.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1b00) proc(0x7f82b42d6e90) pid(19481) version 11:1:1:4 [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6e90), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b42d5bd0, requested num -1 [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:42.536 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:42.543 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:14:42.543 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:14:42.543 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cde40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:42.543 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cde40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:42.746 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d6e90 [ CSSD]2013-05-23 14:14:42.746 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d6e90) con(0x7f82b42a1b00) skgpid ospid 19481 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:43.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:43.531 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf050) allocated [ CSSD]2013-05-23 14:14:43.532 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:14:43.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf050 - 1,2,3 [ CSSD]2013-05-23 14:14:43.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdc10) proc(0x7f82b42cf050) pid(19498) version 11:1:1:4 [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cf050), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cef90, requested num -1 [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b4202ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:43.539 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:43.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:14:43.547 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:14:43.547 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cee10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:43.547 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cee10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:43.749 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf050 [ CSSD]2013-05-23 14:14:43.749 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf050) con(0x7f82b42cdc10) skgpid ospid 19498 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:43.869 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:43.869 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:44.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:44.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:45.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:46.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:46.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:46.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050f002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:46.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:14:46.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:14:46.516 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:14:46.516 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:46.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0510002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:46.523 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:14:46.523 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:14:47.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:47.350 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:47.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0511002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:47.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:47.872 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:14:48.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:48.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:48.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0512002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:48.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:14:48.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:14:48.776 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:14:48.776 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:48.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0513002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:48.782 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:14:48.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:14:49.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:50.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:50.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:51.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:52.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:52.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:52.875 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:52.875 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:53.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:54.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:54.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:55.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:56.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:56.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:57.370 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:14:57.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:14:57.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0514002b) incarnation(174631051) [ CSSD]2013-05-23 14:14:57.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:14:57.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:14:58.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:14:58.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:14:58.793 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 14:14:58.794 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:14:58.794 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 14:14:58.794 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d6130) proc(0x7f82b42042d0) pid(19646) version 11:1:1:4 [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42042d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d6f30, requested num -1 [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cda80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:14:58.801 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:14:58.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:14:58.807 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:14:58.807 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdd80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:14:58.808 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdd80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:14:59.010 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 14:14:59.010 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d6130) skgpid ospid 19646 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:14:59.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:00.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:00.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:01.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:02.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:02.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:02.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:02.882 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:03.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:04.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0515002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:04.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:15:04.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:15:04.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:15:04.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:04.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0516002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:04.031 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:15:04.031 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:15:04.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:04.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:05.087 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204510) allocated [ CSSD]2013-05-23 14:15:05.088 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:15:05.088 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204510 - 1,2,3 [ CSSD]2013-05-23 14:15:05.088 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d62e0) proc(0x7f82b4204510) pid(19763/19763) version 11:1:1:4 [ CSSD]2013-05-23 14:15:05.104 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4204510), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:15:05.104 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:15:05.104 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:15:05.104 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:15:05.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:15:05.397 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:15:05.397 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:15:05.397 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:15:05.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204510 [ CSSD]2013-05-23 14:15:05.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204510) con(0x7f82b42d62e0) skgpid 19763 ospid 19763 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:15:05.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:06.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:06.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:06.884 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:06.885 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:15:07.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:07.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:07.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0517002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:08.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:08.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:09.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:10.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:10.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:11.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:11.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:11.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:12.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:12.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:13.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:14.047 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4204510) allocated [ CSSD]2013-05-23 14:15:14.048 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:15:14.049 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4204510 - 1,2,3 [ CSSD]2013-05-23 14:15:14.049 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d62e0) proc(0x7f82b4204510) pid(19836) version 11:1:1:4 [ CSSD]2013-05-23 14:15:14.065 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4204510), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:15:14.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:15:14.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b4204450, requested num -1 [ CSSD]2013-05-23 14:15:14.066 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:14.066 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:15:14.066 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:15:14.066 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:14.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:15:14.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:15:14.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:14.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:15:14.275 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4204510 [ CSSD]2013-05-23 14:15:14.275 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4204510) con(0x7f82b42d62e0) skgpid ospid 19836 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:15:14.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:14.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:15.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:16.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:16.811 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:16.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:16.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:17.410 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:17.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0518002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:17.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:18.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:18.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:19.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0519002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:19.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:15:19.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:15:19.273 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:15:19.273 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:19.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051a002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:19.280 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:15:19.280 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:15:19.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:20.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:20.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:21.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:21.895 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:21.895 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:22.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:22.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:23.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:24.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:24.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:25.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:25.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:25.898 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:15:26.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:26.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:27.432 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:27.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051b002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:27.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:28.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:28.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:29.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42042d0) allocated [ CSSD]2013-05-23 14:15:29.313 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:15:29.314 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42042d0 - 1,2,3 [ CSSD]2013-05-23 14:15:29.314 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b42042d0) pid(19994) version 11:1:1:4 [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42042d0), client(1/0x7f82b429e560) [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429e560 with con 0x7f82b4204700, requested num -1 [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cdb40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:15:29.331 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:29.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:15:29.339 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429e560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:15:29.339 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cde40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:29.340 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cde40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:15:29.542 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42042d0 [ CSSD]2013-05-23 14:15:29.542 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42042d0) con(0x7f82b42d5bd0) skgpid ospid 19994 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:15:29.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:30.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:30.901 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:30.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:30.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:31.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:32.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:32.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:33.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:34.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051c002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:34.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:15:34.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:15:34.544 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:15:34.544 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:34.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051d002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:34.552 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:15:34.552 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:15:34.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:34.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:35.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:35.904 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:35.905 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:36.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:36.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:37.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:37.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051e002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:37.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:38.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:38.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:39.601 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d6e60) allocated [ CSSD]2013-05-23 14:15:39.602 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:15:39.603 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d6e60 - 1,2,3 [ CSSD]2013-05-23 14:15:39.603 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5bd0) proc(0x7f82b42d6e60) pid(20101/20101) version 11:1:1:4 [ CSSD]2013-05-23 14:15:39.619 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d6e60), client(1/0x7f82b42baa20) [ CSSD]2013-05-23 14:15:39.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42baa20) [ CSSD]2013-05-23 14:15:39.619 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:15:39.619 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:15:39.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:40.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:40.908 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:40.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:40.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:41.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:42.785 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf750) allocated [ CSSD]2013-05-23 14:15:42.786 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:15:42.786 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf750 - 1,2,3 [ CSSD]2013-05-23 14:15:42.786 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42046a0) proc(0x7f82b42cf750) pid(20130) version 11:1:1:4 [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf750), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cf880, requested num -1 [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c96b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:15:42.802 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:42.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:15:42.810 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:15:42.810 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c99b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:42.810 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c99b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:15:42.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:42.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:43.013 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf750 [ CSSD]2013-05-23 14:15:43.013 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf750) con(0x7f82b42046a0) skgpid ospid 20130 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:15:43.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:44.576 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf800) allocated [ CSSD]2013-05-23 14:15:44.577 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:15:44.578 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf800 - 1,2,3 [ CSSD]2013-05-23 14:15:44.578 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cde90) proc(0x7f82b42cf800) pid(20152) version 11:1:1:4 [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf800), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cf730, requested num -1 [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:15:44.595 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:44.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:15:44.601 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:15:44.601 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:44.601 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:15:44.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf800 [ CSSD]2013-05-23 14:15:44.804 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf800) con(0x7f82b42cde90) skgpid ospid 20152 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:15:44.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:44.911 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:15:45.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:45.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:45.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:46.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051f002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:46.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:15:46.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:15:46.775 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:15:46.775 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:46.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0520002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:46.782 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:15:46.782 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:15:47.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:47.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:47.481 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:47.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0521002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:47.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:49.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:49.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:49.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0522002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:49.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:15:49.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:15:49.805 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:15:49.805 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:49.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0523002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:49.813 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:15:49.813 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:15:49.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:49.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:49.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:51.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:51.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:51.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:53.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:53.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:53.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:54.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:54.917 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:15:55.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:55.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:55.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:57.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:57.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:57.513 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:15:57.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0524002b) incarnation(174631051) [ CSSD]2013-05-23 14:15:57.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:15:59.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:15:59.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:15:59.841 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf670) allocated [ CSSD]2013-05-23 14:15:59.842 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:15:59.843 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf670 - 1,2,3 [ CSSD]2013-05-23 14:15:59.843 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdd00) proc(0x7f82b42cf670) pid(20333) version 11:1:1:4 [ CSSD]2013-05-23 14:15:59.849 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf670), client(1/0x7f82b429e190) [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429e190) [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429e190 with con 0x7f82b42cf5a0, requested num -1 [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c95c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:15:59.850 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:15:59.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429e190) [ CSSD]2013-05-23 14:15:59.857 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429e190), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:15:59.857 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c98c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:15:59.858 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c98c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:15:59.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:15:59.921 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:00.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:00.060 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf670 [ CSSD]2013-05-23 14:16:00.060 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf670) con(0x7f82b42cdd00) skgpid ospid 20333 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:01.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:01.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:02.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:03.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:03.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:04.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:04.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:04.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:05.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0525002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:05.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:05.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:05.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:16:05.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:05.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0526002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:05.063 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:05.064 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:05.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:05.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:06.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:07.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:07.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:07.543 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:07.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0527002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:08.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:09.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:09.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:09.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0528002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:09.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:09.767 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:09.767 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:16:09.767 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:09.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0529002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:09.775 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:09.775 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:09.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:16:09.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:16:09.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:16:09.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:16:09.927 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:09.927 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:10.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:11.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:11.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:12.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:13.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:13.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:14.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:14.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:14.931 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:15.105 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9050) allocated [ CSSD]2013-05-23 14:16:15.106 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:16:15.107 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9050 - 1,2,3 [ CSSD]2013-05-23 14:16:15.107 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cdef0) proc(0x7f82b42c9050) pid(20467) version 11:1:1:4 [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9050), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b42cf790, requested num -1 [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c97e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:16:15.124 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:15.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:15.131 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:16:15.131 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ae0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:15.131 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ae0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:16:15.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:15.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:15.333 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9050 [ CSSD]2013-05-23 14:16:15.333 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9050) con(0x7f82b42cdef0) skgpid ospid 20467 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:16.025 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd770) allocated [ CSSD]2013-05-23 14:16:16.026 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:16:16.027 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd770 - 1,2,3 [ CSSD]2013-05-23 14:16:16.027 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8db0) proc(0x7f82b42cd770) pid(20516/20516) version 11:1:1:4 [ CSSD]2013-05-23 14:16:16.044 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cd770), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:16:16.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:16:16.044 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:16:16.044 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:16:16.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:16:16.075 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42c8340), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:16:16.075 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42c8340), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:16:16.075 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:16:16.076 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd770 [ CSSD]2013-05-23 14:16:16.076 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd770) con(0x7f82b42c8db0) skgpid 20516 ospid 20516 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:16.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:17.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:17.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:17.573 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:17.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052a002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:18.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:19.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:19.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:19.934 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:19.934 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:20.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:20.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052b002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:20.318 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:20.318 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:20.318 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:16:20.319 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:20.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052c002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:20.327 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:20.327 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:21.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:21.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:16:21.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b4207cd0) skgpid 13128 ospid 13128 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:21.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4204870) [ CSSD]2013-05-23 14:16:21.593 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4204870), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:16:21.593 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4204870), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:16:21.593 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:16:21.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:16:21.599 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:16:21.599 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:16:21.599 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:16:21.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 14:16:21.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42c6340) skgpid 15136 ospid 15136 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:22.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:23.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:23.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:23.673 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 14:16:23.673 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:16:23.674 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 14:16:23.674 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aed80) proc(0x7f82b42a5440) pid(19911/19911) version 11:1:1:4 [ CSSD]2013-05-23 14:16:23.679 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:16:23.679 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:16:23.679 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:16:23.679 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:16:23.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:23.937 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:16:24.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:25.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:25.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:26.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:27.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:27.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:27.603 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:27.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052d002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:28.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:28.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:28.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:29.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:29.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:30.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:30.380 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 14:16:30.381 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:16:30.381 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 14:16:30.381 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4286800) proc(0x7f82b42574a0) pid(20626) version 11:1:1:4 [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42574a0), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b42b3110, requested num -1 [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd840/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:16:30.388 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:30.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:16:30.396 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:16:30.396 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:30.396 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:16:30.598 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 14:16:30.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b4286800) skgpid ospid 20626 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:31.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:31.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:32.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:33.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:33.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:33.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:33.943 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:34.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:35.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:35.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:35.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052e002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:35.580 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:35.580 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:35.580 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:16:35.580 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:35.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052f002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:35.588 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:35.588 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:36.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:37.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:37.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:37.643 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:37.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0530002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:38.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:38.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:38.947 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:39.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:39.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:40.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:41.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:41.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:42.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:43.059 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 14:16:43.060 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:16:43.061 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 14:16:43.061 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3110) proc(0x7f82b42574a0) pid(20755) version 11:1:1:4 [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42574a0), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b42867f0, requested num -1 [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:16:43.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:43.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:16:43.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:16:43.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:43.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:16:43.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 14:16:43.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b42b3110) skgpid ospid 20755 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:43.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:43.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:43.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:43.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:44.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:45.632 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 14:16:45.633 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:16:45.634 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 14:16:45.634 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3110) proc(0x7f82b42574a0) pid(20776) version 11:1:1:4 [ CSSD]2013-05-23 14:16:45.650 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42574a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:16:45.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:16:45.650 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5c0, requested num -1 [ CSSD]2013-05-23 14:16:45.650 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:45.650 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cd9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:16:45.651 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:16:45.651 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:45.658 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:16:45.658 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:16:45.658 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:16:45.658 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:16:45.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:45.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:45.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 14:16:45.861 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b42b3110) skgpid ospid 20776 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:16:46.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:47.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0531002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:47.031 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:47.031 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:47.031 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:16:47.031 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:47.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0532002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:47.038 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:47.038 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:47.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:47.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:47.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:47.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0533002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:48.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:48.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:48.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:49.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:49.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:50.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:50.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0534002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:50.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:16:50.831 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:16:50.831 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:16:50.831 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:16:50.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0535002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:50.838 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:16:50.838 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:16:51.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:51.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:52.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:53.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:53.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:53.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:53.957 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:54.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:55.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:55.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:56.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:56.752 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 14:16:56.752 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:16:56.753 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 14:16:56.753 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d9290) pid(20893/20893) version 11:1:1:4 [ CSSD]2013-05-23 14:16:56.760 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d9290), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:16:56.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:16:56.760 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:16:56.760 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:16:57.684 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:16:57.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:57.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:16:58.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0536002b) incarnation(174631051) [ CSSD]2013-05-23 14:16:58.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:16:58.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:16:58.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:16:59.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:16:59.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:00.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:00.905 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf340) allocated [ CSSD]2013-05-23 14:17:00.906 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:17:00.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf340 - 1,2,3 [ CSSD]2013-05-23 14:17:00.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a2930) proc(0x7f82b42cf340) pid(20923) version 11:1:1:4 [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf340), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42cf270, requested num -1 [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:00.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:00.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:17:00.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:00.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:00.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:01.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf340 [ CSSD]2013-05-23 14:17:01.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf340) con(0x7f82b42a2930) skgpid ospid 20923 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:01.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:01.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:02.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:02.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:02.963 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:17:04.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:04.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:04.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:06.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:06.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:06.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0537002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:06.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:06.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:06.082 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:17:06.082 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:06.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0538002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:06.089 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:06.089 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:06.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:07.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:17:07.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:17:07.611 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:17:07.612 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:17:07.703 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:07.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf340) allocated [ CSSD]2013-05-23 14:17:07.772 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:07.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf340 - 1,2,3 [ CSSD]2013-05-23 14:17:07.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a2930) proc(0x7f82b42cf340) pid(21022) version 11:1:1:4 [ CSSD]2013-05-23 14:17:07.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0539002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:07.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:07.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:07.776 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:17:07.777 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf340), client(1/0x7f82b429e560) [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429e560 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:07.779 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:07.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053a002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:07.784 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:07.785 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:07.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429e560) [ CSSD]2013-05-23 14:17:07.787 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429e560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:07.787 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cf0f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:07.787 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cf0f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:07.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:07.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:07.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf340 [ CSSD]2013-05-23 14:17:07.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf340) con(0x7f82b42a2930) skgpid ospid 21022 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:08.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:08.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:08.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053b002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:08.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:10.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:10.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:10.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:11.882 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf340) allocated [ CSSD]2013-05-23 14:17:11.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:11.883 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf340 - 1,2,3 [ CSSD]2013-05-23 14:17:11.883 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cf340) pid(21093) version 11:1:1:4 [ CSSD]2013-05-23 14:17:12.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:12.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:12.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:12.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:12.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:14.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:14.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:14.472 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf340 [ CSSD]2013-05-23 14:17:14.472 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf340) con(0x7f82b42c6340) skgpid ospid 21093 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:14.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:16.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:16.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:16.163 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf340) allocated [ CSSD]2013-05-23 14:17:16.164 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:17:16.164 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf340 - 1,2,3 [ CSSD]2013-05-23 14:17:16.164 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a2930) proc(0x7f82b42cf340) pid(21423) version 11:1:1:4 [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf340), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42cf270, requested num -1 [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:16.171 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:16.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:17:16.177 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:16.177 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:16.177 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:16.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf340 [ CSSD]2013-05-23 14:17:16.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf340) con(0x7f82b42a2930) skgpid ospid 21423 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:16.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:17.735 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:17.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:17.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:18.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053c002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:18.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:18.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:18.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:19.816 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf340) allocated [ CSSD]2013-05-23 14:17:19.816 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:19.817 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf340 - 1,2,3 [ CSSD]2013-05-23 14:17:19.817 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cf340) pid(19909/19909) version 11:1:1:4 [ CSSD]2013-05-23 14:17:19.832 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf340), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 14:17:19.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 14:17:19.832 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:17:19.832 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:17:20.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:20.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:20.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:21.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(053d002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:21.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:21.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:21.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:17:21.337 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:21.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053e002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:21.345 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:21.345 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:22.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:22.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:22.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:22.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:22.975 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:24.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:24.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:24.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:26.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:26.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:26.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:26.809 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 14:17:26.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:17:26.809 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:17:26.809 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 14:17:26.813 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b427c5d0) skgpid 20893 ospid 20893 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:26.977 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:26.977 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:17:27.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:28.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053f002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:28.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:28.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:28.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:30.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:30.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:30.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:31.413 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 14:17:31.414 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:17:31.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 14:17:31.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b30f0) proc(0x7f82b42d9290) pid(21603) version 11:1:1:4 [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d9290), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4257550, requested num -1 [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c99a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:31.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:31.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:17:31.426 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:31.426 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:31.427 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:31.629 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 14:17:31.629 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42b30f0) skgpid ospid 21603 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:31.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:31.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:32.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:32.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:32.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:34.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:34.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:34.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:36.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:36.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:36.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0540002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:36.599 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:36.599 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:36.599 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:17:36.599 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:36.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0541002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:36.607 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:36.607 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:36.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:36.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:36.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:37.256 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 14:17:37.257 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:37.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 14:17:37.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baf50) proc(0x7f82b42d9290) pid(21687) version 11:1:1:4 [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d9290), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b42c9360, requested num -1 [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c99a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:37.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:37.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:17:37.272 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:37.272 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:37.272 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:37.475 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 14:17:37.475 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42baf50) skgpid ospid 21687 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:37.795 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:38.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0542002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:38.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:38.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:38.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:40.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:40.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:40.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:41.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:41.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:42.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:42.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:42.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:43.320 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 14:17:43.320 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:43.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 14:17:43.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b30f0) proc(0x7f82b42d9290) pid(21735) version 11:1:1:4 [ CSSD]2013-05-23 14:17:43.327 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d9290), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:17:43.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:17:43.327 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b4257550, requested num -1 [ CSSD]2013-05-23 14:17:43.327 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:43.327 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c99a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:43.328 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:43.328 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:43.335 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:17:43.335 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:43.335 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:43.335 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:43.537 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 14:17:43.537 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42b30f0) skgpid ospid 21735 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:44.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:44.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:44.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:45.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:45.991 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:17:46.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:46.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:46.665 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 14:17:46.666 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:17:46.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 14:17:46.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5840) proc(0x7f82b42d91c0) pid(21769) version 11:1:1:4 [ CSSD]2013-05-23 14:17:46.683 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d91c0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:17:46.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:17:46.683 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:17:46.683 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:46.683 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:17:46.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:17:46.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:46.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:17:46.691 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:17:46.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:17:46.691 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:17:46.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 14:17:46.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b42b5840) skgpid ospid 21769 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:46.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d4d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:17:47.107 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 16271 ospid 16271 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:17:47.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0543002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:47.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:47.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:47.291 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:17:47.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:47.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0544002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:47.298 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:47.298 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:47.814 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:48.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0545002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:48.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:48.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:48.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:49.470 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:17:49.471 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:17:49.472 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:17:49.472 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b4207a80) pid(21812/21812) version 11:1:1:4 [ CSSD]2013-05-23 14:17:49.488 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 14:17:49.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:17:49.488 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:17:49.488 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:17:50.281 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(2/0x7f82b42d9760) [ CSSD]2013-05-23 14:17:50.282 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 14:17:50.282 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:17:50.282 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 14:17:50.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:50.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:50.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:50.994 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:51.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:51.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0546002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:51.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:17:51.851 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:17:51.851 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:17:51.852 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:17:51.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0547002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:51.859 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:17:51.859 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:17:52.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:52.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:53.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:54.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:54.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:55.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:55.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:17:55.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:17:56.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:56.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:57.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:17:57.836 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:17:58.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0548002b) incarnation(174631051) [ CSSD]2013-05-23 14:17:58.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:17:58.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:17:59.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:00.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:00.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:01.001 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:01.001 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:01.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:01.932 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:01.933 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:18:01.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:01.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42c9500) pid(21953) version 11:1:1:4 [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b42a18e0) [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a18e0 with con 0x7f82b42c7cc0, requested num -1 [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:01.941 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:01.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a18e0) [ CSSD]2013-05-23 14:18:01.948 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a18e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:18:01.948 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:01.948 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:02.151 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:02.151 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b427c5d0) skgpid ospid 21953 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:02.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:02.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:03.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:04.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:04.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:05.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:05.004 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:18:05.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:06.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:06.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:07.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0549002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:07.101 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:18:07.101 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:18:07.101 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:18:07.101 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:07.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:07.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(054a002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:07.108 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:18:07.108 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:18:07.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:08.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054b002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:08.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:08.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:09.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:10.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:10.007 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:10.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:10.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:11.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:12.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:12.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:13.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:14.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:14.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:15.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:15.010 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:15.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:16.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:16.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:17.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:17.180 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:17.181 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:18:17.181 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:17.181 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c9500) pid(22106) version 11:1:1:4 [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b42c7cc0, requested num -1 [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:17.186 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:17.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:18:17.192 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:18:17.192 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:17.192 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:17.394 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:17.394 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b42a29f0) skgpid ospid 22106 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:17.875 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:18.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054c002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:18.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:18.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:19.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:20.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:20.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:20.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:20.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:21.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:22.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(054d002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:22.351 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:18:22.351 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:18:22.351 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:18:22.351 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:22.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(054e002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:22.357 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:18:22.358 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:18:22.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:22.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:23.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:24.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:24.015 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:18:24.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:24.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:25.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:26.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:26.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:27.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:27.896 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:28.230 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 14:18:28.231 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:28.231 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 14:18:28.231 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42574a0) pid(22249/22249) version 11:1:1:4 [ CSSD]2013-05-23 14:18:28.248 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42574a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:18:28.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:18:28.248 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:18:28.248 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 14:18:28.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b42c7cc0) skgpid 22249 ospid 22249 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:28.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054f002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:28.464 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:28.465 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:28.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:28.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c9500) pid(22252/22252) version 11:1:1:4 [ CSSD]2013-05-23 14:18:28.472 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:18:28.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:18:28.472 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:18:28.472 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:18:28.539 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:18:28.539 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:18:28.539 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:18:28.539 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:18:28.540 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:28.540 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b42a29f0) skgpid 22252 ospid 22252 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:28.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:28.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:29.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:29.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:29.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:30.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:30.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:30.778 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:30.779 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:30.780 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:30.780 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c9500) pid(22271) version 11:1:1:4 [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41edd50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9ba0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:30.787 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:30.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:18:30.796 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:18:30.796 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ea0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:18:30.796 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c9ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:30.909 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cae80) allocated [ CSSD]2013-05-23 14:18:30.910 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:30.911 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cae80 - 1,2,3 [ CSSD]2013-05-23 14:18:30.911 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42cae80) pid(22282) version 11:1:1:4 [ CSSD]2013-05-23 14:18:30.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:18:30.940 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:18:30.943 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:18:30.944 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cae80 [ CSSD]2013-05-23 14:18:30.944 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cae80) con(0x7f82b42c7cc0) skgpid ospid 22282 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:31.098 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:31.098 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b42ccc30) skgpid ospid 22271 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:31.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:32.431 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 14:18:32.432 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:18:32.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 14:18:32.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42c92b0) pid(22295) version 11:1:1:4 [ CSSD]2013-05-23 14:18:32.439 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c92b0), client(1/0x7f82b42c8340) [ CSSD]2013-05-23 14:18:32.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:18:32.439 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42c8340 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:18:32.439 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:32.439 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9c70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:18:32.440 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:32.440 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:32.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42c8340) [ CSSD]2013-05-23 14:18:32.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42c8340), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:18:32.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:32.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:32.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 14:18:32.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42c7cc0) skgpid ospid 22295 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:32.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:32.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:33.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:34.022 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:34.022 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:34.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:34.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:35.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:36.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:36.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:37.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:37.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0550002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:37.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:18:37.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:18:37.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:18:37.612 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:37.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0551002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:37.619 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:18:37.620 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:18:37.926 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:38.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0552002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:38.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:38.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:39.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:39.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:39.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:40.744 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42574a0) allocated [ CSSD]2013-05-23 14:18:40.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:40.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42574a0 - 1,2,3 [ CSSD]2013-05-23 14:18:40.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42574a0) pid(22403) version 11:1:1:4 [ CSSD]2013-05-23 14:18:40.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:40.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:41.289 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42574a0 [ CSSD]2013-05-23 14:18:41.289 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42574a0) con(0x7f82b42ccc30) skgpid ospid 22403 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:41.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:42.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:42.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:43.028 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:43.029 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:18:43.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:43.587 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:43.588 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:43.588 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:43.588 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c9500) pid(22575) version 11:1:1:4 [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b427d4d0) [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4d0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:43.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:43.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4d0) [ CSSD]2013-05-23 14:18:43.613 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:18:43.613 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:43.613 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:43.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:43.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b42a29f0) skgpid ospid 22575 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:44.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:44.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:45.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:46.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:46.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:47.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:47.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0553002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:47.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:18:47.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:18:47.553 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:18:47.553 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:47.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0554002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:47.561 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:18:47.561 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:18:47.682 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c9500) allocated [ CSSD]2013-05-23 14:18:47.683 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:18:47.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c9500 - 1,2,3 [ CSSD]2013-05-23 14:18:47.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42c9500) pid(22612) version 11:1:1:4 [ CSSD]2013-05-23 14:18:47.690 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c9500), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:18:47.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:18:47.690 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:18:47.690 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:47.690 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:18:47.691 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:18:47.691 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:47.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:18:47.698 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:18:47.698 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:18:47.698 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:18:47.901 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c9500 [ CSSD]2013-05-23 14:18:47.901 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c9500) con(0x7f82b427c5d0) skgpid ospid 22612 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:47.957 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:48.031 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:48.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:48.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0555002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:48.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:48.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:49.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:50.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:50.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:51.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 14:18:51.635 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b429e880) skgpid 16891 ospid 16891 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:51.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:18:51.636 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:18:51.636 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:18:51.636 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 14:18:51.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:18:51.638 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:18:51.638 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:18:51.638 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b45f0 [ CSSD]2013-05-23 14:18:51.640 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b45f0) con(0x7f82b427d8a0) skgpid 16893 ospid 16893 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 14:18:51.646 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4257120) skgpid 16895 ospid 16895 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:18:52.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0556002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:52.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:18:52.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:18:52.871 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:18:52.871 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:18:52.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0557002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:52.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:18:52.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:18:52.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:52.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:53.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:53.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:53.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:54.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:54.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:55.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:56.859 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 14:18:56.860 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:18:56.860 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 14:18:56.860 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42a3ea0) pid(21876/21876) version 11:1:1:4 [ CSSD]2013-05-23 14:18:56.867 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ea0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:18:56.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:18:56.867 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:18:56.867 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:18:57.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:57.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:57.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:18:57.977 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:18:58.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:18:58.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:18:58.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0558002b) incarnation(174631051) [ CSSD]2013-05-23 14:18:59.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:18:59.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:18:59.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:01.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:01.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:01.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:02.040 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:02.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:19:02.939 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 14:19:02.940 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:19:02.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 14:19:02.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b427d340) pid(22795) version 11:1:1:4 [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427d340), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:02.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:02.956 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:19:02.956 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:19:02.956 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:02.956 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:03.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:03.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:03.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 14:19:03.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b427d8a0) skgpid ospid 22795 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:03.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:05.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:05.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:05.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:07.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:07.043 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:07.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:07.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:07.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:08.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:08.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0559002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:08.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:19:08.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:19:08.121 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:19:08.121 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:08.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(055a002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:08.128 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:19:08.128 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:19:08.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055b002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:09.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:09.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:09.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:11.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:11.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:11.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:12.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:12.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:13.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:13.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:13.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:15.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:15.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:15.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:17.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:17.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:17.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:17.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:17.455 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 14:19:17.456 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:17.457 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 14:19:17.457 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b427d340) pid(22936) version 11:1:1:4 [ CSSD]2013-05-23 14:19:17.577 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e6d0) allocated [ CSSD]2013-05-23 14:19:17.578 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:17.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e6d0 - 1,2,3 [ CSSD]2013-05-23 14:19:17.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b429e6d0) pid(22946) version 11:1:1:4 [ CSSD]2013-05-23 14:19:17.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:19:17.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:19:17.601 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e6d0 [ CSSD]2013-05-23 14:19:17.601 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e6d0) con(0x7f82b427d8a0) skgpid ospid 22946 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5320/0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5320 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42b00d0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42baac0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:17.678 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:19:17.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5320 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:17.686 [1199044928] >TRACE: clssgmExitGrock: client 5320 (0x7f82b42b00d0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:19:17.686 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:19:17.686 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:17.687 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 14:19:17.687 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b42a29f0) skgpid ospid 22936 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:17.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:18.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:18.203 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 14:19:18.204 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:19:18.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 14:19:18.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b427d340) pid(22964) version 11:1:1:4 [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427d340), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:18.222 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:18.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:19:18.228 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:19:18.228 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d91c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:18.228 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d91c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:18.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055c002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:18.431 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 14:19:18.431 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b42a29f0) skgpid ospid 22964 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:19.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:19.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:19.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:21.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:21.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:21.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:22.053 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:22.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:23.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:23.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:23.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(055d002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:23.376 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:19:23.376 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:19:23.377 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:19:23.377 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:23.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(055e002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:23.384 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:19:23.384 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:19:23.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:25.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:25.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:25.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:26.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:26.056 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:19:27.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:27.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:27.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:28.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:28.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055f002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:29.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:29.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:29.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:31.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:31.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:31.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:31.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:31.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:33.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:33.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:33.475 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 14:19:33.476 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:19:33.477 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 14:19:33.477 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b427d340) pid(23112) version 11:1:1:4 [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427d340), client(1/0x7f82b42a19b0) [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a19b0) [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a19b0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:33.512 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:33.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a19b0) [ CSSD]2013-05-23 14:19:33.519 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a19b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:19:33.519 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:33.519 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:33.721 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 14:19:33.721 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b42a29f0) skgpid ospid 23112 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:33.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:35.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:35.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:35.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:36.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:36.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:37.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:37.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:37.904 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d340) allocated [ CSSD]2013-05-23 14:19:37.905 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:37.906 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d340 - 1,2,3 [ CSSD]2013-05-23 14:19:37.906 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b427d340) pid(23177/23177) version 11:1:1:4 [ CSSD]2013-05-23 14:19:37.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:37.912 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427d340), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:19:37.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:19:37.912 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:37.912 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:19:38.483 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:38.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0560002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:38.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0561002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:38.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:19:38.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:19:38.627 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:19:38.627 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:38.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0562002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:38.635 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:19:38.635 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:19:39.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:39.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:39.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:41.066 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:41.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:41.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:41.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:41.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmRegisterClient: proc(28/0x7f82b422bb00), client(9/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 9 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmJoinGrock: global grock IGHWPRODSYS.KUPC$C_1_20130523141939 new client 0x7f82b41c8ba0 with con 0x7f82b427c5d0, requested num 1 [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock IGHWPRODSYS.KUPC$C_1_20130523141939 [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmAddMember: new master 1 for group(IGHWPRODSYS.KUPC$C_1_20130523141939) [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmAddMember: Adding fencing for member 1, group IGHWPRODSYS.KUPC$C_1_20130523141939, death 1, SAGE 0 [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmAddMember: member (1/0x7f82b429e7c0) added. pbsz(0) prsz(0) flags 0x0 to grock (0x7f82b42baac0/IGHWPRODSYS.KUPC$C_1_20130523141939) [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS.KUPC$C_1_20130523141939) count(1) master(1) event(1), incarn 1, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 14:19:43.206 [1199044928] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODSYS.KUPC$C_1_20130523141939 member(1/Local) node(1) flags 0x0 0x0 [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmRegisterClient: proc(28/0x7f82b422bb00), client(10/0x7f82b4286810) [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 10 (0x7f82b4286810) [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmJoinGrock: global grock IGHWPRODSYS.KUPC$S_1_20130523141939 new client 0x7f82b4286810 with con 0x7f82b42c92b0, requested num 1 [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock IGHWPRODSYS.KUPC$S_1_20130523141939 [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmAddMember: new master 1 for group(IGHWPRODSYS.KUPC$S_1_20130523141939) [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmAddMember: Adding fencing for member 1, group IGHWPRODSYS.KUPC$S_1_20130523141939, death 1, SAGE 0 [ CSSD]2013-05-23 14:19:43.389 [1199044928] >TRACE: clssgmAddMember: member (1/0x7f82b42ccf90) added. pbsz(0) prsz(0) flags 0x0 to grock (0x7f82b42b3350/IGHWPRODSYS.KUPC$S_1_20130523141939) [ CSSD]2013-05-23 14:19:43.390 [1199044928] >TRACE: clssgmQueueGrockEvent: groupName(IGHWPRODSYS.KUPC$S_1_20130523141939) count(1) master(1) event(1), incarn 1, mbrc 1, to member 1, events 0x0, state 0x0 [ CSSD]2013-05-23 14:19:43.390 [1199044928] >TRACE: clssgmCommonAddMember: global group grock IGHWPRODSYS.KUPC$S_1_20130523141939 member(1/Local) node(1) flags 0x0 0x0 [ CSSD]2013-05-23 14:19:43.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:43.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:43.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2500) allocated [ CSSD]2013-05-23 14:19:43.869 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:43.869 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2500 - 1,2,3 [ CSSD]2013-05-23 14:19:43.869 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2500) pid(23222) version 11:1:1:4 [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a2500), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b42c7cc0, requested num -1 [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:43.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:43.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:43.884 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:19:43.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:43.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:43.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:44.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2500 [ CSSD]2013-05-23 14:19:44.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2500) con(0x7f82b427d8a0) skgpid ospid 23222 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:44.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a22c0) allocated [ CSSD]2013-05-23 14:19:44.566 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:44.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a22c0 - 1,2,3 [ CSSD]2013-05-23 14:19:44.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a22c0) pid(23237/23237) version 11:1:1:4 [ CSSD]2013-05-23 14:19:44.583 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a22c0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:19:44.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:19:44.584 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:44.584 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:19:45.068 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:45.068 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:19:45.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:45.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:45.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:47.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:47.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:47.617 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ca0a0) allocated [ CSSD]2013-05-23 14:19:47.618 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:47.619 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ca0a0 - 1,2,3 [ CSSD]2013-05-23 14:19:47.619 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42ca0a0) pid(21810/21810) version 11:1:1:4 [ CSSD]2013-05-23 14:19:47.625 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ca0a0), client(1/0x7f82b42a19b0) [ CSSD]2013-05-23 14:19:47.625 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a19b0) [ CSSD]2013-05-23 14:19:47.625 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:47.625 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:19:47.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0563002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:47.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:19:47.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:19:47.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:19:47.807 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:47.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0564002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:47.814 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:19:47.814 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:19:47.836 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd9f0) allocated [ CSSD]2013-05-23 14:19:47.837 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:47.837 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd9f0 - 1,2,3 [ CSSD]2013-05-23 14:19:47.837 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cab20) proc(0x7f82b42dd9f0) pid(22715/22715) version 11:1:1:4 [ CSSD]2013-05-23 14:19:47.855 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd9f0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 14:19:47.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 14:19:47.855 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:47.855 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:19:47.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:48.002 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd9f0), client(2/0x7f82b427d5c0) [ CSSD]2013-05-23 14:19:48.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:19:48.002 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:19:48.002 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:19:48.348 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ca0a0), client(2/0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:48.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:19:48.348 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:19:48.348 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 14:19:48.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0565002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:48.519 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:48.579 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a22c0), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 14:19:48.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:19:48.579 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:19:48.579 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 14:19:48.718 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e12f0) allocated [ CSSD]2013-05-23 14:19:48.719 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:48.719 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e12f0 - 1,2,3 [ CSSD]2013-05-23 14:19:48.719 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42df020) proc(0x7f82b42e12f0) pid(22707/22707) version 11:1:1:4 [ CSSD]2013-05-23 14:19:48.737 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e12f0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:19:48.737 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:19:48.737 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:48.737 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:19:48.756 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e12f0), client(2/0x7f82b42de070) [ CSSD]2013-05-23 14:19:48.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42de070) [ CSSD]2013-05-23 14:19:48.756 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:19:48.756 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:19:48.756 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e4510) allocated [ CSSD]2013-05-23 14:19:48.757 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:19:48.758 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e4510 - 1,2,3 [ CSSD]2013-05-23 14:19:48.758 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e2240) proc(0x7f82b42e4510) pid(23267) version 11:1:1:4 [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e4510), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42e4430, requested num -1 [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e4c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:19:48.764 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:48.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:19:48.770 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:19:48.770 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e4f90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:19:48.771 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e4f90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:19:48.973 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e4510 [ CSSD]2013-05-23 14:19:48.973 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e4510) con(0x7f82b42e2240) skgpid ospid 23267 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:19:49.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:49.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:49.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:50.072 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:50.072 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:50.568 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e46a0) allocated [ CSSD]2013-05-23 14:19:50.569 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:19:50.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e46a0 - 1,2,3 [ CSSD]2013-05-23 14:19:50.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e23d0) proc(0x7f82b42e46a0) pid(23320/23320) version 11:1:1:4 [ CSSD]2013-05-23 14:19:50.587 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e46a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:19:50.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:19:50.587 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:19:50.587 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:19:51.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:51.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:51.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:53.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:53.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:53.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0566002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:53.877 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:19:53.877 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:19:53.877 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:19:53.877 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:19:53.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0567002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:53.885 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:19:53.885 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:19:54.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:55.075 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:19:55.075 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:19:55.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:55.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:56.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:57.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:57.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:19:58.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:19:58.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0568002b) incarnation(174631051) [ CSSD]2013-05-23 14:19:58.544 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:19:59.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:19:59.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:00.078 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:00.078 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:00.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:01.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:01.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:02.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:03.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:03.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:04.007 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e71d0) allocated [ CSSD]2013-05-23 14:20:04.008 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:20:04.008 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e71d0 - 1,2,3 [ CSSD]2013-05-23 14:20:04.008 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42e71d0) pid(23605) version 11:1:1:4 [ CSSD]2013-05-23 14:20:04.015 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e71d0), client(1/0x7f82b42e7890) [ CSSD]2013-05-23 14:20:04.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e7890) [ CSSD]2013-05-23 14:20:04.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e7890 with con 0x7f82b42e70e0, requested num -1 [ CSSD]2013-05-23 14:20:04.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:04.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e7a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:20:04.016 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:20:04.016 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:04.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e7890) [ CSSD]2013-05-23 14:20:04.022 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e7890), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:20:04.022 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e7d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:04.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e7d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:20:04.081 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:04.081 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:20:04.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:04.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e71d0 [ CSSD]2013-05-23 14:20:04.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e71d0) con(0x7f82b42ddfc0) skgpid ospid 23605 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:04.566 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e7cb0) allocated [ CSSD]2013-05-23 14:20:04.566 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:20:04.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e7cb0 - 1,2,3 [ CSSD]2013-05-23 14:20:04.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42e7cb0) pid(23654/23654) version 11:1:1:4 [ CSSD]2013-05-23 14:20:04.573 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e7cb0), client(1/0x7f82b42e6b20) [ CSSD]2013-05-23 14:20:04.573 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42e6b20) [ CSSD]2013-05-23 14:20:04.573 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:20:04.574 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42e6b20) [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42e6b20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42e6b20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e7cb0 [ CSSD]2013-05-23 14:20:05.354 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e7cb0) con(0x7f82b42ddfc0) skgpid 23654 ospid 23654 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:05.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:05.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:06.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:07.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:07.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:08.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:08.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0569002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:08.568 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:09.084 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:09.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:09.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056a002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:09.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:09.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:09.127 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:09.128 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:09.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056b002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:09.134 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:09.135 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:09.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:09.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:10.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:11.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:11.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:12.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:13.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:13.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:14.088 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:14.088 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:14.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:15.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:15.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:16.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5240 [ CSSD]2013-05-23 14:20:17.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5240) con(0x7f82b429ea70) skgpid 18151 ospid 18151 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:17.275 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe180) allocated [ CSSD]2013-05-23 14:20:17.276 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:20:17.276 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe180 - 1,2,3 [ CSSD]2013-05-23 14:20:17.276 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b41fe180) pid(23735/23735) version 11:1:1:4 [ CSSD]2013-05-23 14:20:17.294 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b41fe180), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:20:17.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:20:17.294 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:20:17.294 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:20:17.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:17.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:18.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:18.592 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:18.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056c002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:19.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:19.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:19.261 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e7420) allocated [ CSSD]2013-05-23 14:20:19.262 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:20:19.263 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e7420 - 1,2,3 [ CSSD]2013-05-23 14:20:19.263 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42e7420) pid(23753) version 11:1:1:4 [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e7420), client(1/0x7f82b42e7ae0) [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e7ae0) [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e7ae0 with con 0x7f82b42e7330, requested num -1 [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e7c50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:20:19.269 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:19.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e7ae0) [ CSSD]2013-05-23 14:20:19.277 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e7ae0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:20:19.277 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e7f50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:19.277 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e7f50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:20:19.479 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e7420 [ CSSD]2013-05-23 14:20:19.479 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e7420) con(0x7f82b42ddfc0) skgpid ospid 23753 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:19.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:19.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:20.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:21.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:21.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:22.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:23.094 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:23.095 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:20:23.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:23.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:24.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:24.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056d002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:24.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:24.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:24.388 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:24.388 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:24.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056e002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:24.395 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:24.395 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:25.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:25.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:26.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:27.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:27.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:28.098 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:28.098 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:28.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:28.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:28.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056f002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:29.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:29.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:30.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:31.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:31.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:32.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:33.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:33.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:33.665 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e46a0), client(2/0x7f82b42e5070) [ CSSD]2013-05-23 14:20:33.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42e5070) [ CSSD]2013-05-23 14:20:33.665 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:20:33.665 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 14:20:33.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:33.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:34.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:34.528 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e7960) allocated [ CSSD]2013-05-23 14:20:34.529 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:20:34.529 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e7960 - 1,2,3 [ CSSD]2013-05-23 14:20:34.529 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e5680) proc(0x7f82b42e7960) pid(23913) version 11:1:1:4 [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e7960), client(1/0x7f82b42e8020) [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e8020) [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e8020 with con 0x7f82b42e7870, requested num -1 [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e8190/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:20:34.545 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:34.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e8020) [ CSSD]2013-05-23 14:20:34.552 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e8020), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:20:34.552 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e8490) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:34.553 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e8490) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:20:34.755 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e7960 [ CSSD]2013-05-23 14:20:34.755 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e7960) con(0x7f82b42e5680) skgpid ospid 23913 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:35.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:35.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:36.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:37.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:37.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:38.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:38.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:38.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:38.640 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:38.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0570002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:39.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0571002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:39.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:39.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:39.638 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:39.638 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:39.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0572002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:39.646 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:39.646 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:39.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:39.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:40.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:41.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:41.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:42.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:43.108 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:43.108 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:43.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:43.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:44.134 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e7960) allocated [ CSSD]2013-05-23 14:20:44.135 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:20:44.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e7960 - 1,2,3 [ CSSD]2013-05-23 14:20:44.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e5680) proc(0x7f82b42e7960) pid(24020) version 11:1:1:4 [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e7960), client(1/0x7f82b42e8020) [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e8020) [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e8020 with con 0x7f82b42e7870, requested num -1 [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e8190/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:20:44.153 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:44.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e8020) [ CSSD]2013-05-23 14:20:44.159 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e8020), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:20:44.159 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e8490) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:44.160 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e8490) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:20:44.362 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e7960 [ CSSD]2013-05-23 14:20:44.362 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e7960) con(0x7f82b42e5680) skgpid ospid 24020 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:44.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:45.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:45.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:46.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:47.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42e5070) [ CSSD]2013-05-23 14:20:47.503 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42e5070), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:20:47.503 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42e5070), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:20:47.503 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e46a0 [ CSSD]2013-05-23 14:20:47.517 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e46a0) con(0x7f82b42e23d0) skgpid 23320 ospid 23320 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:47.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 9 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:20:47.916 [1199044928] >TRACE: clssgmExitGrock: client 9 (0x7f82b41c8ba0), grock IGHWPRODSYS.KUPC$C_1_20130523141939, member 1 [ CSSD]2013-05-23 14:20:47.916 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 1 (0x7f82b429e7c0) in global grock IGHWPRODSYS.KUPC$C_1_20130523141939 [ CSSD]2013-05-23 14:20:47.916 [1199044928] >TRACE: clssgmRemoveMember: grock IGHWPRODSYS.KUPC$C_1_20130523141939, member number 1 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 2 [ CSSD]2013-05-23 14:20:47.918 [1199044928] >TRACE: clssgmGroupState: requested group state of unknown group IGHWPRODSYS.KUPC$C_1_20130523141939 [ CSSD]2013-05-23 14:20:47.918 [1199044928] >TRACE: clssgmGroupState: requested group state of group IGHWPRODSYS.KUPC$C_1_20130523141939, member count 0 [ CSSD]2013-05-23 14:20:47.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:47.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:48.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0573002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:48.069 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:48.069 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:48.069 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:48.069 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:48.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0574002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:48.076 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:48.076 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:48.112 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:48.112 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:48.205 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 10 (0x7f82b4286810) [ CSSD]2013-05-23 14:20:48.205 [1199044928] >TRACE: clssgmExitGrock: client 10 (0x7f82b4286810), grock IGHWPRODSYS.KUPC$S_1_20130523141939, member 1 [ CSSD]2013-05-23 14:20:48.205 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 1 (0x7f82b42ccf90) in global grock IGHWPRODSYS.KUPC$S_1_20130523141939 [ CSSD]2013-05-23 14:20:48.206 [1199044928] >TRACE: clssgmRemoveMember: grock IGHWPRODSYS.KUPC$S_1_20130523141939, member number 1 (0x7f82b42ccf90) node number 1 state 0x14 member refcnt 0 grock type 2 [ CSSD]2013-05-23 14:20:48.208 [1199044928] >TRACE: clssgmGroupState: requested group state of unknown group IGHWPRODSYS.KUPC$S_1_20130523141939 [ CSSD]2013-05-23 14:20:48.208 [1199044928] >TRACE: clssgmGroupState: requested group state of group IGHWPRODSYS.KUPC$S_1_20130523141939, member count 0 [ CSSD]2013-05-23 14:20:48.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:48.664 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:48.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0575002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:49.792 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:20:49.793 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:20:49.793 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:20:49.793 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42573d0) pid(24070) version 11:1:1:4 [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42573d0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42c9370, requested num -1 [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:20:49.810 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:49.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:20:49.818 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:20:49.818 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3aa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:20:49.818 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3aa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:20:49.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 14:20:49.904 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:20:49.904 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:20:49.904 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a22c0 [ CSSD]2013-05-23 14:20:49.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a22c0) con(0x7f82b427d8a0) skgpid 23237 ospid 23237 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:49.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:49.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:50.021 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:20:50.021 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42ddfc0) skgpid ospid 24070 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d340 [ CSSD]2013-05-23 14:20:50.025 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d340) con(0x7f82b42a29f0) skgpid 23177 ospid 23177 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:20:50.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:52.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:52.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:52.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0576002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:52.550 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:52.550 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:52.550 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:52.550 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:52.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0577002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:52.558 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:52.558 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:52.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:53.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:53.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:20:54.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:54.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:54.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:54.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0578002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:54.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:20:54.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:20:54.892 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:20:54.892 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:20:54.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0579002b) incarnation(174631051) [ CSSD]2013-05-23 14:20:54.900 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:20:54.900 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:20:56.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:56.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:56.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:57.117 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:20:57.118 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:20:58.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:20:58.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:20:58.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:20:58.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:20:58.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(057a002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:00.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:00.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:00.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:02.120 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:02.121 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:02.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:02.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:02.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:04.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:04.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:04.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:05.057 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b4520) allocated [ CSSD]2013-05-23 14:21:05.058 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:21:05.058 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b4520 - 1,2,3 [ CSSD]2013-05-23 14:21:05.058 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42b4520) pid(24246) version 11:1:1:4 [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b4520), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:21:05.065 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:05.071 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:21:05.071 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:21:05.071 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dfe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:05.071 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dfe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:21:05.273 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b4520 [ CSSD]2013-05-23 14:21:05.273 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b4520) con(0x7f82b42ddfc0) skgpid ospid 24246 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:06.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:06.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:06.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:07.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:07.124 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:08.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:08.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:08.720 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:08.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(057b002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:08.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:10.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057c002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:10.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:10.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:10.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:21:10.063 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:10.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057d002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:10.070 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:10.070 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:10.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057e002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:10.141 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:10.141 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:10.141 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:21:10.141 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:10.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057f002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:10.149 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:10.149 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:10.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:10.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:10.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:21:10.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:21:10.203 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:21:10.203 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:21:10.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:12.127 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:12.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:12.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:12.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:12.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:14.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:14.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:14.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:15.525 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 14:21:15.525 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:21:15.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 14:21:15.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b42c7b30) pid(24382/24382) version 11:1:1:4 [ CSSD]2013-05-23 14:21:15.532 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c7b30), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:21:15.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:21:15.532 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:21:15.532 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 14:21:15.552 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42ddfc0) skgpid 24382 ospid 24382 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:16.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:16.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:16.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:17.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:17.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:18.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:18.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:18.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:18.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0580002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:18.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:20.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:20.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:20.307 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b4520) allocated [ CSSD]2013-05-23 14:21:20.308 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:21:20.309 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b4520 - 1,2,3 [ CSSD]2013-05-23 14:21:20.309 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42b4520) pid(24417) version 11:1:1:4 [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b4520), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:21:20.316 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:20.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:21:20.323 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:21:20.323 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:20.323 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:21:20.525 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b4520 [ CSSD]2013-05-23 14:21:20.525 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b4520) con(0x7f82b42a29f0) skgpid ospid 24417 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:20.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:22.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:22.134 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:22.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:22.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:22.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:24.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:24.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:24.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:25.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0581002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:25.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:25.392 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:25.392 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:21:25.392 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:25.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0582002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:25.400 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:25.400 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:26.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:26.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:26.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:27.137 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:27.137 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:28.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:28.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:28.766 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:28.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0583002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:29.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:29.144 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 14:21:29.145 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:21:29.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 14:21:29.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42c7b30) pid(24464/24464) version 11:1:1:4 [ CSSD]2013-05-23 14:21:29.151 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c7b30), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 14:21:29.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:21:29.151 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:21:29.151 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:21:30.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:30.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:31.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:32.140 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:32.141 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:32.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:32.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:33.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:34.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:34.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:35.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:35.562 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de530) allocated [ CSSD]2013-05-23 14:21:35.563 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:21:35.563 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de530 - 1,2,3 [ CSSD]2013-05-23 14:21:35.563 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42de530) pid(24560) version 11:1:1:4 [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de530), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c9380, requested num -1 [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:21:35.569 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:35.576 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:21:35.576 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:21:35.576 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:35.577 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:21:35.779 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de530 [ CSSD]2013-05-23 14:21:35.779 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de530) con(0x7f82b427c5d0) skgpid ospid 24560 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:36.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:36.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:37.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:37.144 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:37.144 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:38.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:38.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:38.789 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:38.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0584002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:39.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:40.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:40.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:40.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0585002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:40.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:40.643 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:40.643 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:21:40.643 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:40.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0586002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:40.651 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:40.651 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:41.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:42.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:42.148 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:42.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:42.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:43.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:44.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:44.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:44.416 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:21:44.417 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:21:44.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:21:44.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9380) proc(0x7f82b429e330) pid(24670) version 11:1:1:4 [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e330), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ddfc0, requested num -1 [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:21:44.426 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:44.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:21:44.434 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:21:44.434 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:44.435 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:21:44.637 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:21:44.637 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42c9380) skgpid ospid 24670 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:45.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:46.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:46.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:47.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:47.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:47.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:48.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0587002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:48.324 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:48.324 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:48.324 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:21:48.324 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:48.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0588002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:48.331 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:48.331 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:48.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:48.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:48.815 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:48.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0589002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:49.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:50.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:50.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:50.814 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:21:50.815 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:21:50.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:21:50.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42573d0) pid(24721) version 11:1:1:4 [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42573d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c9380, requested num -1 [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:21:50.833 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:50.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:21:50.840 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:21:50.840 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:21:50.840 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:21:51.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:21:51.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b427c5d0) skgpid ospid 24721 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:51.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:52.154 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:52.154 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:21:52.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:52.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:53.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:54.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:54.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:55.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:55.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058a002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:55.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:21:55.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:21:55.894 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:21:55.894 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:21:55.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058b002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:55.903 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:21:55.903 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:21:56.157 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:21:56.157 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:21:56.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:56.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:57.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:21:58.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:21:58.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:21:58.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de530) allocated [ CSSD]2013-05-23 14:21:58.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:21:58.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de530 - 1,2,3 [ CSSD]2013-05-23 14:21:58.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42de530) pid(24836/24836) version 11:1:1:4 [ CSSD]2013-05-23 14:21:58.746 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de530), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:21:58.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:21:58.746 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:21:58.746 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de530 [ CSSD]2013-05-23 14:21:58.771 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de530) con(0x7f82b42ccc30) skgpid 24836 ospid 24836 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:21:58.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:21:58.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(058c002b) incarnation(174631051) [ CSSD]2013-05-23 14:21:59.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:00.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:00.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:01.160 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:01.160 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:01.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:02.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058d002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:02.518 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:02.518 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:02.518 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:02.518 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:02.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058e002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:02.526 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:02.526 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:02.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:02.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:03.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:04.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:04.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:05.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:06.076 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:22:06.076 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:22:06.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:22:06.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddfc0) proc(0x7f82b429e330) pid(24897) version 11:1:1:4 [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e330), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:22:06.083 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:06.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:22:06.090 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:22:06.090 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:06.090 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:22:06.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:06.164 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:06.293 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:22:06.293 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42ddfc0) skgpid ospid 24897 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:06.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:06.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:07.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:08.006 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:22:08.007 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:22:08.008 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:22:08.009 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:22:08.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058f002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:08.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:08.084 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:08.084 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:22:08.084 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:22:08.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0590002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:08.091 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:08.091 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:08.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:08.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:08.867 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:09.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0591002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:09.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:10.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:10.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:11.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0592002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:11.156 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:11.156 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:11.156 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:11.156 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:11.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0593002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:11.163 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:11.163 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:11.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:11.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:11.342 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:22:11.343 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:22:11.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:22:11.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9380) proc(0x7f82b42573d0) pid(25010) version 11:1:1:4 [ CSSD]2013-05-23 14:22:11.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:12.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:12.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:13.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:13.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:22:13.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42c9380) skgpid ospid 25010 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:14.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:14.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:15.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:15.170 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:22:15.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:16.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:16.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:17.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:18.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:18.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:18.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:19.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0594002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:19.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:20.173 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:20.173 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:20.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:20.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:21.326 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de530) allocated [ CSSD]2013-05-23 14:22:21.327 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:22:21.327 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de530 - 1,2,3 [ CSSD]2013-05-23 14:22:21.327 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42de530) pid(25374) version 11:1:1:4 [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de530), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:22:21.343 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:21.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:22:21.351 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:22:21.351 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:21.351 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:22:21.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:21.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de530 [ CSSD]2013-05-23 14:22:21.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de530) con(0x7f82b42ccc30) skgpid ospid 25374 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:22.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:22.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:23.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:24.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:24.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:25.176 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:25.176 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:25.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:26.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0595002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:26.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:26.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:26.417 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:26.417 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:26.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0596002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:26.425 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:26.425 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:26.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:26.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:27.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:28.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:28.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:28.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:29.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0597002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:29.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:30.180 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:30.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:30.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:30.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:31.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:32.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:32.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:33.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:34.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:34.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:35.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:35.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:35.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:36.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 14:22:36.587 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:22:36.588 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 14:22:36.588 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9380) proc(0x7f82b429e330) pid(25531) version 11:1:1:4 [ CSSD]2013-05-23 14:22:36.593 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b429e330), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:22:36.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:22:36.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ddfc0, requested num -1 [ CSSD]2013-05-23 14:22:36.593 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:36.593 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:22:36.594 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:22:36.594 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:36.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:22:36.600 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:22:36.600 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:36.600 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:22:36.803 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 14:22:36.803 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42c9380) skgpid ospid 25531 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:36.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:36.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:37.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:38.930 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:38.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:38.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:39.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0598002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:39.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:40.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:40.186 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:40.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:40.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:41.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0599002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:41.680 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:41.680 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:41.680 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:41.680 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:41.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:41.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059a002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:41.687 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:41.687 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:42.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:42.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:43.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:44.682 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:22:44.682 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:22:44.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:22:44.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42573d0) pid(25634) version 11:1:1:4 [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42573d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ddfc0, requested num -1 [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:22:44.690 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:44.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:22:44.697 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:22:44.697 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b38d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:44.698 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b38d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:22:44.900 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:22:44.900 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b427c5d0) skgpid ospid 25634 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:45.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:45.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:45.188 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:45.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:45.673 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c7b30), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 14:22:45.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:22:45.673 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:22:45.673 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:22:45.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:47.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:47.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf340 [ CSSD]2013-05-23 14:22:47.173 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf340) con(0x7f82b42c6340) skgpid 19909 ospid 19909 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:47.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:22:47.183 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:22:47.183 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:22:47.183 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:22:47.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:22:47.190 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:22:47.190 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:22:47.190 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:22:47.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 14:22:47.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aed80) skgpid 19911 ospid 19911 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:47.350 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 14:22:47.351 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:22:47.351 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 14:22:47.351 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(25658/25658) version 11:1:1:4 [ CSSD]2013-05-23 14:22:47.356 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 14:22:47.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:22:47.356 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:22:47.356 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:22:47.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:48.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059b002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:48.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:48.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:48.591 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:48.591 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:48.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059c002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:48.598 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:48.599 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:48.950 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:49.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:49.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:49.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(059d002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:49.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:50.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:50.192 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:51.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:51.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:51.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:51.848 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 14:22:51.849 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:22:51.850 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 14:22:51.850 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9450) proc(0x7f82b42573d0) pid(25698) version 11:1:1:4 [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42573d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b429e4b0, requested num -1 [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:22:51.857 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:51.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:22:51.864 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:22:51.864 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbc40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:22:51.864 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbc40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:22:52.067 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 14:22:52.067 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42c9450) skgpid ospid 25698 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:53.093 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 14:22:53.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:22:53.095 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 14:22:53.095 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42b3cd0) pid(25664/25664) version 11:1:1:4 [ CSSD]2013-05-23 14:22:53.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:53.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:53.101 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b3cd0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 14:22:53.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:22:53.101 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:22:53.101 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:22:53.140 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3350) allocated [ CSSD]2013-05-23 14:22:53.141 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:22:53.142 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3350 - 1,2,3 [ CSSD]2013-05-23 14:22:53.142 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e330) proc(0x7f82b42b3350) pid(25744/25744) version 11:1:1:4 [ CSSD]2013-05-23 14:22:53.147 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42b3350), client(1/0x7f82b4286810) [ CSSD]2013-05-23 14:22:53.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 14:22:53.147 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:22:53.147 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:22:53.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:55.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:55.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:55.195 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:55.195 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:22:55.585 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42b3cd0), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:22:55.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:22:55.585 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:22:55.585 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:22:55.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 14:22:56.946 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42be650) skgpid 21876 ospid 21876 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:22:56.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059e002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:56.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:22:56.952 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:22:56.952 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:22:56.952 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:22:56.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059f002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:56.960 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:22:56.960 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:22:57.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:57.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:57.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:22:58.971 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:22:59.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:22:59.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:22:59.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a0002b) incarnation(174631051) [ CSSD]2013-05-23 14:22:59.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:22:59.197 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:22:59.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:01.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:01.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:01.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:03.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:03.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:03.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:04.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:04.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:05.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:05.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:05.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:07.103 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:07.104 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:23:07.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:07.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba890) pid(25842) version 11:1:1:4 [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42baac0, requested num -1 [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a22c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:07.111 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:07.118 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:07.118 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:23:07.118 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:07.119 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:07.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:07.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:07.321 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:07.321 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b4257120) skgpid ospid 25842 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:07.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:08.996 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:09.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:09.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:09.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:09.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:09.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a1002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:09.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:11.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:11.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:11.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:12.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a2002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:12.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:23:12.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:23:12.213 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:23:12.213 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:12.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a3002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:12.220 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:23:12.221 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:23:13.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:13.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:13.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:14.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:14.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:15.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:15.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:15.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:17.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:17.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:18.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:19.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:19.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:19.210 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:19.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:19.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:19.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a4002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:20.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:21.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:21.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:22.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:22.355 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:22.356 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:23:22.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:22.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42ba890) pid(25982) version 11:1:1:4 [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42ae3d0, requested num -1 [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a2390/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:22.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:22.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:23:22.381 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:23:22.381 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:22.381 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:22.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:22.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42baac0) skgpid ospid 25982 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:23.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:23.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:24.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:24.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:24.213 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:25.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:25.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:26.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:27.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:27.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:27.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a5002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:27.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:23:27.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:23:27.464 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:23:27.464 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:27.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a6002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:27.471 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:23:27.471 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:23:28.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:29.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:29.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:29.216 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:29.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a7002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:29.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:29.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:30.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:31.180 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:31.181 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:23:31.182 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:31.182 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42ba890) pid(26090) version 11:1:1:4 [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a22c0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:31.189 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:31.196 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:31.196 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:23:31.196 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:23:31.196 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:31.308 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2520) allocated [ CSSD]2013-05-23 14:23:31.309 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:23:31.310 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2520 - 1,2,3 [ CSSD]2013-05-23 14:23:31.310 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42a2520) pid(26095) version 11:1:1:4 [ CSSD]2013-05-23 14:23:31.326 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:23:31.328 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:23:31.330 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:23:31.331 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2520 [ CSSD]2013-05-23 14:23:31.331 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2520) con(0x7f82b42a3f90) skgpid ospid 26095 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:31.398 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:31.398 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42baac0) skgpid ospid 26090 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:31.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:31.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:32.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:33.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:33.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:34.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:34.219 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:34.219 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:35.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:35.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:36.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:37.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:37.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:37.622 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:37.623 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:23:37.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:37.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba890) pid(26155) version 11:1:1:4 [ CSSD]2013-05-23 14:23:37.629 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:23:37.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:23:37.629 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42baac0, requested num -1 [ CSSD]2013-05-23 14:23:37.629 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:37.629 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a22c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:23:37.630 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:37.630 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:37.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:23:37.638 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:23:37.638 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42833d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:37.638 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42833d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:37.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:37.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42be650) skgpid ospid 26155 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:38.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:39.067 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:39.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:39.222 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:39.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a8002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:39.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:39.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:40.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:41.229 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:41.230 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:23:41.230 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:41.230 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42ba890) pid(26233) version 11:1:1:4 [ CSSD]2013-05-23 14:23:41.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:41.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:41.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:41.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42baac0) skgpid ospid 26233 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:42.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:42.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a9002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:42.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:23:42.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:23:42.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:23:42.715 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:42.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05aa002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:42.723 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:23:42.723 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:23:43.224 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:43.224 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:23:43.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:43.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:44.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:44.944 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:44.945 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:23:44.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:44.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba890) pid(26410) version 11:1:1:4 [ CSSD]2013-05-23 14:23:44.952 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:23:44.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:23:44.952 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42ae3d0, requested num -1 [ CSSD]2013-05-23 14:23:44.952 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:44.952 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a2390/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:23:44.953 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:44.953 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:44.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:23:44.960 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:23:44.960 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:44.960 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:45.162 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:45.162 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b4257120) skgpid ospid 26410 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:45.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:45.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:46.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:47.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:47.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:48.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:48.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:48.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:48.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ab002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:48.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:23:48.847 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:23:48.847 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:23:48.847 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:48.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ac002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:48.854 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:23:48.854 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:23:49.087 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:49.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ad002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:49.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:49.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:50.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:51.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:51.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:52.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:52.879 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:52.880 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:23:52.881 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:52.881 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42ba890) pid(26482) version 11:1:1:4 [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42baf60, requested num -1 [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a2390/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:23:52.887 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:52.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:23:52.894 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:23:52.894 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c8d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:23:52.894 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c8d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:23:53.096 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:23:53.096 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42baac0) skgpid ospid 26482 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:23:53.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:53.231 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:53.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:53.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:54.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:55.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:55.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:56.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:57.103 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:23:57.104 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:23:57.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:23:57.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba890) pid(26438/26438) version 11:1:1:4 [ CSSD]2013-05-23 14:23:57.111 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42ba890), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:23:57.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:23:57.111 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:23:57.111 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:23:57.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:57.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:23:57.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ae002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:57.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:23:57.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:23:57.968 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:23:57.968 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:23:57.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05af002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:57.976 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:23:57.976 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:23:58.234 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:23:58.234 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:23:58.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:23:59.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:23:59.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b0002b) incarnation(174631051) [ CSSD]2013-05-23 14:23:59.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:23:59.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:00.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:01.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:01.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:01.840 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3500) allocated [ CSSD]2013-05-23 14:24:01.841 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:01.841 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3500 - 1,2,3 [ CSSD]2013-05-23 14:24:01.841 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cd110) proc(0x7f82b42e3500) pid(26474/26474) version 11:1:1:4 [ CSSD]2013-05-23 14:24:01.848 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e3500), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 14:24:01.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:24:01.848 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:24:01.848 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:24:02.035 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e4550) allocated [ CSSD]2013-05-23 14:24:02.035 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:02.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e4550 - 1,2,3 [ CSSD]2013-05-23 14:24:02.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42e4550) pid(26440/26440) version 11:1:1:4 [ CSSD]2013-05-23 14:24:02.053 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e4550), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:24:02.053 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:24:02.053 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:24:02.053 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 14:24:02.236 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:02.237 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:24:02.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:03.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:03.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:04.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:04.790 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9470) allocated [ CSSD]2013-05-23 14:24:04.791 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:04.791 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9470 - 1,2,3 [ CSSD]2013-05-23 14:24:04.791 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7190) proc(0x7f82b42e9470) pid(26642/26642) version 11:1:1:4 [ CSSD]2013-05-23 14:24:04.808 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e9470), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:04.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:04.808 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:24:04.808 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9470 [ CSSD]2013-05-23 14:24:04.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9470) con(0x7f82b42e7190) skgpid 26642 ospid 26642 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:05.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:05.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:06.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:07.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:07.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:07.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:07.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:08.133 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e92e0) allocated [ CSSD]2013-05-23 14:24:08.134 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:24:08.135 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e92e0 - 1,2,3 [ CSSD]2013-05-23 14:24:08.135 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7000) proc(0x7f82b42e92e0) pid(26667) version 11:1:1:4 [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e92e0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42e91f0, requested num -1 [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e9a70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:08.142 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:08.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:08.149 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:24:08.149 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e9d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:08.149 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e9d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:08.352 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e92e0 [ CSSD]2013-05-23 14:24:08.352 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e92e0) con(0x7f82b42e7000) skgpid ospid 26667 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:08.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:09.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:09.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b1002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:09.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:09.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:10.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:11.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:11.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:12.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:12.243 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:12.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:13.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b2002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:13.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:24:13.220 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:24:13.220 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:24:13.220 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:13.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b3002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:13.227 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:24:13.227 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:24:13.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:13.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:14.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:15.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:15.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:16.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:17.246 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:17.246 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:17.770 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9470) allocated [ CSSD]2013-05-23 14:24:17.771 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:17.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9470 - 1,2,3 [ CSSD]2013-05-23 14:24:17.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7190) proc(0x7f82b42e9470) pid(26785) version 11:1:1:4 [ CSSD]2013-05-23 14:24:17.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:17.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:17.895 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ebd50) allocated [ CSSD]2013-05-23 14:24:17.896 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:17.897 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ebd50 - 1,2,3 [ CSSD]2013-05-23 14:24:17.897 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e68d0) proc(0x7f82b42ebd50) pid(26795) version 11:1:1:4 [ CSSD]2013-05-23 14:24:17.915 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:24:17.918 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:24:17.921 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ebd50 [ CSSD]2013-05-23 14:24:17.921 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ebd50) con(0x7f82b42e68d0) skgpid ospid 26795 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:17.993 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5321/0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:17.993 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5321 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:17.993 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42ccac0 with con 0x7f82b42e68d0, requested num -1 [ CSSD]2013-05-23 14:24:17.993 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:24:17.993 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42e9b30/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:24:17.994 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:17.994 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:24:18.001 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5321 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:18.001 [1199044928] >TRACE: clssgmExitGrock: client 5321 (0x7f82b42ccac0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:24:18.001 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e9e30) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:24:18.001 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42e9e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:18.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9470 [ CSSD]2013-05-23 14:24:18.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9470) con(0x7f82b42e7190) skgpid ospid 26785 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:18.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:19.154 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:19.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b4002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:19.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:19.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:20.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:21.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:21.249 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:24:21.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:21.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:22.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:23.391 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9470) allocated [ CSSD]2013-05-23 14:24:23.391 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:24:23.392 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9470 - 1,2,3 [ CSSD]2013-05-23 14:24:23.392 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7190) proc(0x7f82b42e9470) pid(26846) version 11:1:1:4 [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e9470), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42e9380, requested num -1 [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e9c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:23.398 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:23.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:23.405 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:24:23.405 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e9f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:23.405 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e9f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:23.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9470 [ CSSD]2013-05-23 14:24:23.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9470) con(0x7f82b42e7190) skgpid ospid 26846 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:23.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:23.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:24.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:25.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:25.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:26.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:26.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:26.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:27.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:27.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:28.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b5002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:28.471 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:24:28.471 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:24:28.471 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:24:28.471 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:28.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b6002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:28.478 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:24:28.478 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:24:28.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:29.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:29.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b7002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:29.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:29.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:30.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:31.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:31.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:31.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:31.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:24:32.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42be650) skgpid 26438 ospid 26438 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e4550 [ CSSD]2013-05-23 14:24:32.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e4550) con(0x7f82b42a25e0) skgpid 26440 ospid 26440 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:32.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:33.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:33.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:34.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:35.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:35.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:36.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:36.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:36.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:37.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:37.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:38.654 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:24:38.655 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:24:38.655 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:24:38.655 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba890) pid(26994) version 11:1:1:4 [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ba890), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a25e0, requested num -1 [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:38.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:38.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:24:38.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:24:38.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e4020) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:38.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e4020) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:38.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:38.872 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:24:38.872 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b4257120) skgpid ospid 26994 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:39.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:39.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b8002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:40.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:40.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:40.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:41.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:41.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:42.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:42.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:42.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:43.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b9002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:43.721 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:24:43.721 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:24:43.721 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:24:43.721 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:43.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ba002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:43.728 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:24:43.728 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:24:44.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:44.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:44.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:45.197 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:24:45.197 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:24:45.197 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:24:45.197 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba890) pid(27080) version 11:1:1:4 [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ba890), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42baac0, requested num -1 [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:45.202 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:45.207 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:24:45.207 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:24:45.207 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e4020) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:45.207 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e4020) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:45.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:24:45.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b4257120) skgpid ospid 27080 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:46.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:46.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:46.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:46.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:46.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:48.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:48.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:48.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:49.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05bb002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:49.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:24:49.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:24:49.102 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:24:49.102 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:49.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05bc002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:49.109 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:24:49.109 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:24:49.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:49.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05bd002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:50.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:50.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:50.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:51.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:51.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:52.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:52.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:52.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:53.906 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:24:53.907 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:24:53.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:24:53.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42ba890) pid(27171) version 11:1:1:4 [ CSSD]2013-05-23 14:24:53.913 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ba890), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:24:53.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:24:53.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 14:24:53.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:53.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:24:53.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:24:53.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:53.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:24:53.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:24:53.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e4020) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:24:53.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e4020) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:24:54.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:24:54.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42a25e0) skgpid ospid 27171 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:24:54.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:54.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:54.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:56.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:56.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:56.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:24:56.272 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:24:56.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:58.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:24:58.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:24:58.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05be002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:58.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:24:58.972 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:24:58.972 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:24:58.972 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:24:58.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:24:58.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05bf002b) incarnation(174631051) [ CSSD]2013-05-23 14:24:58.980 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:24:58.980 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:24:59.467 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:24:59.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c0002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:00.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:00.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:00.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:01.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:01.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:02.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:02.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:03.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:04.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:04.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:05.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:25:05.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:25:05.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:25:05.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42ba890) pid(27314/27314) version 11:1:1:4 [ CSSD]2013-05-23 14:25:05.033 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ba890), client(1/0x7f82b4207960) [ CSSD]2013-05-23 14:25:05.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:25:05.033 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:25:05.033 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:25:05.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:25:05.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b42a25e0) skgpid 27314 ospid 27314 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:06.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:06.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:06.278 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:06.278 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:07.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:08.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:08.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:09.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:09.161 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba890) allocated [ CSSD]2013-05-23 14:25:09.162 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:25:09.163 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba890 - 1,2,3 [ CSSD]2013-05-23 14:25:09.163 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba890) pid(27340) version 11:1:1:4 [ CSSD]2013-05-23 14:25:09.169 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ba890), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:09.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:09.169 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a25e0, requested num -1 [ CSSD]2013-05-23 14:25:09.169 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:09.169 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:25:09.170 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:25:09.170 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:09.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:09.178 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:25:09.178 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e4020) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:09.178 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e4020) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:25:09.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba890 [ CSSD]2013-05-23 14:25:09.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba890) con(0x7f82b4257120) skgpid ospid 27340 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:09.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:09.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c1002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:10.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:10.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:11.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:11.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:11.282 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:12.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:12.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:13.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:14.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c2002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:14.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:25:14.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:25:14.222 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:25:14.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:14.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c3002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:14.230 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:25:14.230 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:25:14.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:14.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:15.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:16.285 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:16.285 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:16.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:16.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:17.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:17.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 14:25:17.212 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9760), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:25:17.212 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9760), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:25:17.212 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:25:17.217 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42aee40) skgpid 21812 ospid 21812 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:17.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:25:17.223 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:25:17.223 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b00d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:25:17.223 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a19b0) [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a19b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a19b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ca0a0 [ CSSD]2013-05-23 14:25:17.227 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ca0a0) con(0x7f82b42c7cc0) skgpid 21810 ospid 21810 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:18.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:18.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:19.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:19.531 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:19.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c4002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:20.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:20.288 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:25:20.340 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 14:25:20.340 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:25:20.341 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 14:25:20.341 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b4207a80) pid(27432/27432) version 11:1:1:4 [ CSSD]2013-05-23 14:25:20.348 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 14:25:20.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:25:20.348 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:25:20.348 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:25:20.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:20.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:21.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:21.981 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 14:25:21.982 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:25:21.982 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 14:25:21.982 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b4207c10) pid(27468/27468) version 11:1:1:4 [ CSSD]2013-05-23 14:25:21.999 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b4207c10), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 14:25:21.999 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:25:21.999 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:25:21.999 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:25:22.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:22.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:23.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:23.680 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 14:25:23.680 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:25:23.680 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:25:23.680 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:25:23.681 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 14:25:23.681 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42aee40) skgpid 27468 ospid 27468 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:24.179 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a18e0) allocated [ CSSD]2013-05-23 14:25:24.180 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:25:24.180 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a18e0 - 1,2,3 [ CSSD]2013-05-23 14:25:24.180 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de110) proc(0x7f82b42a18e0) pid(26472/26472) version 11:1:1:4 [ CSSD]2013-05-23 14:25:24.186 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42a18e0), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 14:25:24.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:25:24.186 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:25:24.186 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:25:24.414 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8770) allocated [ CSSD]2013-05-23 14:25:24.415 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:25:24.415 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8770 - 1,2,3 [ CSSD]2013-05-23 14:25:24.415 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42a8770) pid(27491) version 11:1:1:4 [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42a8770), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42834c0, requested num -1 [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d2bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:25:24.421 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:24.427 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:24.427 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:25:24.427 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:24.427 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:25:24.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:24.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:24.630 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8770 [ CSSD]2013-05-23 14:25:24.630 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8770) con(0x7f82b4207cd0) skgpid ospid 27491 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:25.290 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:25.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:25.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:26.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:26.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:27.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:28.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:28.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:29.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:29.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c5002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:29.472 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:25:29.472 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:25:29.472 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:25:29.473 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:29.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c6002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:29.480 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:25:29.480 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:25:29.560 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:29.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c7002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:30.293 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:30.293 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:30.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:30.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:31.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:32.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:32.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:33.138 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(2/0x7f82b42d9760) [ CSSD]2013-05-23 14:25:33.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 14:25:33.138 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:25:33.138 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 14:25:33.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:33.448 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e3500), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 14:25:33.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 14:25:33.448 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:25:33.448 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:25:34.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:34.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:35.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:35.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:35.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:36.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:36.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:37.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:38.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:38.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:39.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:39.582 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:39.658 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8770) allocated [ CSSD]2013-05-23 14:25:39.659 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:25:39.659 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8770 - 1,2,3 [ CSSD]2013-05-23 14:25:39.659 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de3a0) proc(0x7f82b42a8770) pid(27639) version 11:1:1:4 [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42a8770), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ca1b0, requested num -1 [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3200/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:25:39.664 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:39.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:39.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:25:39.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:39.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:25:39.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c8002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:39.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8770 [ CSSD]2013-05-23 14:25:39.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8770) con(0x7f82b42de3a0) skgpid ospid 27639 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:40.298 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:40.298 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:40.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:40.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:41.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:42.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:42.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:43.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:44.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:44.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:44.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c9002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:44.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:25:44.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:25:44.723 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:25:44.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:44.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ca002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:44.731 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:25:44.731 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:25:45.301 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:45.301 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:45.451 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3850) allocated [ CSSD]2013-05-23 14:25:45.452 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:25:45.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3850 - 1,2,3 [ CSSD]2013-05-23 14:25:45.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42e3850) pid(27722) version 11:1:1:4 [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e3850), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ca1b0, requested num -1 [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:25:45.459 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:45.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:45.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:45.465 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:25:45.465 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:45.465 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:25:45.668 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3850 [ CSSD]2013-05-23 14:25:45.668 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3850) con(0x7f82b42a25e0) skgpid ospid 27722 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:46.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:46.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:47.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:48.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:48.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:49.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:49.303 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:25:49.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05cb002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:49.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:25:49.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:25:49.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:25:49.375 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:49.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05cc002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:49.382 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:25:49.382 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:25:49.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:49.601 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:49.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05cd002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:50.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:50.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:51.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:52.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:52.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:53.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:54.306 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:54.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:54.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:54.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:54.914 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3850) allocated [ CSSD]2013-05-23 14:25:54.915 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:25:54.916 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3850 - 1,2,3 [ CSSD]2013-05-23 14:25:54.916 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42e3850) pid(27798) version 11:1:1:4 [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e3850), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ca1b0, requested num -1 [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:25:54.922 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:54.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:25:54.930 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:25:54.930 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:25:54.930 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:25:55.132 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3850 [ CSSD]2013-05-23 14:25:55.132 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3850) con(0x7f82b42a25e0) skgpid ospid 27798 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:25:55.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:56.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:56.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:57.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:58.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:25:58.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:25:59.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:25:59.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:25:59.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:25:59.626 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:25:59.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ce002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:59.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05cf002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:59.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:25:59.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:25:59.978 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:25:59.978 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:25:59.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d0002b) incarnation(174631051) [ CSSD]2013-05-23 14:25:59.986 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:25:59.986 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:00.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:00.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:01.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:02.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:02.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:03.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:04.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:04.311 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:04.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:04.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:05.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:06.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:06.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:07.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:08.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:08.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:09.314 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:09.314 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:09.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:26:09.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:09.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d1002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:10.165 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e3850) allocated [ CSSD]2013-05-23 14:26:10.166 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:26:10.166 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e3850 - 1,2,3 [ CSSD]2013-05-23 14:26:10.166 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a25e0) proc(0x7f82b42e3850) pid(27949) version 11:1:1:4 [ CSSD]2013-05-23 14:26:10.172 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e3850), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:10.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:10.172 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 14:26:10.172 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:10.172 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:26:10.173 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:26:10.173 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:10.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:10.179 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:26:10.179 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:10.179 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:26:10.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d2002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:10.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:26:10.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:26:10.353 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:26:10.353 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:10.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d3002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:10.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:26:10.360 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:10.381 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3850 [ CSSD]2013-05-23 14:26:10.381 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3850) con(0x7f82b42a25e0) skgpid ospid 27949 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:10.483 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:26:10.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:26:10.485 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:26:10.485 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:26:10.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:10.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:11.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:12.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:12.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:13.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:13.316 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:26:13.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:14.778 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42a18e0), client(2/0x7f82b4207960) [ CSSD]2013-05-23 14:26:14.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 14:26:14.778 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:26:14.778 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 14:26:14.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:14.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:15.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d4002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:15.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:26:15.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:26:15.228 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:26:15.228 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:15.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d5002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:15.235 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:26:15.235 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:15.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:16.001 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a86d0) allocated [ CSSD]2013-05-23 14:26:16.002 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:26:16.003 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a86d0 - 1,2,3 [ CSSD]2013-05-23 14:26:16.003 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8170) proc(0x7f82b42a86d0) pid(28022/28022) version 11:1:1:4 [ CSSD]2013-05-23 14:26:16.019 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42a86d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:16.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:16.019 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:26:16.019 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a86d0 [ CSSD]2013-05-23 14:26:16.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a86d0) con(0x7f82b42a8170) skgpid 28022 ospid 28022 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:16.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:16.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:17.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:18.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:18.319 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:18.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:18.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:19.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:26:19.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:19.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d6002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:20.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:20.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:21.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:26:21.720 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:26:21.720 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b427d5c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:26:21.720 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 14:26:21.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42de070) [ CSSD]2013-05-23 14:26:21.722 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42de070), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:26:21.722 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42de070), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:26:21.722 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd9f0 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd9f0) con(0x7f82b42cab20) skgpid 22715 ospid 22715 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:26:21.724 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:26:21.725 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e12f0 [ CSSD]2013-05-23 14:26:21.725 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e12f0) con(0x7f82b42df020) skgpid 22707 ospid 22707 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:21.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:22.824 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8770) allocated [ CSSD]2013-05-23 14:26:22.825 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:26:22.826 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8770 - 1,2,3 [ CSSD]2013-05-23 14:26:22.826 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de1c0) proc(0x7f82b42a8770) pid(28073/28073) version 11:1:1:4 [ CSSD]2013-05-23 14:26:22.831 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a8770), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 14:26:22.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:26:22.831 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:26:22.831 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:26:22.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:22.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:23.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:23.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:23.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:24.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:24.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:25.418 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ad0) allocated [ CSSD]2013-05-23 14:26:25.419 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:26:25.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ad0 - 1,2,3 [ CSSD]2013-05-23 14:26:25.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42d3ad0) pid(28093) version 11:1:1:4 [ CSSD]2013-05-23 14:26:25.426 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d3ad0), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:26:25.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:26:25.426 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42d39f0, requested num -1 [ CSSD]2013-05-23 14:26:25.426 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:25.426 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:26:25.427 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:26:25.427 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:25.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:26:25.434 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:26:25.434 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dccd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:25.434 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dccd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:26:25.636 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ad0 [ CSSD]2013-05-23 14:26:25.636 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ad0) con(0x7f82b4207cd0) skgpid ospid 28093 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:25.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:26.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:26.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:27.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:28.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:28.324 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:28.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:28.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:29.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:26:29.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d7002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:29.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:30.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d8002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:30.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:26:30.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:26:30.478 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:26:30.478 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:30.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d9002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:30.486 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:26:30.486 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:30.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:30.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:31.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:33.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:33.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:33.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:33.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:33.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:35.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:35.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:36.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:37.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:37.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:37.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:37.330 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:26:38.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:39.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:39.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:39.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:26:39.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05da002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:40.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:40.681 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ad0) allocated [ CSSD]2013-05-23 14:26:40.682 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:26:40.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ad0 - 1,2,3 [ CSSD]2013-05-23 14:26:40.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9a90) proc(0x7f82b42d3ad0) pid(28259) version 11:1:1:4 [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d3ad0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d39f0, requested num -1 [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcaa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:26:40.689 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:40.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:40.696 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:26:40.696 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dcda0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:40.696 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dcda0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:26:40.899 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ad0 [ CSSD]2013-05-23 14:26:40.899 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ad0) con(0x7f82b42c9a90) skgpid ospid 28259 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:41.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:41.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:42.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:42.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:42.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:43.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:43.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:44.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:45.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:45.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:45.708 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ad0) allocated [ CSSD]2013-05-23 14:26:45.709 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:26:45.709 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ad0 - 1,2,3 [ CSSD]2013-05-23 14:26:45.709 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42d3ad0) pid(28333) version 11:1:1:4 [ CSSD]2013-05-23 14:26:45.715 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d3ad0), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:26:45.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:26:45.715 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42d39f0, requested num -1 [ CSSD]2013-05-23 14:26:45.715 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:45.715 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc9d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:26:45.716 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:26:45.716 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:45.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:26:45.723 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:26:45.723 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dccd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:45.723 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dccd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:26:45.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05db002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:45.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:26:45.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:26:45.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:26:45.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:45.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05dc002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:45.748 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:26:45.748 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:45.925 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ad0 [ CSSD]2013-05-23 14:26:45.925 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ad0) con(0x7f82b4207cd0) skgpid ospid 28333 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:46.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:47.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:47.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:47.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:47.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:48.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:49.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:49.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:49.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05dd002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:49.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:26:49.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:26:49.633 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:26:49.633 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:49.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05de002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:49.640 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:26:49.640 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:26:49.732 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:26:49.920 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ad0) allocated [ CSSD]2013-05-23 14:26:49.921 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:26:49.922 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ad0 - 1,2,3 [ CSSD]2013-05-23 14:26:49.922 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42d3ad0) pid(28369/28369) version 11:1:1:4 [ CSSD]2013-05-23 14:26:49.928 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d3ad0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:49.928 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:26:49.928 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:26:49.928 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:26:50.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05df002b) incarnation(174631051) [ CSSD]2013-05-23 14:26:50.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:51.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:51.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:52.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:52.338 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:52.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:53.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:53.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:53.216 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d3ad0), client(2/0x7f82b42b3600) [ CSSD]2013-05-23 14:26:53.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b3600) [ CSSD]2013-05-23 14:26:53.216 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:26:53.216 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:26:54.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:55.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:55.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:55.942 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:26:55.943 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:26:55.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:26:55.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd100) proc(0x7f82b42ddd80) pid(28407) version 11:1:1:4 [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:26:55.950 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:26:55.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:26:55.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:26:55.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:26:55.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:26:56.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:26:56.160 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42dd100) skgpid ospid 28407 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:26:56.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:57.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:57.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:57.341 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:26:57.341 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:26:58.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:26:59.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:26:59.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:26:59.754 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:00.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e0002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:00.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:00.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e1002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:00.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:00.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:00.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:27:00.994 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:01.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e2002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:01.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:01.001 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:01.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:01.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:01.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:01.344 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:27:02.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:03.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:03.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:04.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:05.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:05.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:06.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:06.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:06.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:07.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:07.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:08.114 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dde50) allocated [ CSSD]2013-05-23 14:27:08.115 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:27:08.116 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dde50 - 1,2,3 [ CSSD]2013-05-23 14:27:08.116 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd1d0) proc(0x7f82b42dde50) pid(28580) version 11:1:1:4 [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dde50), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0810/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:08.122 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:08.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:27:08.129 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:08.129 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0b10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:08.129 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0b10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:08.308 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:27:08.309 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:27:08.310 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:27:08.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:27:08.332 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dde50 [ CSSD]2013-05-23 14:27:08.332 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dde50) con(0x7f82b42dd1d0) skgpid ospid 28580 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:08.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:08.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e3002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:08.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:08.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:08.390 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:27:08.390 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:27:08.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e4002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:08.398 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:08.398 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:09.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:09.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:09.775 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:10.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e5002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:10.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:11.196 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:11.197 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:27:11.197 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:11.197 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1c00) proc(0x7f82b42ddd80) pid(28641) version 11:1:1:4 [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:11.204 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:11.211 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:27:11.211 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:11.211 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:11.211 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:11.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:11.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:11.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:11.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:11.414 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:11.414 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42e1c00) skgpid ospid 28641 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:12.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:12.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:27:12.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:12.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1c00) proc(0x7f82b42ddd80) pid(28706) version 11:1:1:4 [ CSSD]2013-05-23 14:27:12.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:13.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:13.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:14.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:14.585 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:14.585 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42e1c00) skgpid ospid 28706 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:15.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:15.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:16.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e6002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:16.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:16.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:16.302 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:27:16.302 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:16.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e7002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:16.309 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:16.309 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:16.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:16.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:16.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:17.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:17.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:18.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:19.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:19.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:19.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:20.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e8002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:20.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:21.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:21.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:21.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:21.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:22.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:23.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:23.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:24.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:25.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:25.359 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:27:25.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:25.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:26.447 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:26.448 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:27:26.449 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:26.449 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd100) proc(0x7f82b42ddd80) pid(29093) version 11:1:1:4 [ CSSD]2013-05-23 14:27:26.466 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:27:26.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:26.466 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:26.466 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:26.466 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:26.467 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:26.467 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:26.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:26.474 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:26.474 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:26.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:26.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:26.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:26.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42dd100) skgpid ospid 29093 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:27.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:27.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:28.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:29.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:29.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:29.828 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:30.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e9002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:30.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:30.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:30.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:31.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:31.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:31.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ea002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:31.562 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:31.562 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:31.562 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:27:31.562 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:31.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05eb002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:31.568 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:31.569 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:32.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:33.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:33.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:34.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:35.365 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:35.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:35.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:35.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:36.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:37.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:37.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:37.604 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:37.605 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:27:37.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:37.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd100) proc(0x7f82b42ddd80) pid(29221) version 11:1:1:4 [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:37.613 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:37.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:37.620 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:37.620 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:37.620 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:37.823 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:37.823 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42dd100) skgpid ospid 29221 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:38.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:39.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:39.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:39.851 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:40.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ec002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:40.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:40.368 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:40.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:41.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:41.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:41.715 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:41.716 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:27:41.717 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:41.717 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd100) proc(0x7f82b42ddd80) pid(29257) version 11:1:1:4 [ CSSD]2013-05-23 14:27:41.723 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:27:41.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:41.723 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:41.723 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:41.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:41.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:41.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:41.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:41.731 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:41.731 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:41.731 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:41.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:41.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42dd100) skgpid ospid 29257 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:42.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:43.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:43.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:44.370 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:44.371 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:27:44.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:45.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:45.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:45.972 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ddd80) allocated [ CSSD]2013-05-23 14:27:45.973 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:27:45.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ddd80 - 1,2,3 [ CSSD]2013-05-23 14:27:45.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd100) proc(0x7f82b42ddd80) pid(29327) version 11:1:1:4 [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42ddd80), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b42e00e0, requested num -1 [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:45.980 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:45.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:45.988 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:45.988 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:45.988 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:46.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ddd80 [ CSSD]2013-05-23 14:27:46.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ddd80) con(0x7f82b42dd100) skgpid ospid 29327 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:46.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:46.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ed002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:46.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:46.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:46.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:27:46.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:46.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ee002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:46.819 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:46.819 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:47.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:27:47.245 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:27:47.245 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d3dc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:27:47.245 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:27:47.245 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe180 [ CSSD]2013-05-23 14:27:47.246 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe180) con(0x7f82b42d8560) skgpid 23735 ospid 23735 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:47.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:47.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:48.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:49.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:49.374 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:49.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:49.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:49.873 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:27:49.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ef002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:49.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:27:49.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:27:49.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:27:49.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:49.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f0002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:49.901 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:27:49.901 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:27:50.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f1002b) incarnation(174631051) [ CSSD]2013-05-23 14:27:50.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:51.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:51.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:52.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:53.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:53.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:54.377 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:54.377 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:54.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:55.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:55.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:56.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:56.968 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd6e0) allocated [ CSSD]2013-05-23 14:27:56.969 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:27:56.969 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd6e0 - 1,2,3 [ CSSD]2013-05-23 14:27:56.969 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429eb50) proc(0x7f82b42dd6e0) pid(29446) version 11:1:1:4 [ CSSD]2013-05-23 14:27:56.976 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dd6e0), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:27:56.976 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:56.976 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42de070 with con 0x7f82b429ee50, requested num -1 [ CSSD]2013-05-23 14:27:56.976 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:56.976 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddcc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:27:56.977 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:27:56.977 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:27:56.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:27:56.984 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:27:56.984 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:27:56.984 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:27:57.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd6e0 [ CSSD]2013-05-23 14:27:57.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd6e0) con(0x7f82b429eb50) skgpid ospid 29446 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:27:57.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:57.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:58.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:27:59.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:27:59.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:27:59.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:27:59.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:27:59.896 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:00.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f2002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:00.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:01.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:01.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:02.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f3002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:02.064 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:28:02.064 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:28:02.064 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:28:02.064 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:02.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f4002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:02.071 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:28:02.071 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:28:02.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:03.383 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:03.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:28:03.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:03.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:04.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:05.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:05.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:07.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:07.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:07.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:08.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:08.385 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:09.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:09.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:09.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:09.921 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:10.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f5002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:11.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:11.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:11.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:12.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d50d0) allocated [ CSSD]2013-05-23 14:28:12.221 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:28:12.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d50d0 - 1,2,3 [ CSSD]2013-05-23 14:28:12.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1c00) proc(0x7f82b42d50d0) pid(29600) version 11:1:1:4 [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d50d0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b42d5200, requested num -1 [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddb90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:12.229 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:12.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:28:12.237 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:28:12.237 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429ecd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:12.237 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429ecd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:12.439 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d50d0 [ CSSD]2013-05-23 14:28:12.439 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d50d0) con(0x7f82b42e1c00) skgpid ospid 29600 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:13.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:13.388 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:13.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:13.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:13.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:15.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:15.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:15.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:17.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:17.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f6002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:17.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:28:17.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:28:17.315 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:28:17.315 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:17.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f7002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:17.323 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:28:17.323 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:28:17.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:17.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:18.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:18.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:19.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:19.940 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:19.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:19.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:20.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f8002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:21.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:21.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:21.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:23.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:23.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:23.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:23.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:23.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:25.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:25.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:25.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:27.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:27.397 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:27.397 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:28:27.475 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd6e0) allocated [ CSSD]2013-05-23 14:28:27.477 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:28:27.477 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd6e0 - 1,2,3 [ CSSD]2013-05-23 14:28:27.477 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b42dd6e0) pid(29740) version 11:1:1:4 [ CSSD]2013-05-23 14:28:27.483 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dd6e0), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:27.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:27.483 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b429ee50, requested num -1 [ CSSD]2013-05-23 14:28:27.483 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:27.483 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:28:27.484 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:27.484 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:27.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:27.491 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:28:27.491 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dddf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:27.491 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dddf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:27.693 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd6e0 [ CSSD]2013-05-23 14:28:27.693 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd6e0) con(0x7f82b42d8560) skgpid ospid 29740 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:28.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:28.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:29.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:29.962 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:30.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:30.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:30.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f9002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:31.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:31.478 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd6e0) allocated [ CSSD]2013-05-23 14:28:31.479 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:31.480 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd6e0 - 1,2,3 [ CSSD]2013-05-23 14:28:31.480 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b42dd6e0) pid(29819) version 11:1:1:4 [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dd6e0), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42de070 with con 0x7f82b429ee50, requested num -1 [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd6e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:31.487 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:31.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:28:31.494 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42de070), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:28:31.494 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dddf0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:28:31.494 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42dddf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:31.604 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e03a0) allocated [ CSSD]2013-05-23 14:28:31.605 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:31.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e03a0 - 1,2,3 [ CSSD]2013-05-23 14:28:31.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd870) proc(0x7f82b42e03a0) pid(29824) version 11:1:1:4 [ CSSD]2013-05-23 14:28:31.622 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:28:31.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:28:31.626 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:28:31.628 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e03a0 [ CSSD]2013-05-23 14:28:31.628 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e03a0) con(0x7f82b41fd870) skgpid ospid 29824 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:31.696 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd6e0 [ CSSD]2013-05-23 14:28:31.696 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd6e0) con(0x7f82b42d8560) skgpid ospid 29819 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:32.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:32.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:32.332 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d50d0) allocated [ CSSD]2013-05-23 14:28:32.333 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:32.334 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d50d0 - 1,2,3 [ CSSD]2013-05-23 14:28:32.334 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e1c00) proc(0x7f82b42d50d0) pid(29359/29359) version 11:1:1:4 [ CSSD]2013-05-23 14:28:32.339 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d50d0), client(1/0x7f82b42de070) [ CSSD]2013-05-23 14:28:32.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:28:32.339 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:28:32.339 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:28:32.400 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:32.401 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:32.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05fa002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:32.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:28:32.565 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:28:32.565 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:28:32.566 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:32.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05fb002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:32.572 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:28:32.572 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:28:33.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:33.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b3600) [ CSSD]2013-05-23 14:28:33.632 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b3600), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:28:33.632 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b3600), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:28:33.632 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ad0 [ CSSD]2013-05-23 14:28:33.639 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ad0) con(0x7f82b4207cd0) skgpid 28369 ospid 28369 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:34.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:34.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:35.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:36.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:36.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:37.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:37.404 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:37.404 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:38.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:38.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:39.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:39.990 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:40.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:40.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:40.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05fc002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:40.742 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc430) allocated [ CSSD]2013-05-23 14:28:40.743 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:40.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc430 - 1,2,3 [ CSSD]2013-05-23 14:28:40.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd7c0) proc(0x7f82b42dc430) pid(29903) version 11:1:1:4 [ CSSD]2013-05-23 14:28:41.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc430 [ CSSD]2013-05-23 14:28:41.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc430) con(0x7f82b42dd7c0) skgpid ospid 29903 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:41.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:42.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:42.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:42.407 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:42.407 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:42.725 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc7d0) allocated [ CSSD]2013-05-23 14:28:42.726 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:28:42.726 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc7d0 - 1,2,3 [ CSSD]2013-05-23 14:28:42.726 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddf10) proc(0x7f82b42dc7d0) pid(30065) version 11:1:1:4 [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc7d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42dd890, requested num -1 [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d2bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:42.742 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:42.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 14:28:42.748 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:28:42.748 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:42.748 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:42.950 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc7d0 [ CSSD]2013-05-23 14:28:42.951 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc7d0) con(0x7f82b42ddf10) skgpid ospid 30065 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:43.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:44.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:44.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:45.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:46.233 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc430) allocated [ CSSD]2013-05-23 14:28:46.234 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:46.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc430 - 1,2,3 [ CSSD]2013-05-23 14:28:46.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd7c0) proc(0x7f82b42dc430) pid(30133) version 11:1:1:4 [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc430), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b42dc1d0, requested num -1 [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d2bf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:46.240 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:46.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:46.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:46.246 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:46.246 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:28:46.246 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:46.246 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:46.449 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc430 [ CSSD]2013-05-23 14:28:46.449 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc430) con(0x7f82b42dd7c0) skgpid ospid 30133 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:47.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:47.410 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:47.410 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:47.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05fd002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:47.816 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:28:47.816 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:28:47.816 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:28:47.816 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:47.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05fe002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:47.824 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:28:47.824 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:28:48.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:48.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:49.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:50.023 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:28:50.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ff002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:50.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:28:50.147 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:28:50.147 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:28:50.147 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:50.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0600002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:50.155 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:28:50.155 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:28:50.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:50.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:50.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0601002b) incarnation(174631051) [ CSSD]2013-05-23 14:28:51.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:52.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:52.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:52.413 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:52.413 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:53.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:54.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:54.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:55.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:56.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:56.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:57.210 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc430) allocated [ CSSD]2013-05-23 14:28:57.210 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:28:57.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc430 - 1,2,3 [ CSSD]2013-05-23 14:28:57.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd7c0) proc(0x7f82b42dc430) pid(29487/29487) version 11:1:1:4 [ CSSD]2013-05-23 14:28:57.215 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dc430), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 14:28:57.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 14:28:57.215 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:28:57.215 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:28:57.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:28:57.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:28:57.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:28:57.982 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dff60) allocated [ CSSD]2013-05-23 14:28:57.983 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:28:57.983 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dff60 - 1,2,3 [ CSSD]2013-05-23 14:28:57.983 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca330) proc(0x7f82b42dff60) pid(30215) version 11:1:1:4 [ CSSD]2013-05-23 14:28:57.989 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42dff60), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:57.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:57.989 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b42d3b90, requested num -1 [ CSSD]2013-05-23 14:28:57.989 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:57.989 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0670/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:28:57.990 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:28:57.990 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:28:57.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:28:57.996 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:28:57.996 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0970) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:28:57.996 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0970) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:28:58.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dff60 [ CSSD]2013-05-23 14:28:58.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dff60) con(0x7f82b42ca330) skgpid ospid 30215 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:28:58.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:28:58.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:28:59.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:00.045 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:00.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0602002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:00.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:00.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:01.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:02.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:02.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:02.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:02.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:03.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0603002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:03.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:29:03.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:29:03.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:29:03.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:03.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0604002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:03.087 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:29:03.087 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:29:03.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:04.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:04.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:05.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:06.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:06.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:07.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:07.421 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:07.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:08.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:08.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:09.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:10.070 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:10.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0605002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:10.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:10.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:11.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:11.424 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:29:11.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:12.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:12.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:13.241 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3bb0) allocated [ CSSD]2013-05-23 14:29:13.242 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:29:13.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3bb0 - 1,2,3 [ CSSD]2013-05-23 14:29:13.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc860) proc(0x7f82b42d3bb0) pid(30366) version 11:1:1:4 [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42d3bb0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d3ad0, requested num -1 [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e04e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:13.249 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:13.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:29:13.256 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:29:13.256 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e07e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:13.256 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e07e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:13.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3bb0 [ CSSD]2013-05-23 14:29:13.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3bb0) con(0x7f82b42dc860) skgpid ospid 30366 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:13.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:14.203 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3450) allocated [ CSSD]2013-05-23 14:29:14.203 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:14.204 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3450 - 1,2,3 [ CSSD]2013-05-23 14:29:14.204 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3c10) proc(0x7f82b42d3450) pid(29357/29357) version 11:1:1:4 [ CSSD]2013-05-23 14:29:14.221 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42d3450), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 14:29:14.221 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:29:14.221 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:29:14.221 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 14:29:14.285 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e66d0) allocated [ CSSD]2013-05-23 14:29:14.285 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:14.286 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e66d0 - 1,2,3 [ CSSD]2013-05-23 14:29:14.286 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e04f0) proc(0x7f82b42e66d0) pid(29355/29355) version 11:1:1:4 [ CSSD]2013-05-23 14:29:14.302 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e66d0), client(1/0x7f82b42d3cc0) [ CSSD]2013-05-23 14:29:14.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d3cc0) [ CSSD]2013-05-23 14:29:14.302 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:29:14.302 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 14:29:14.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:14.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:15.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:16.426 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:16.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:16.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:16.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:17.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:18.086 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9210) allocated [ CSSD]2013-05-23 14:29:18.087 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:18.087 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9210 - 1,2,3 [ CSSD]2013-05-23 14:29:18.087 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0b50) proc(0x7f82b42e9210) pid(30438) version 11:1:1:4 [ CSSD]2013-05-23 14:29:18.213 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ebba0) allocated [ CSSD]2013-05-23 14:29:18.214 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:18.215 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ebba0 - 1,2,3 [ CSSD]2013-05-23 14:29:18.215 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e98b0) proc(0x7f82b42ebba0) pid(30448) version 11:1:1:4 [ CSSD]2013-05-23 14:29:18.233 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:29:18.235 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:29:18.239 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ebba0 [ CSSD]2013-05-23 14:29:18.239 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ebba0) con(0x7f82b42e98b0) skgpid ospid 30448 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5322/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5322 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42d3dc0 with con 0x7f82b42dc860, requested num -1 [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42e98d0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:18.317 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:29:18.326 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5322 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:18.326 [1199044928] >TRACE: clssgmExitGrock: client 5322 (0x7f82b42d3dc0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:29:18.326 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e9bd0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:29:18.326 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42e9bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:18.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9210 [ CSSD]2013-05-23 14:29:18.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9210) con(0x7f82b42e0b50) skgpid ospid 30438 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:18.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0606002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:18.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:29:18.340 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:29:18.340 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:29:18.340 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:18.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0607002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:18.348 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:29:18.348 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:29:18.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:18.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:19.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:20.092 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:20.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0608002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:20.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:20.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:21.429 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:21.429 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:21.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:22.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:22.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:23.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:24.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:24.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:25.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:26.432 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:26.432 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:26.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:26.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:27.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:28.171 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42d3450), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 14:29:28.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:29:28.172 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:29:28.172 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:29:28.491 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e95e0) allocated [ CSSD]2013-05-23 14:29:28.492 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:29:28.492 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e95e0 - 1,2,3 [ CSSD]2013-05-23 14:29:28.492 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7300) proc(0x7f82b42e95e0) pid(30529) version 11:1:1:4 [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e95e0), client(1/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d3dc0 with con 0x7f82b42e94f0, requested num -1 [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e9d70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:28.498 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:28.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:28.505 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d3dc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:29:28.505 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ea070) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:28.505 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ea070) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:28.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:28.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:28.708 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e95e0 [ CSSD]2013-05-23 14:29:28.708 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e95e0) con(0x7f82b42e7300) skgpid ospid 30529 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:29.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:30.114 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:30.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0609002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:30.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:30.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:31.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:31.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:31.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:32.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:32.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:33.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060a002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:33.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:29:33.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:29:33.601 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:29:33.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:33.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060b002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:33.609 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:29:33.609 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:29:33.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:34.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:34.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:35.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:35.438 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:29:35.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:36.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:36.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:37.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:38.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:38.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:39.451 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42d50d0), client(2/0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:39.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:29:39.451 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:29:39.451 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 14:29:39.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:40.136 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:40.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(060c002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:40.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:40.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:40.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:40.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:41.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:42.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:42.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:43.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e9910) allocated [ CSSD]2013-05-23 14:29:43.744 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:29:43.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e9910 - 1,2,3 [ CSSD]2013-05-23 14:29:43.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e7630) proc(0x7f82b42e9910) pid(30692) version 11:1:1:4 [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e9910), client(1/0x7f82b42e9fd0) [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42e9fd0) [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42e9fd0 with con 0x7f82b42e9820, requested num -1 [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ea140/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:43.751 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:43.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42e9fd0) [ CSSD]2013-05-23 14:29:43.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42e9fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:29:43.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ea440) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:43.759 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ea440) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:43.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:43.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e9910 [ CSSD]2013-05-23 14:29:43.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e9910) con(0x7f82b42e7630) skgpid ospid 30692 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:44.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:44.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:45.444 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:45.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:45.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:46.495 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e99c0) allocated [ CSSD]2013-05-23 14:29:46.496 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:46.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e99c0 - 1,2,3 [ CSSD]2013-05-23 14:29:46.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e76e0) proc(0x7f82b42e99c0) pid(30746) version 11:1:1:4 [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e99c0), client(1/0x7f82b42ea080) [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ea080) [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ea080 with con 0x7f82b42e98d0, requested num -1 [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ea1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:46.503 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:46.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ea080) [ CSSD]2013-05-23 14:29:46.511 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ea080), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:29:46.511 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ea4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:46.511 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ea4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:46.713 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e99c0 [ CSSD]2013-05-23 14:29:46.713 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e99c0) con(0x7f82b42e76e0) skgpid ospid 30746 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:46.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:46.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:47.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:48.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060d002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:48.853 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:29:48.853 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:29:48.853 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:29:48.853 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:48.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060e002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:48.861 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:29:48.861 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:29:48.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:48.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:49.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:50.159 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:29:50.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060f002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:50.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:29:50.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:29:50.415 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:29:50.415 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:50.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0610002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:50.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:29:50.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:29:50.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:50.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:29:50.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0611002b) incarnation(174631051) [ CSSD]2013-05-23 14:29:50.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:50.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:52.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:52.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:52.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:54.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:54.450 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:54.450 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:29:54.468 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e99c0) allocated [ CSSD]2013-05-23 14:29:54.469 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:29:54.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e99c0 - 1,2,3 [ CSSD]2013-05-23 14:29:54.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e76e0) proc(0x7f82b42e99c0) pid(29353/29353) version 11:1:1:4 [ CSSD]2013-05-23 14:29:54.485 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e99c0), client(1/0x7f82b42e9ef0) [ CSSD]2013-05-23 14:29:54.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42e9ef0) [ CSSD]2013-05-23 14:29:54.485 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:29:54.485 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 32 [ CSSD]2013-05-23 14:29:54.487 [1199044928] >TRACE: clssgmRegisterClient: proc(74/0x7f82b42e99c0), client(2/0x7f82b42ea390) [ CSSD]2013-05-23 14:29:54.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ea390) [ CSSD]2013-05-23 14:29:54.487 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:29:54.487 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 44 [ CSSD]2013-05-23 14:29:54.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:54.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:55.110 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42e66d0), client(2/0x7f82b42ea770) [ CSSD]2013-05-23 14:29:55.110 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ea770) [ CSSD]2013-05-23 14:29:55.110 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:29:55.110 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 33 [ CSSD]2013-05-23 14:29:56.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:56.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:56.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:58.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:29:58.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:29:58.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:29:59.003 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ed140) allocated [ CSSD]2013-05-23 14:29:59.004 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:29:59.005 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ed140 - 1,2,3 [ CSSD]2013-05-23 14:29:59.005 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42eae50) proc(0x7f82b42ed140) pid(30836) version 11:1:1:4 [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82b42ed140), client(1/0x7f82b42ed810) [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ed810) [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ed810 with con 0x7f82b42ed040, requested num -1 [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ed980/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:29:59.012 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:29:59.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ed810) [ CSSD]2013-05-23 14:29:59.019 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ed810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:29:59.019 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42edc80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:29:59.020 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42edc80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:29:59.222 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ed140 [ CSSD]2013-05-23 14:29:59.222 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ed140) con(0x7f82b42eae50) skgpid ospid 30836 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:29:59.453 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:29:59.453 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:00.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:00.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:00.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0612002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:00.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:00.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:02.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:03.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:03.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:04.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:04.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0613002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:04.107 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:04.107 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:04.107 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:04.107 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:04.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0614002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:04.115 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:04.115 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:04.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:04.456 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:04.527 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ed140) allocated [ CSSD]2013-05-23 14:30:04.528 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:30:04.528 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ed140 - 1,2,3 [ CSSD]2013-05-23 14:30:04.528 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42eae50) proc(0x7f82b42ed140) pid(31137/31137) version 11:1:1:4 [ CSSD]2013-05-23 14:30:04.533 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82b42ed140), client(1/0x7f82b42ed680) [ CSSD]2013-05-23 14:30:04.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ed680) [ CSSD]2013-05-23 14:30:04.533 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:30:04.533 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 45 [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ed680) [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ed680), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ed680), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 44 [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ed140 [ CSSD]2013-05-23 14:30:04.796 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ed140) con(0x7f82b42eae50) skgpid 31137 ospid 31137 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:05.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:05.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:06.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:07.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:07.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:08.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:09.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:09.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:09.459 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:09.459 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:10.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:10.208 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:10.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0615002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:11.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:11.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:12.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:13.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:13.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:14.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:14.250 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ed1f0) allocated [ CSSD]2013-05-23 14:30:14.250 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:30:14.251 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ed1f0 - 1,2,3 [ CSSD]2013-05-23 14:30:14.251 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42eaf00) proc(0x7f82b42ed1f0) pid(31216) version 11:1:1:4 [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmRegisterClient: proc(75/0x7f82b42ed1f0), client(1/0x7f82b42ed7f0) [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ed7f0) [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ed7f0 with con 0x7f82b42e09a0, requested num -1 [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ed960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:30:14.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:14.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ed7f0) [ CSSD]2013-05-23 14:30:14.271 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ed7f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:30:14.271 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42edc60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:14.271 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42edc60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:30:14.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:14.462 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:14.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ed1f0 [ CSSD]2013-05-23 14:30:14.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ed1f0) con(0x7f82b42eaf00) skgpid ospid 31216 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:15.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:15.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:16.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:17.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:17.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 43 [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 14:30:17.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid 25658 ospid 25658 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:17.347 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:30:17.347 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:30:17.347 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:30:17.347 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 32 [ CSSD]2013-05-23 14:30:17.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 14:30:17.353 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:30:17.353 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:30:17.353 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 14:30:17.354 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 14:30:17.354 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b41fa050) skgpid 25664 ospid 25664 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:18.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:18.464 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:18.464 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:30:19.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:19.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:19.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0616002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:19.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:19.369 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:19.369 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:19.369 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:19.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0617002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:19.377 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:19.377 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:20.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:20.235 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:20.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0618002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:21.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:21.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:22.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:23.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:23.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:23.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:23.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:24.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:25.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:25.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:26.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:27.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:27.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:28.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:28.470 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:28.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:29.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:29.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:29.512 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 14:30:29.513 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:30:29.514 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 14:30:29.514 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42a5440) pid(31356) version 11:1:1:4 [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42e09a0, requested num -1 [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:30:29.521 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:29.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 14:30:29.529 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:30:29.529 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1b20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:29.529 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1b20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:30:29.732 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 14:30:29.732 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41fa050) skgpid ospid 31356 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:30.256 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:30.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:30.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0619002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:31.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:31.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:32.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:33.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:33.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:33.473 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:33.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:34.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:34.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061a002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:34.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:34.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:34.640 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:34.640 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:34.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061b002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:34.648 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:34.648 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:35.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:35.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:36.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:37.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:37.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:38.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:38.477 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:38.477 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:39.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:39.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:40.280 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:40.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:40.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(061c002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:41.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:41.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:42.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:43.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:43.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:43.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:43.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:44.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:44.769 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 14:30:44.770 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:30:44.771 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 14:30:44.771 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42a5440) pid(31505) version 11:1:1:4 [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x7f82b42a5440), client(1/0x268c740) [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268c740) [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268c740 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26911e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:30:44.778 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:44.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268c740) [ CSSD]2013-05-23 14:30:44.785 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268c740), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:30:44.785 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:44.786 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:30:44.988 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 14:30:44.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41fa050) skgpid ospid 31505 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:45.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:45.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:46.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:46.751 [1199044928] >TRACE: clssgmAllocProc: (0x26eebf0) allocated [ CSSD]2013-05-23 14:30:46.752 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:30:46.753 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eebf0 - 1,2,3 [ CSSD]2013-05-23 14:30:46.753 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c5c0) proc(0x26eebf0) pid(31562) version 11:1:1:4 [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26eebf0), client(1/0x26915a0) [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26915a0) [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26915a0 with con 0x2691360, requested num -1 [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bb50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:30:46.759 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:46.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26915a0) [ CSSD]2013-05-23 14:30:46.766 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26915a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:30:46.766 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261be50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:30:46.766 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261be50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:30:46.969 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eebf0 [ CSSD]2013-05-23 14:30:46.969 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eebf0) con(0x268c5c0) skgpid ospid 31562 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:30:47.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:47.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:48.482 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:48.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:48.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:49.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:49.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:49.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061d002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:49.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:49.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:49.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:49.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:49.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061e002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:49.898 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:49.898 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:50.301 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:30:50.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:50.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(061f002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:50.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0620002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:50.682 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:50.682 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:50.682 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:50.682 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:50.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0621002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:50.690 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:50.690 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:51.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:51.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:52.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:52.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0622002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:52.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:30:52.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:30:52.894 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:30:52.894 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:30:52.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0623002b) incarnation(174631051) [ CSSD]2013-05-23 14:30:52.902 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:30:52.902 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:30:53.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:53.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:53.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:53.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:54.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:55.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:55.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:56.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:57.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:57.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:30:58.488 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:30:58.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:30:58.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:30:59.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:30:59.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:00.022 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 14:31:00.023 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:31:00.023 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 14:31:00.023 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c1a0) proc(0x2659ac0) pid(31682) version 11:1:1:4 [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2659ac0), client(1/0x26eed10) [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26e4e80, requested num -1 [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bb50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:31:00.030 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:00.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 14:31:00.038 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:31:00.038 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:00.038 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:31:00.240 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 14:31:00.240 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x268c1a0) skgpid ospid 31682 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:00.340 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:00.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:00.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0624002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:01.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:01.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:02.491 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:02.491 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:31:02.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:03.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:03.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:04.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:05.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0625002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:05.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:05.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:05.145 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:31:05.145 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:05.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0626002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:05.152 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:05.152 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:05.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:05.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:06.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:07.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:07.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:07.494 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:07.494 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:08.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:09.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:09.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:10.379 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:10.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0627002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:10.657 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:10.657 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:10.657 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:31:10.657 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:10.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0628002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:10.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0629002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:10.664 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:10.664 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:10.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:10.801 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:31:10.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:31:10.804 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:31:10.804 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:31:11.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:11.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:12.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:12.497 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:12.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:13.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:13.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:14.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:15.279 [1199044928] >TRACE: clssgmAllocProc: (0x26eebf0) allocated [ CSSD]2013-05-23 14:31:15.280 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:31:15.280 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eebf0 - 1,2,3 [ CSSD]2013-05-23 14:31:15.280 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c5c0) proc(0x26eebf0) pid(31902) version 11:1:1:4 [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26eebf0), client(1/0x26e8d80) [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8d80 with con 0x26e8b40, requested num -1 [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bb50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:31:15.287 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:15.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 14:31:15.294 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:31:15.294 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261be50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:15.294 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261be50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:31:15.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eebf0 [ CSSD]2013-05-23 14:31:15.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eebf0) con(0x268c5c0) skgpid ospid 31902 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:15.505 [1199044928] >TRACE: clssgmAllocProc: (0x26e8c30) allocated [ CSSD]2013-05-23 14:31:15.506 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:31:15.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8c30 - 1,2,3 [ CSSD]2013-05-23 14:31:15.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c5c0) proc(0x26e8c30) pid(31945/31945) version 11:1:1:4 [ CSSD]2013-05-23 14:31:15.512 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26e8c30), client(1/0x26e8b40) [ CSSD]2013-05-23 14:31:15.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e8b40) [ CSSD]2013-05-23 14:31:15.512 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:31:15.512 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 14:31:15.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e8b40) [ CSSD]2013-05-23 14:31:15.529 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e8b40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:31:15.529 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e8b40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:31:15.529 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 14:31:15.530 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8c30 [ CSSD]2013-05-23 14:31:15.530 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8c30) con(0x268c5c0) skgpid 31945 ospid 31945 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:15.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:15.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:16.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:17.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:17.500 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:17.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:17.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:18.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:18.819 [1199044928] >TRACE: clssgmAllocProc: (0x26eebf0) allocated [ CSSD]2013-05-23 14:31:18.819 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:31:18.820 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eebf0 - 1,2,3 [ CSSD]2013-05-23 14:31:18.820 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c5c0) proc(0x26eebf0) pid(26470/26470) version 11:1:1:4 [ CSSD]2013-05-23 14:31:18.826 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26eebf0), client(1/0x26916a0) [ CSSD]2013-05-23 14:31:18.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26916a0) [ CSSD]2013-05-23 14:31:18.826 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:31:18.826 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 43 [ CSSD]2013-05-23 14:31:19.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:19.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:20.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062a002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:20.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:20.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:20.397 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:31:20.397 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:20.402 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:20.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(062b002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:20.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:20.404 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:20.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062c002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:20.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:21.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:21.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:21.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 14:31:21.761 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef0a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:31:21.761 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef0a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.761 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 31 [ CSSD]2013-05-23 14:31:21.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 14:31:21.764 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:31:21.764 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.764 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 14:31:21.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 14:31:21.767 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:31:21.767 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.767 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e8790), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e8790), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 42 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid 26332 ospid 26332 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.770 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b427d8a0) skgpid 24464 ospid 24464 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:31:21.771 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:31:21.772 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e3500 [ CSSD]2013-05-23 14:31:21.772 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e3500) con(0x7f82b42cd110) skgpid 26474 ospid 26474 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:22.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:22.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:22.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:23.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:23.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:24.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:25.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:25.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:26.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:27.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:27.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:27.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:27.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:28.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:29.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:29.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:30.431 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:30.530 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:31:30.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:31:30.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:31:30.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(32053) version 11:1:1:4 [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(1/0x268fa20) [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:31:30.548 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:30.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:30.556 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:31:30.556 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a6890) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:30.556 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a6890) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:31:30.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062d002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:30.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:31:30.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 32053 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:30.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:31.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:31.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:32.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:32.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:32.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:33.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:33.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:34.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:35.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062e002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:35.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:35.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:35.646 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:31:35.646 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:35.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(062f002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:35.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:35.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:35.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:35.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:36.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:37.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:37.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:37.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:37.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:38.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:39.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:39.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:40.457 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:40.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0630002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:41.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:41.516 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:41.517 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:31:41.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:41.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:43.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:43.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:43.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:45.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:45.797 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:31:45.798 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:31:45.798 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:31:45.798 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(32194) version 11:1:1:4 [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(1/0x268fa20) [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:31:45.805 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:45.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:45.813 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:31:45.813 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a6890) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:45.813 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a6890) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:31:45.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:45.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:46.016 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:31:46.016 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 32194 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:46.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:46.520 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:47.009 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:31:47.010 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:31:47.010 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:31:47.010 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(32242) version 11:1:1:4 [ CSSD]2013-05-23 14:31:47.027 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(1/0x268fa20) [ CSSD]2013-05-23 14:31:47.027 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:47.027 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 14:31:47.027 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:47.027 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:31:47.028 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:31:47.028 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:47.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:31:47.035 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:31:47.035 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a6890) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:31:47.035 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a6890) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:31:47.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:47.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:31:47.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid ospid 32242 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:31:47.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:47.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:49.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:49.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:49.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:50.478 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:31:50.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0631002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:50.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0632002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:50.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:50.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:50.897 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:31:50.897 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:50.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0633002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:50.904 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:50.904 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:50.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0634002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:50.947 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:31:50.947 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:31:50.947 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:31:50.947 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:31:50.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0635002b) incarnation(174631051) [ CSSD]2013-05-23 14:31:50.954 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:31:50.954 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:31:51.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:51.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:51.523 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:51.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:51.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:53.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:54.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:54.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:55.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:56.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:56.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:56.527 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:31:56.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:31:57.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:31:58.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:31:58.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:31:59.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:00.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:00.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:00.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:00.530 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:00.530 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:32:00.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0636002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:01.051 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:32:01.052 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:32:01.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:32:01.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(32343) version 11:1:1:4 [ CSSD]2013-05-23 14:32:01.058 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(1/0x268fa20) [ CSSD]2013-05-23 14:32:01.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:32:01.058 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:32:01.058 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:01.058 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26987a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:32:01.059 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:32:01.059 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:01.066 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:32:01.066 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:32:01.066 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a6890) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:01.066 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a6890) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:32:01.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:01.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:32:01.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 32343 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:02.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:02.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:02.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0637002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:02.856 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:02.856 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:02.856 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:02.856 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:02.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0638002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:02.863 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:02.863 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:03.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:04.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:04.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:05.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:05.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:05.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:06.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:06.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:06.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0639002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:06.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:06.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:06.153 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:06.153 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:06.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063a002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:06.160 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:06.160 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:06.841 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:32:06.842 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:32:06.842 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:32:06.842 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(31986/31986) version 11:1:1:4 [ CSSD]2013-05-23 14:32:06.857 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(1/0x26a67c0) [ CSSD]2013-05-23 14:32:06.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 14:32:06.857 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:32:06.857 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:32:07.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:08.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:08.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:08.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:32:08.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:32:08.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:32:08.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:32:08.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063b002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:08.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:08.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:08.699 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:32:08.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:32:08.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063c002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:08.708 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:08.708 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:09.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:10.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:10.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:10.520 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:10.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:10.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:10.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(063d002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:11.331 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 14:32:11.332 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:32:11.332 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 14:32:11.332 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26915c0) proc(0x261ca20) pid(32502) version 11:1:1:4 [ CSSD]2013-05-23 14:32:11.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:12.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:12.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:13.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:13.862 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 14:32:13.862 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x26915c0) skgpid ospid 32502 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:14.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:14.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:15.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:15.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:15.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:16.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:16.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:16.302 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 14:32:16.302 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:32:16.303 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 14:32:16.303 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eef20) proc(0x261ca20) pid(374) version 11:1:1:4 [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x261ca20), client(1/0x26cd6b0) [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cd6b0) [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cd6b0 with con 0x261c940, requested num -1 [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26cd820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:32:16.309 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:16.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cd6b0) [ CSSD]2013-05-23 14:32:16.316 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cd6b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:32:16.316 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdb20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:16.316 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdb20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:32:16.519 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 14:32:16.519 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x26eef20) skgpid ospid 374 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:17.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:18.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:18.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:19.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:20.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:20.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:20.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:20.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:20.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:20.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(063e002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:21.376 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x266f0d0), client(2/0x26ef0a0) [ CSSD]2013-05-23 14:32:21.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 14:32:21.376 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:32:21.376 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:32:21.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063f002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:21.401 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:21.401 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:21.401 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:21.401 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:21.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0640002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:21.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:21.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:21.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:22.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:22.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:23.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:24.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:24.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:25.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:25.544 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:25.545 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:26.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:26.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:27.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:28.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:28.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:29.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:30.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:30.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:30.547 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:30.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:30.561 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:30.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0641002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:31.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:31.562 [1199044928] >TRACE: clssgmAllocProc: (0x26cd530) allocated [ CSSD]2013-05-23 14:32:31.563 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:32:31.564 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd530 - 1,2,3 [ CSSD]2013-05-23 14:32:31.564 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a40) proc(0x26cd530) pid(541) version 11:1:1:4 [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26cd530), client(1/0x26cdc40) [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdc40) [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdc40 with con 0x26cd450, requested num -1 [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:32:31.570 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:31.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdc40) [ CSSD]2013-05-23 14:32:31.577 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdc40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:32:31.577 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b640) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:31.577 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b640) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:32:31.780 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd530 [ CSSD]2013-05-23 14:32:31.780 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd530) con(0x26a6a40) skgpid ospid 541 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:32.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:32.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:33.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:34.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:34.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:35.550 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:35.550 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:35.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:36.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:36.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:36.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0642002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:36.664 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:36.664 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:36.664 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:36.664 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:36.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0643002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:36.672 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:36.672 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:37.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:38.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:38.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:39.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:40.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:40.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:40.553 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:40.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:40.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:40.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0644002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:41.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:42.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:42.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:43.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:44.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:44.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:45.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:45.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:45.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:46.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:46.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:46.815 [1199044928] >TRACE: clssgmAllocProc: (0x26cd530) allocated [ CSSD]2013-05-23 14:32:46.816 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:32:46.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd530 - 1,2,3 [ CSSD]2013-05-23 14:32:46.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261be70) proc(0x26cd530) pid(706) version 11:1:1:4 [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26cd530), client(1/0x26cdb10) [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdb10) [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdb10 with con 0x26cd450, requested num -1 [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:32:46.823 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:46.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdb10) [ CSSD]2013-05-23 14:32:46.829 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:32:46.829 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdc80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:46.829 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdc80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:32:47.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd530 [ CSSD]2013-05-23 14:32:47.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd530) con(0x261be70) skgpid ospid 706 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:47.287 [1199044928] >TRACE: clssgmAllocProc: (0x261c6d0) allocated [ CSSD]2013-05-23 14:32:47.288 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:32:47.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c6d0 - 1,2,3 [ CSSD]2013-05-23 14:32:47.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b400) proc(0x261c6d0) pid(747) version 11:1:1:4 [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x261c6d0), client(1/0x261cab0) [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cab0) [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cab0 with con 0x261c5f0, requested num -1 [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26cd530/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:32:47.296 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:47.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cab0) [ CSSD]2013-05-23 14:32:47.302 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:32:47.302 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cd830) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:32:47.302 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cd830) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:32:47.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9760) [ CSSD]2013-05-23 14:32:47.369 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9760), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:32:47.369 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9760), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:32:47.369 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 14:32:47.375 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42baac0) skgpid 27432 ospid 27432 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:47.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c6d0 [ CSSD]2013-05-23 14:32:47.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c6d0) con(0x268b400) skgpid ospid 747 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:47.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:48.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:48.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:49.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:50.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:50.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:50.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:50.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:50.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:32:50.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0645002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:51.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0646002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:51.205 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:51.205 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:51.205 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:51.205 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:51.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0647002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:51.212 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:51.212 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:51.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:51.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0648002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:51.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:32:51.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:32:51.913 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:32:51.913 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:32:51.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0649002b) incarnation(174631051) [ CSSD]2013-05-23 14:32:51.920 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:32:51.920 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:32:52.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:52.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:53.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:54.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:54.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:55.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:32:55.562 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:32:55.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:56.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:56.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:57.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 14:32:57.169 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:32:57.169 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:32:57.169 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:32:57.170 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc430 [ CSSD]2013-05-23 14:32:57.170 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc430) con(0x7f82b42dd7c0) skgpid 29487 ospid 29487 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:32:57.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:32:58.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:32:58.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:32:59.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:00.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:00.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:00.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:00.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:00.669 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:00.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064a002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:01.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:02.063 [1199044928] >TRACE: clssgmAllocProc: (0x26cd520) allocated [ CSSD]2013-05-23 14:33:02.064 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:33:02.065 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd520 - 1,2,3 [ CSSD]2013-05-23 14:33:02.065 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a40) proc(0x26cd520) pid(862) version 11:1:1:4 [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cd520), client(1/0x26cdc20) [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdc20) [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdc20 with con 0x26cd450, requested num -1 [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:02.072 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:02.079 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdc20) [ CSSD]2013-05-23 14:33:02.079 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdc20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:33:02.079 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cd2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:02.080 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cd2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:02.282 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd520 [ CSSD]2013-05-23 14:33:02.282 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd520) con(0x26a6a40) skgpid ospid 862 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:02.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:02.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:03.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:04.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:04.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:05.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:05.569 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:05.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:06.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:06.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:07.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064b002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:07.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:33:07.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:33:07.173 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:33:07.173 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:07.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(064c002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:07.180 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:33:07.180 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:33:07.524 [1199044928] >TRACE: clssgmAllocProc: (0x26cd520) allocated [ CSSD]2013-05-23 14:33:07.525 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:07.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd520 - 1,2,3 [ CSSD]2013-05-23 14:33:07.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261be70) proc(0x26cd520) pid(760/760) version 11:1:1:4 [ CSSD]2013-05-23 14:33:07.532 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cd520), client(1/0x26cd970) [ CSSD]2013-05-23 14:33:07.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cd970) [ CSSD]2013-05-23 14:33:07.532 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:33:07.532 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:33:07.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:08.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:08.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:09.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:10.572 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:10.572 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:10.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:10.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:10.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:10.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064d002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:11.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:12.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:12.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:13.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:14.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:14.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:15.575 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:15.575 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:15.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:16.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:16.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:17.316 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:17.317 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:33:17.318 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:17.318 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(1056) version 11:1:1:4 [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1bc0), client(1/0x267bab0) [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267bab0 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:17.324 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:17.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:17.331 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:33:17.331 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:17.331 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:17.533 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:33:17.533 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 1056 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:18.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:18.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:18.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:20.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:20.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:20.577 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:20.712 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:20.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:20.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:20.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064e002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:22.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:22.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064f002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:22.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:33:22.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:33:22.423 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:33:22.423 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:22.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0650002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:22.430 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:33:22.430 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:33:22.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:22.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:24.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:24.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:24.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:25.581 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:25.581 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:26.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:26.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:26.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:28.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:28.691 [1199044928] >TRACE: clssgmAllocProc: (0x268bdb0) allocated [ CSSD]2013-05-23 14:33:28.692 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:28.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bdb0 - 1,2,3 [ CSSD]2013-05-23 14:33:28.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x268bdb0) pid(1170/1170) version 11:1:1:4 [ CSSD]2013-05-23 14:33:28.699 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x268bdb0), client(1/0x267d4f0) [ CSSD]2013-05-23 14:33:28.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d4f0) [ CSSD]2013-05-23 14:33:28.699 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:33:28.699 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:33:28.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d4f0) [ CSSD]2013-05-23 14:33:28.735 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d4f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:33:28.735 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d4f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:33:28.735 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:33:28.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bdb0 [ CSSD]2013-05-23 14:33:28.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bdb0) con(0x26cddc0) skgpid 1170 ospid 1170 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:28.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:28.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:28.921 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:28.922 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:28.922 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:28.922 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(1173/1173) version 11:1:1:4 [ CSSD]2013-05-23 14:33:28.939 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1bc0), client(1/0x267b920) [ CSSD]2013-05-23 14:33:28.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267b920) [ CSSD]2013-05-23 14:33:28.939 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:33:28.939 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267b920) [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267b920), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267b920), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:33:28.986 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid 1173 ospid 1173 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:29.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:29.584 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:33:30.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:30.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:30.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:30.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:31.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0651002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:31.787 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:31.788 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:31.788 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:31.788 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdc90) proc(0x26e1bc0) pid(1199) version 11:1:1:4 [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1bc0), client(1/0x267bb30) [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bb30) [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x267bb30 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bca0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:33:31.797 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:31.798 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:31.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bb30) [ CSSD]2013-05-23 14:33:31.805 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bb30), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:33:31.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bfa0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:33:31.805 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x267bfa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:31.916 [1199044928] >TRACE: clssgmAllocProc: (0x269eb20) allocated [ CSSD]2013-05-23 14:33:31.916 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:31.917 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269eb20 - 1,2,3 [ CSSD]2013-05-23 14:33:31.917 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267ba60) proc(0x269eb20) pid(1204) version 11:1:1:4 [ CSSD]2013-05-23 14:33:31.933 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:33:31.934 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:33:31.936 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:33:31.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x269eb20 [ CSSD]2013-05-23 14:33:31.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269eb20) con(0x267ba60) skgpid ospid 1204 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:32.007 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:33:32.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdc90) skgpid ospid 1199 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:32.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:32.573 [1199044928] >TRACE: clssgmAllocProc: (0x267d5f0) allocated [ CSSD]2013-05-23 14:33:32.574 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:33:32.575 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d5f0 - 1,2,3 [ CSSD]2013-05-23 14:33:32.575 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdc90) proc(0x267d5f0) pid(1216) version 11:1:1:4 [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x267d5f0), client(1/0x267bab0) [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267bab0 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:32.581 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:32.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:32.589 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:33:32.589 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:32.589 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:32.791 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d5f0 [ CSSD]2013-05-23 14:33:32.791 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d5f0) con(0x26cdc90) skgpid ospid 1216 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:32.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:32.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:34.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:34.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:34.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:34.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:34.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:36.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:36.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:36.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:37.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0652002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:37.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:33:37.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:33:37.673 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:33:37.673 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:37.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0653002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:37.680 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:33:37.680 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:33:38.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:38.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:38.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:39.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:39.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:40.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:40.756 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:40.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:40.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:41.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0654002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:41.182 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:41.182 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:41.183 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:41.183 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(1344) version 11:1:1:4 [ CSSD]2013-05-23 14:33:41.699 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:33:41.700 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 1344 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:42.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:42.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:42.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:44.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:44.592 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:44.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:44.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:44.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:46.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:47.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:47.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:47.560 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:47.561 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:47.562 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:47.562 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(1550) version 11:1:1:4 [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1bc0), client(1/0x267bab0) [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267bab0 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:47.580 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:47.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267bab0) [ CSSD]2013-05-23 14:33:47.588 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267bab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:33:47.588 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:47.588 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:47.790 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:33:47.790 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 1550 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:47.834 [1199044928] >TRACE: clssgmAllocProc: (0x267b2d0) allocated [ CSSD]2013-05-23 14:33:47.835 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:33:47.835 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267b2d0 - 1,2,3 [ CSSD]2013-05-23 14:33:47.835 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x267b2d0) pid(1559) version 11:1:1:4 [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x267b2d0), client(1/0x267b8b0) [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267b8b0) [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267b8b0 with con 0x267d590, requested num -1 [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267ba20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:33:47.841 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:47.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267b8b0) [ CSSD]2013-05-23 14:33:47.847 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267b8b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:33:47.847 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:33:47.847 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:33:48.050 [1199044928] >TRACE: clssgmDeadProc: proc 0x267b2d0 [ CSSD]2013-05-23 14:33:48.050 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267b2d0) con(0x26cdae0) skgpid ospid 1559 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:48.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:49.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:49.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:49.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:49.596 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:50.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:50.779 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:33:51.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:51.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:51.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0655002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:51.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0656002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:51.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:33:51.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:33:51.463 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:33:51.463 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:51.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0657002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:51.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:33:51.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8770 [ CSSD]2013-05-23 14:33:51.831 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8770) con(0x7f82b42de1c0) skgpid 28073 ospid 28073 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:33:52.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:52.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0658002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:52.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:33:52.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:33:52.922 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:33:52.922 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:33:52.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0659002b) incarnation(174631051) [ CSSD]2013-05-23 14:33:52.929 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:33:52.929 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:33:53.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:53.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:54.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:54.598 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:54.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:33:55.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:55.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:56.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:57.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:57.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:57.245 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:33:57.245 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:33:57.246 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:33:57.246 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdc90) proc(0x26e1bc0) pid(1548/1548) version 11:1:1:4 [ CSSD]2013-05-23 14:33:57.262 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1bc0), client(1/0x267b980) [ CSSD]2013-05-23 14:33:57.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267b980) [ CSSD]2013-05-23 14:33:57.262 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:33:57.262 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:33:58.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:33:59.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:33:59.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:33:59.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:33:59.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:00.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:00.992 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:01.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065a002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:01.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:01.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:02.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:03.087 [1199044928] >TRACE: clssgmAllocProc: (0x269eaa0) allocated [ CSSD]2013-05-23 14:34:03.088 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:34:03.089 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269eaa0 - 1,2,3 [ CSSD]2013-05-23 14:34:03.089 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c090) proc(0x269eaa0) pid(1739) version 11:1:1:4 [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x269eaa0), client(1/0x267c530) [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c530) [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c530 with con 0x26788b0, requested num -1 [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ee0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:03.095 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:03.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c530) [ CSSD]2013-05-23 14:34:03.102 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c530), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:34:03.102 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678730) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:03.102 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678730) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:03.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:03.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:03.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x269eaa0 [ CSSD]2013-05-23 14:34:03.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269eaa0) con(0x267c090) skgpid ospid 1739 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:04.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:04.605 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:04.605 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:05.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:05.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:06.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:07.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:07.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:08.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065b002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:08.172 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:34:08.172 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:34:08.172 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:34:08.172 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:08.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(065c002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:08.180 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:34:08.180 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:34:08.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:09.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:09.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:09.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:09.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:10.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:11.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:11.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065d002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:11.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:11.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:12.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:13.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:13.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:13.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:13.609 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:34:14.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:15.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:15.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:16.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:17.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:17.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:18.354 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:34:18.355 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:34:18.356 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:34:18.356 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bfc0) proc(0x2678730) pid(1887) version 11:1:1:4 [ CSSD]2013-05-23 14:34:18.362 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2678730), client(1/0x2678d40) [ CSSD]2013-05-23 14:34:18.362 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d40) [ CSSD]2013-05-23 14:34:18.362 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d40 with con 0x269eb10, requested num -1 [ CSSD]2013-05-23 14:34:18.362 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:18.362 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678eb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:34:18.363 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:18.363 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:18.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d40) [ CSSD]2013-05-23 14:34:18.369 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:34:18.369 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:18.369 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:18.412 [1199044928] >TRACE: clssgmAllocProc: (0x269a9f0) allocated [ CSSD]2013-05-23 14:34:18.413 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:34:18.413 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a9f0 - 1,2,3 [ CSSD]2013-05-23 14:34:18.413 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269eb40) proc(0x269a9f0) pid(1898) version 11:1:1:4 [ CSSD]2013-05-23 14:34:18.537 [1199044928] >TRACE: clssgmAllocProc: (0x26aaae0) allocated [ CSSD]2013-05-23 14:34:18.538 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:34:18.539 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaae0 - 1,2,3 [ CSSD]2013-05-23 14:34:18.539 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b160) proc(0x26aaae0) pid(1949) version 11:1:1:4 [ CSSD]2013-05-23 14:34:18.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:34:18.559 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:34:18.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaae0 [ CSSD]2013-05-23 14:34:18.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaae0) con(0x269b160) skgpid ospid 1949 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:18.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:18.571 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:34:18.571 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267bfc0) skgpid ospid 1887 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:18.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:18.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5323/0x2691090) [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5323 (0x2691090) [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x2691090 with con 0x267b8b0, requested num -1 [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x269b080/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:18.636 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:34:18.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5323 (0x2691090) [ CSSD]2013-05-23 14:34:18.643 [1199044928] >TRACE: clssgmExitGrock: client 5323 (0x2691090), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:34:18.643 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b380) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:34:18.643 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x269b380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:18.645 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a9f0 [ CSSD]2013-05-23 14:34:18.645 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a9f0) con(0x269eb40) skgpid ospid 1898 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:19.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:19.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:20.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:21.036 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:21.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065e002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:21.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:21.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:22.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:23.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:23.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:23.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065f002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:23.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:34:23.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:34:23.423 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:34:23.423 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:23.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0660002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:23.430 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:34:23.431 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:34:23.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:23.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:24.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:25.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:25.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:26.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267b980) [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267b980), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267b980), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:34:27.362 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdc90) skgpid 1548 ospid 1548 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:27.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:27.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:28.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:28.619 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:28.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:29.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:29.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:30.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:31.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:31.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0661002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:31.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:31.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:32.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:33.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:33.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:33.608 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:34:33.609 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:34:33.610 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:34:33.610 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(2071) version 11:1:1:4 [ CSSD]2013-05-23 14:34:33.616 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1bc0), client(1/0x267ba90) [ CSSD]2013-05-23 14:34:33.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:34:33.616 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267ba90 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:34:33.616 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:33.616 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:34:33.617 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:33.617 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:33.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:33.621 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:33.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:34:33.624 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267ba90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:34:33.624 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:33.624 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:33.826 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:34:33.826 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 2071 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:34.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:35.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:35.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:36.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:37.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:37.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:37.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:37.624 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:34:38.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0662002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:38.674 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:34:38.674 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:34:38.674 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:34:38.674 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:38.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0663002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:38.681 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:34:38.681 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:34:38.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:39.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:39.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:40.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:41.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:41.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0664002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:41.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:41.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:42.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:42.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:42.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:43.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:43.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:44.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:45.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:45.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:46.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:47.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:47.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:47.630 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:47.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:47.834 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:34:47.835 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:34:47.836 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:34:47.836 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(2206) version 11:1:1:4 [ CSSD]2013-05-23 14:34:47.842 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1bc0), client(1/0x267ba90) [ CSSD]2013-05-23 14:34:47.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:34:47.842 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267ba90 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:34:47.842 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:47.842 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:34:47.843 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:47.843 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:47.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:34:47.849 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267ba90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:34:47.849 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:47.849 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:48.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:34:48.051 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 2206 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:48.855 [1199044928] >TRACE: clssgmAllocProc: (0x267b2d0) allocated [ CSSD]2013-05-23 14:34:48.856 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:34:48.856 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267b2d0 - 1,2,3 [ CSSD]2013-05-23 14:34:48.856 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x267b2d0) pid(2221) version 11:1:1:4 [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x267b2d0), client(1/0x267b8e0) [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267b8e0) [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267b8e0 with con 0x267d590, requested num -1 [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267ba50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:34:48.863 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:48.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267b8e0) [ CSSD]2013-05-23 14:34:48.869 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267b8e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:34:48.869 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bd50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:34:48.869 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bd50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:34:48.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:49.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x267b2d0 [ CSSD]2013-05-23 14:34:49.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267b2d0) con(0x26cdae0) skgpid ospid 2221 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:34:49.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:49.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:50.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:51.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:34:51.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0665002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:51.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:51.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:51.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0666002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:51.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:34:51.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:34:51.723 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:34:51.723 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:51.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0667002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:51.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:34:51.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:34:52.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:52.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:52.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:53.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:53.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:53.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0668002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:53.923 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:34:53.923 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:34:53.923 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:34:53.923 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:34:53.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0669002b) incarnation(174631051) [ CSSD]2013-05-23 14:34:53.929 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:34:53.929 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:34:54.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:55.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:55.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:56.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:57.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:34:57.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:34:57.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:57.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:34:59.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:34:59.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:34:59.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:01.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:01.174 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:01.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066a002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:01.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:01.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:02.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:02.639 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:03.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:03.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:03.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:04.121 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bc0) allocated [ CSSD]2013-05-23 14:35:04.122 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:35:04.123 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bc0 - 1,2,3 [ CSSD]2013-05-23 14:35:04.123 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1bc0) pid(2377) version 11:1:1:4 [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1bc0), client(1/0x267ba90) [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267ba90 with con 0x267b450, requested num -1 [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bc00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:35:04.140 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:04.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267ba90) [ CSSD]2013-05-23 14:35:04.148 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267ba90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:35:04.148 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bf00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:04.149 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bf00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:35:04.351 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bc0 [ CSSD]2013-05-23 14:35:04.351 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bc0) con(0x26cdae0) skgpid ospid 2377 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:05.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:05.128 [1199044928] >TRACE: clssgmAllocProc: (0x26e1b30) allocated [ CSSD]2013-05-23 14:35:05.129 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:35:05.129 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1b30 - 1,2,3 [ CSSD]2013-05-23 14:35:05.129 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x26e1b30) pid(2427/2427) version 11:1:1:4 [ CSSD]2013-05-23 14:35:05.136 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1b30), client(1/0x267b9b0) [ CSSD]2013-05-23 14:35:05.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267b9b0) [ CSSD]2013-05-23 14:35:05.136 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:35:05.136 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267b9b0) [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267b9b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267b9b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1b30 [ CSSD]2013-05-23 14:35:05.416 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1b30) con(0x26cdae0) skgpid 2427 ospid 2427 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:05.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:05.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:07.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:07.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:07.642 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:07.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:07.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:09.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:09.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066b002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:09.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:35:09.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:35:09.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:35:09.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:09.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(066c002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:09.200 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:35:09.200 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:35:09.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:09.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:11.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:11.202 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:11.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066d002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:11.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:11.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:12.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:12.645 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:13.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:13.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:13.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:15.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:15.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:15.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:17.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:17.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42e9ef0) [ CSSD]2013-05-23 14:35:17.402 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42e9ef0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:35:17.402 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42e9ef0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.402 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ea390) [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ea390), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ea390), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e99c0 [ CSSD]2013-05-23 14:35:17.404 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e99c0) con(0x7f82b42e76e0) skgpid 29353 ospid 29353 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:17.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d3dc0) [ CSSD]2013-05-23 14:35:17.405 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d3dc0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:35:17.405 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d3dc0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.405 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42de070) [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42de070), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42de070), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d50d0 [ CSSD]2013-05-23 14:35:17.411 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d50d0) con(0x7f82b42e1c00) skgpid 29359 ospid 29359 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:17.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 14:35:17.414 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:35:17.414 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.414 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:35:17.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ea770) [ CSSD]2013-05-23 14:35:17.417 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ea770), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:35:17.417 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ea770), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.417 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3450 [ CSSD]2013-05-23 14:35:17.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3450) con(0x7f82b42d3c10) skgpid 29357 ospid 29357 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:17.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d3cc0) [ CSSD]2013-05-23 14:35:17.421 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d3cc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:35:17.421 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d3cc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:35:17.421 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:35:17.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e66d0 [ CSSD]2013-05-23 14:35:17.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e66d0) con(0x7f82b42e04f0) skgpid 29355 ospid 29355 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:17.648 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:17.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:17.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:17.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:19.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:19.384 [1199044928] >TRACE: clssgmAllocProc: (0x268bd80) allocated [ CSSD]2013-05-23 14:35:19.385 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:35:19.386 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bd80 - 1,2,3 [ CSSD]2013-05-23 14:35:19.386 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdda0) proc(0x268bd80) pid(2522) version 11:1:1:4 [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bd80), client(1/0x267d670) [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d670) [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d670 with con 0x268bcd0, requested num -1 [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bcf0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:35:19.392 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:19.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d670) [ CSSD]2013-05-23 14:35:19.398 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d670), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:35:19.398 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bff0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:19.399 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bff0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:35:19.601 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bd80 [ CSSD]2013-05-23 14:35:19.601 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bd80) con(0x26cdda0) skgpid ospid 2522 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:19.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:19.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:21.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:21.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:21.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066e002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:21.651 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:21.651 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:35:21.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:21.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:23.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:23.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:23.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:24.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066f002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:24.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:35:24.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:35:24.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:35:24.441 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:24.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0670002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:24.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:35:24.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:35:25.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:25.878 [1199044928] >TRACE: clssgmAllocProc: (0x268bd80) allocated [ CSSD]2013-05-23 14:35:25.879 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:35:25.880 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bd80 - 1,2,3 [ CSSD]2013-05-23 14:35:25.880 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdda0) proc(0x268bd80) pid(2508/2508) version 11:1:1:4 [ CSSD]2013-05-23 14:35:25.896 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bd80), client(1/0x268bcd0) [ CSSD]2013-05-23 14:35:25.896 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268bcd0) [ CSSD]2013-05-23 14:35:25.896 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:35:25.896 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:35:25.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:25.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:26.654 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:26.654 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:27.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:28.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:28.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:29.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:30.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:30.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:31.245 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:31.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:31.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0671002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:31.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:31.657 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:32.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:32.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:33.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:34.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:34.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:34.635 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:35:34.636 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:35:34.637 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:35:34.637 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x2678730) pid(2680) version 11:1:1:4 [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x267d500) [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d500 with con 0x269eb10, requested num -1 [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678dc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:35:34.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:34.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:35:34.651 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d500), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:35:34.651 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26790c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:34.651 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26790c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:35:34.853 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:35:34.853 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267d670) skgpid ospid 2680 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:35.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:36.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:36.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:36.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:36.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:37.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:38.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:38.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:39.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:39.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0672002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:39.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:35:39.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:35:39.691 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:35:39.691 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:39.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0673002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:39.697 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:35:39.697 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:35:40.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:40.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:41.271 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:41.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0674002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:41.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:41.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:41.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:42.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:42.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:43.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:44.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:44.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:45.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:45.664 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:45.664 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:35:46.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:46.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:47.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:48.101 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:35:48.102 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:35:48.102 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:35:48.102 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c0c0) proc(0x2678730) pid(2834) version 11:1:1:4 [ CSSD]2013-05-23 14:35:48.108 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x2678d80) [ CSSD]2013-05-23 14:35:48.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:35:48.108 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d80 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 14:35:48.108 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:48.108 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:35:48.109 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:35:48.109 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:48.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:35:48.115 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:35:48.115 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268fb90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:48.115 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268fb90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:35:48.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:48.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:48.317 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:35:48.317 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267c0c0) skgpid ospid 2834 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:49.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:49.889 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:35:49.890 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:35:49.890 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:35:49.890 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c0c0) proc(0x2678730) pid(2849) version 11:1:1:4 [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x2678d80) [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d80 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:35:49.897 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:49.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:35:49.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:35:49.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268fb90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:35:49.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268fb90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:35:50.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:35:50.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267c0c0) skgpid ospid 2849 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:35:50.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:50.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:50.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:50.667 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:51.291 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:35:51.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0675002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:51.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:51.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0676002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:51.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:35:51.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:35:51.980 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:35:51.980 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:51.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0677002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:51.987 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:35:51.987 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:35:52.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:52.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:53.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:54.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:54.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:54.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0678002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:54.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:35:54.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:35:54.940 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:35:54.940 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:35:54.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0679002b) incarnation(174631051) [ CSSD]2013-05-23 14:35:54.947 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:35:54.947 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:35:55.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:55.669 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:35:55.670 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:35:56.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:56.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:57.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:35:58.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:35:58.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:35:59.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:00.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:00.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:00.672 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:00.672 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:01.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:01.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(067a002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:01.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:02.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:02.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:03.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:04.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:04.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:05.135 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:36:05.136 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:36:05.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:36:05.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x2678730) pid(3033) version 11:1:1:4 [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x267d500) [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d500 with con 0x269eb10, requested num -1 [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678dc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:36:05.141 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:05.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:36:05.147 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d500), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:36:05.147 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26790c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:05.147 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26790c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:36:05.350 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:36:05.350 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267d670) skgpid ospid 3033 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:05.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:05.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:05.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:06.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:06.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:07.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:08.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:08.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:09.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:09.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:09.677 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:36:10.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067b002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:10.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:10.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:10.190 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:36:10.190 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:10.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067c002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:10.197 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:10.197 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:10.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:10.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:10.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067d002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:10.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:10.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:10.950 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:36:10.950 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:10.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067e002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:10.956 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:10.956 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:11.086 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:36:11.087 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:36:11.088 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:36:11.089 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:36:11.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:11.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(067f002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:11.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:12.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:12.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:13.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:14.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:14.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:14.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:14.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:15.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:16.122 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:36:16.123 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:36:16.124 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:36:16.124 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c0c0) proc(0x2678730) pid(3162/3162) version 11:1:1:4 [ CSSD]2013-05-23 14:36:16.140 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x2678bf0) [ CSSD]2013-05-23 14:36:16.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678bf0) [ CSSD]2013-05-23 14:36:16.140 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:36:16.140 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:36:16.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678bf0) [ CSSD]2013-05-23 14:36:16.157 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678bf0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:36:16.157 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678bf0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:36:16.157 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:36:16.158 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:36:16.158 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267c0c0) skgpid 3162 ospid 3162 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:16.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:16.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:17.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:18.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:18.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:19.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:19.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:19.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:20.387 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:36:20.388 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:36:20.389 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:36:20.389 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c0c0) proc(0x2678730) pid(3195) version 11:1:1:4 [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678730), client(1/0x2678d80) [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d80 with con 0x269ec20, requested num -1 [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:36:20.396 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:20.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d80) [ CSSD]2013-05-23 14:36:20.405 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:36:20.405 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268fb90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:20.405 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268fb90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:36:20.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:20.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:20.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:36:20.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267c0c0) skgpid ospid 3195 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:21.354 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:21.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0680002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:21.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:21.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 14:36:21.854 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:36:21.854 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:36:21.854 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a18e0 [ CSSD]2013-05-23 14:36:21.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a18e0) con(0x7f82b42de110) skgpid 26472 ospid 26472 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:22.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:22.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:23.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:24.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:24.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:24.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:24.686 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:25.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0681002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:25.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:25.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:25.439 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:36:25.439 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:25.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0682002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:25.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:25.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:25.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:26.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:26.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:27.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:28.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:28.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:29.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:29.689 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:29.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:30.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:30.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:31.387 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:31.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0683002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:31.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:32.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:32.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:33.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:33.691 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:36:33.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:34.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:34.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:35.641 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:36:35.642 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:36:35.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:36:35.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x2678730) pid(3355) version 11:1:1:4 [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678730), client(1/0x267d500) [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d500 with con 0x269eb10, requested num -1 [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678db0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:36:35.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:35.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d500) [ CSSD]2013-05-23 14:36:35.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d500), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:36:35.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26790b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:35.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26790b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:36:35.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:35.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:36:35.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267d670) skgpid ospid 3355 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:36.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:36.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:37.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:38.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:38.694 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:38.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:38.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:39.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:40.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0684002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:40.690 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:40.690 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:40.690 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:36:40.690 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:40.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0685002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:40.698 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:40.698 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:40.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:40.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:41.416 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:41.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0686002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:41.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:42.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:42.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:43.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:43.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:43.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:43.965 [1199044928] >TRACE: clssgmAllocProc: (0x2678730) allocated [ CSSD]2013-05-23 14:36:43.965 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:36:43.966 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678730 - 1,2,3 [ CSSD]2013-05-23 14:36:43.966 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c0c0) proc(0x2678730) pid(3250/3250) version 11:1:1:4 [ CSSD]2013-05-23 14:36:43.972 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678730), client(1/0x2678c20) [ CSSD]2013-05-23 14:36:43.972 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678c20) [ CSSD]2013-05-23 14:36:43.972 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:36:43.972 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:36:44.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:44.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:45.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:46.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:46.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:47.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:48.354 [1199044928] >TRACE: clssgmAllocProc: (0x269abb0) allocated [ CSSD]2013-05-23 14:36:48.355 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:36:48.355 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269abb0 - 1,2,3 [ CSSD]2013-05-23 14:36:48.355 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268fc70) proc(0x269abb0) pid(3479) version 11:1:1:4 [ CSSD]2013-05-23 14:36:48.361 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269abb0), client(1/0x2678b80) [ CSSD]2013-05-23 14:36:48.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:36:48.361 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678b80 with con 0x269aaf0, requested num -1 [ CSSD]2013-05-23 14:36:48.361 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:48.361 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269b390/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:36:48.362 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:36:48.362 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:48.368 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:36:48.368 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:36:48.368 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a8db0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:48.369 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a8db0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:36:48.571 [1199044928] >TRACE: clssgmDeadProc: proc 0x269abb0 [ CSSD]2013-05-23 14:36:48.571 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269abb0) con(0x268fc70) skgpid ospid 3479 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:48.699 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:48.699 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:48.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:48.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:49.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:50.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:50.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:50.898 [1199044928] >TRACE: clssgmAllocProc: (0x269aae0) allocated [ CSSD]2013-05-23 14:36:50.899 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:36:50.899 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269aae0 - 1,2,3 [ CSSD]2013-05-23 14:36:50.899 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x269aae0) pid(3506) version 11:1:1:4 [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269aae0), client(1/0x2678b80) [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678b80 with con 0x269aa20, requested num -1 [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269b2c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:36:50.906 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:50.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:36:50.912 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:36:50.912 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:36:50.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:36:51.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x269aae0 [ CSSD]2013-05-23 14:36:51.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269aae0) con(0x267d670) skgpid ospid 3506 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:36:51.437 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:36:51.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0687002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:52.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:52.184 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bd80), client(2/0x2678b70) [ CSSD]2013-05-23 14:36:52.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2678b70) [ CSSD]2013-05-23 14:36:52.184 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:36:52.184 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 14:36:52.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0688002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:52.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:52.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:52.242 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:36:52.242 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:52.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0689002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:52.249 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:52.249 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:52.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:52.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:53.702 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:53.702 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:36:54.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:54.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:54.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:55.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068a002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:55.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:36:55.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:36:55.942 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:36:55.942 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:36:55.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068b002b) incarnation(174631051) [ CSSD]2013-05-23 14:36:55.949 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:36:55.949 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:36:56.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:56.226 [1199044928] >TRACE: clssgmAllocProc: (0x2690fe0) allocated [ CSSD]2013-05-23 14:36:56.227 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:36:56.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690fe0 - 1,2,3 [ CSSD]2013-05-23 14:36:56.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690120) proc(0x2690fe0) pid(3254/3254) version 11:1:1:4 [ CSSD]2013-05-23 14:36:56.234 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690fe0), client(1/0x26790a0) [ CSSD]2013-05-23 14:36:56.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26790a0) [ CSSD]2013-05-23 14:36:56.234 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:36:56.234 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:36:56.886 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690fe0), client(2/0x2679210) [ CSSD]2013-05-23 14:36:56.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2679210) [ CSSD]2013-05-23 14:36:56.886 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:36:56.886 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:36:56.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:56.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:36:57.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:36:57.705 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:36:58.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:36:58.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:36:58.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:00.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:00.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:00.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:01.460 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:01.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(068c002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:02.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:02.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:02.708 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:02.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:02.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:04.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:04.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:04.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:06.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:06.153 [1199044928] >TRACE: clssgmAllocProc: (0x26ecd90) allocated [ CSSD]2013-05-23 14:37:06.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:37:06.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecd90 - 1,2,3 [ CSSD]2013-05-23 14:37:06.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9710) proc(0x26ecd90) pid(3685) version 11:1:1:4 [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ecd90), client(1/0x26ed440) [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed440 with con 0x26eccd0, requested num -1 [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed5b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:06.162 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:06.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:06.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:06.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed8b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:06.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed8b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:06.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecd90 [ CSSD]2013-05-23 14:37:06.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecd90) con(0x26a9710) skgpid ospid 3685 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:07.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:07.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:07.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:07.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:08.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:08.468 [1199044928] >TRACE: clssgmAllocProc: (0x26ecd90) allocated [ CSSD]2013-05-23 14:37:08.469 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:37:08.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecd90 - 1,2,3 [ CSSD]2013-05-23 14:37:08.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9710) proc(0x26ecd90) pid(3743) version 11:1:1:4 [ CSSD]2013-05-23 14:37:08.476 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ecd90), client(1/0x26ed440) [ CSSD]2013-05-23 14:37:08.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:08.476 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed440 with con 0x26eccd0, requested num -1 [ CSSD]2013-05-23 14:37:08.476 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:08.476 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed5b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:08.477 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:08.477 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:08.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:08.483 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:08.483 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed8b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:08.483 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed8b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:08.686 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecd90 [ CSSD]2013-05-23 14:37:08.686 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecd90) con(0x26a9710) skgpid ospid 3743 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:08.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:37:08.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:37:08.927 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:37:08.927 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:37:09.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068d002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:09.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:09.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:09.008 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:37:09.008 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:37:09.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068e002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:09.015 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:09.015 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:09.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:09.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:10.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:10.932 [1199044928] >TRACE: clssgmAllocProc: (0x26ecd90) allocated [ CSSD]2013-05-23 14:37:10.933 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:37:10.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecd90 - 1,2,3 [ CSSD]2013-05-23 14:37:10.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9710) proc(0x26ecd90) pid(3823) version 11:1:1:4 [ CSSD]2013-05-23 14:37:11.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:11.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:11.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068f002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:11.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:11.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:11.195 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:37:11.195 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:11.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0690002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:11.202 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:11.202 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:11.491 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:11.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0691002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:12.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:12.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:12.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:13.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:13.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:13.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecd90 [ CSSD]2013-05-23 14:37:13.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecd90) con(0x26a9710) skgpid ospid 3823 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:14.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:15.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:15.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:16.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:17.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:17.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:17.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:17.717 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:18.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:19.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:19.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:20.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:21.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:21.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:21.402 [1199044928] >TRACE: clssgmAllocProc: (0x26aad80) allocated [ CSSD]2013-05-23 14:37:21.403 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:37:21.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad80 - 1,2,3 [ CSSD]2013-05-23 14:37:21.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x26aad80) pid(4212) version 11:1:1:4 [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26aad80), client(1/0x26ed320) [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed320 with con 0x26a9000, requested num -1 [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:21.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:21.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:21.418 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed320), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:21.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:21.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:21.519 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:21.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0692002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:21.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad80 [ CSSD]2013-05-23 14:37:21.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad80) con(0x267d670) skgpid ospid 4212 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:22.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:22.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:22.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:23.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:23.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:24.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:25.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:25.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:26.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:26.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0693002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:26.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:26.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:26.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:37:26.445 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:26.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0694002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:26.451 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:26.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:27.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:27.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:27.723 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:27.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:28.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:29.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:29.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:30.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:31.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:31.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:31.539 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:31.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0695002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:32.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:32.726 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:32.726 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:33.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:33.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:34.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:35.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:35.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:36.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:36.672 [1199044928] >TRACE: clssgmAllocProc: (0x26ecd90) allocated [ CSSD]2013-05-23 14:37:36.673 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:37:36.674 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecd90 - 1,2,3 [ CSSD]2013-05-23 14:37:36.674 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9710) proc(0x26ecd90) pid(4361) version 11:1:1:4 [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ecd90), client(1/0x26ed440) [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed440 with con 0x26eccd0, requested num -1 [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed5b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:36.681 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:36.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:36.688 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:36.688 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed8b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:36.688 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed8b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:36.890 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecd90 [ CSSD]2013-05-23 14:37:36.890 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecd90) con(0x26a9710) skgpid ospid 4361 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:37.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:37.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:37.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:37.729 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:37.948 [1199044928] >TRACE: clssgmAllocProc: (0x26aad80) allocated [ CSSD]2013-05-23 14:37:37.948 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:37:37.949 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad80 - 1,2,3 [ CSSD]2013-05-23 14:37:37.949 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x26aad80) pid(4414) version 11:1:1:4 [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26aad80), client(1/0x26ed320) [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed320 with con 0x26a9000, requested num -1 [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:37.966 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:37.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:37.973 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed320), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:37.973 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:37.973 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:38.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad80 [ CSSD]2013-05-23 14:37:38.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad80) con(0x267d670) skgpid ospid 4414 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:38.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:39.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:39.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:40.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:41.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:41.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:41.561 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:41.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0696002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:41.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0697002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:41.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:41.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:41.703 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:37:41.703 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:41.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0698002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:41.710 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:41.711 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:41.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:41.732 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:37:42.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:43.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:43.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:44.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:45.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:45.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:46.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:46.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:46.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:47.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:47.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:48.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:48.620 [1199044928] >TRACE: clssgmAllocProc: (0x26ecd90) allocated [ CSSD]2013-05-23 14:37:48.621 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:37:48.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecd90 - 1,2,3 [ CSSD]2013-05-23 14:37:48.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9710) proc(0x26ecd90) pid(4494) version 11:1:1:4 [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ecd90), client(1/0x26ed440) [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed440 with con 0x26eccd0, requested num -1 [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed5b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:48.628 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:48.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed440) [ CSSD]2013-05-23 14:37:48.636 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:48.636 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed8b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:48.636 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed8b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:48.839 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecd90 [ CSSD]2013-05-23 14:37:48.839 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecd90) con(0x26a9710) skgpid ospid 4494 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:49.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:49.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:50.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:51.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:51.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:51.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:37:51.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0699002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:51.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:51.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:51.932 [1199044928] >TRACE: clssgmAllocProc: (0x26aad80) allocated [ CSSD]2013-05-23 14:37:51.933 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:37:51.933 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad80 - 1,2,3 [ CSSD]2013-05-23 14:37:51.933 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x26aad80) pid(4529) version 11:1:1:4 [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26aad80), client(1/0x26ed320) [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed320 with con 0x26a9000, requested num -1 [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:37:51.939 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:51.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed320) [ CSSD]2013-05-23 14:37:51.946 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed320), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:37:51.946 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:37:51.946 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:37:52.149 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad80 [ CSSD]2013-05-23 14:37:52.149 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad80) con(0x267d670) skgpid ospid 4529 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:37:52.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069a002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:52.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:52.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:52.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:37:52.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:52.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(069b002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:52.513 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:52.513 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:52.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:53.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:53.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:54.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:55.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:55.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:56.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:56.740 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:37:56.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:37:56.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069c002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:56.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:37:56.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:37:56.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:37:56.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:37:56.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(069d002b) incarnation(174631051) [ CSSD]2013-05-23 14:37:56.979 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:37:56.979 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:37:57.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:57.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:37:57.439 [1199044928] >TRACE: clssgmAllocProc: (0x26aade0) allocated [ CSSD]2013-05-23 14:37:57.440 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:37:57.441 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aade0 - 1,2,3 [ CSSD]2013-05-23 14:37:57.441 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x26aade0) pid(4600/4600) version 11:1:1:4 [ CSSD]2013-05-23 14:37:57.447 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26aade0), client(1/0x26ecce0) [ CSSD]2013-05-23 14:37:57.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ecce0) [ CSSD]2013-05-23 14:37:57.447 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:37:57.447 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:37:58.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:37:59.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:37:59.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:00.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:01.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:01.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:01.607 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:01.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:01.744 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:01.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069e002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:02.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:03.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:03.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:04.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:05.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:05.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:06.747 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:06.747 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:06.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:07.182 [1199044928] >TRACE: clssgmAllocProc: (0x26de210) allocated [ CSSD]2013-05-23 14:38:07.183 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:38:07.183 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de210 - 1,2,3 [ CSSD]2013-05-23 14:38:07.183 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed9c0) proc(0x26de210) pid(4674) version 11:1:1:4 [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de210), client(1/0x26de8d0) [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de8d0) [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de8d0 with con 0x26ee2c0, requested num -1 [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dea40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:07.190 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:07.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de8d0) [ CSSD]2013-05-23 14:38:07.197 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de8d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:38:07.197 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ded40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:07.197 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ded40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:07.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de210 [ CSSD]2013-05-23 14:38:07.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de210) con(0x26ed9c0) skgpid ospid 4674 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:07.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:07.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:08.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:09.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:09.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:10.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:11.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:11.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:11.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:11.750 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:11.750 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:11.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069f002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:12.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a0002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:12.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:38:12.222 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:38:12.222 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:38:12.222 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:12.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a1002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:12.229 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:38:12.229 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:38:12.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:13.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:13.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:14.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:15.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:15.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:16.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:16.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:16.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:17.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:17.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:18.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:19.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:19.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:20.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:21.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:21.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:21.654 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:21.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:21.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:21.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a2002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:22.439 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:38:22.440 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:38:22.440 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:38:22.440 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed8b0) proc(0x26de070) pid(4814) version 11:1:1:4 [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de7e0) [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de7e0 with con 0x26ddfa0, requested num -1 [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de950/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:22.448 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:22.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:22.455 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:38:22.455 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dec50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:22.456 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dec50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:22.658 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:38:22.658 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ed8b0) skgpid ospid 4814 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:22.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:23.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:23.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:24.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:25.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:25.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:25.758 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:25.759 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:38:26.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:27.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a3002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:27.482 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:38:27.482 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:38:27.482 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:38:27.482 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:27.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a4002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:27.489 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:38:27.489 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:38:27.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:27.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:28.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:29.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:29.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:30.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:30.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:31.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:31.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:31.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:31.678 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:31.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a5002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:32.086 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:38:32.087 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:32.088 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:38:32.088 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed8b0) proc(0x26de070) pid(4926) version 11:1:1:4 [ CSSD]2013-05-23 14:38:32.095 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de7e0) [ CSSD]2013-05-23 14:38:32.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:32.095 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26de7e0 with con 0x26ddfa0, requested num -1 [ CSSD]2013-05-23 14:38:32.095 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:38:32.095 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de950/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:38:32.096 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:32.096 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:32.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:32.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de7e0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:38:32.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dec50) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:38:32.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26dec50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:32.218 [1199044928] >TRACE: clssgmAllocProc: (0x2681a40) allocated [ CSSD]2013-05-23 14:38:32.219 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:32.219 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681a40 - 1,2,3 [ CSSD]2013-05-23 14:38:32.219 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26de8b0) proc(0x2681a40) pid(4931) version 11:1:1:4 [ CSSD]2013-05-23 14:38:32.235 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:38:32.237 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:38:32.239 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:38:32.240 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681a40 [ CSSD]2013-05-23 14:38:32.240 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681a40) con(0x26de8b0) skgpid ospid 4931 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:32.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:38:32.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ed8b0) skgpid ospid 4926 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:33.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:33.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:33.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:35.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:35.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:35.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:35.765 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:35.765 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:37.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:37.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:37.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:37.702 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:38:37.703 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:38:37.704 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:38:37.704 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed8b0) proc(0x26de070) pid(4997) version 11:1:1:4 [ CSSD]2013-05-23 14:38:37.720 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de7e0) [ CSSD]2013-05-23 14:38:37.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:37.720 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de7e0 with con 0x26ddfa0, requested num -1 [ CSSD]2013-05-23 14:38:37.720 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:37.720 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de950/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:38:37.721 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:37.721 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:37.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de7e0) [ CSSD]2013-05-23 14:38:37.727 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de7e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:38:37.727 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dec50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:37.728 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dec50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:37.930 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:38:37.930 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ed8b0) skgpid ospid 4997 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:39.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:39.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:39.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:40.517 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:38:40.517 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:40.518 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:38:40.518 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed1a0) proc(0x26de070) pid(5356/5356) version 11:1:1:4 [ CSSD]2013-05-23 14:38:40.534 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de580) [ CSSD]2013-05-23 14:38:40.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26de580) [ CSSD]2013-05-23 14:38:40.535 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:38:40.535 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:38:40.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26de580) [ CSSD]2013-05-23 14:38:40.547 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26de580), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:38:40.547 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26de580), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:38:40.547 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:38:40.548 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:38:40.548 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ed1a0) skgpid 5356 ospid 5356 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:40.682 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:38:40.683 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:40.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:38:40.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed1a0) proc(0x26de070) pid(5367/5367) version 11:1:1:4 [ CSSD]2013-05-23 14:38:40.689 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de5a0) [ CSSD]2013-05-23 14:38:40.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26de5a0) [ CSSD]2013-05-23 14:38:40.689 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:38:40.689 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:38:40.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:40.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:40.828 [1199044928] >TRACE: clssgmAllocProc: (0x2681a00) allocated [ CSSD]2013-05-23 14:38:40.829 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:40.829 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681a00 - 1,2,3 [ CSSD]2013-05-23 14:38:40.829 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26deca0) proc(0x2681a00) pid(5335) version 11:1:1:4 [ CSSD]2013-05-23 14:38:41.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:41.361 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681a00 [ CSSD]2013-05-23 14:38:41.361 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681a00) con(0x26deca0) skgpid ospid 5335 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:41.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:41.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:41.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:41.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a6002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:42.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a7002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:42.732 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:38:42.732 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:38:42.732 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:38:42.732 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:42.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a8002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:42.739 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:38:42.739 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:38:43.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:43.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:43.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:45.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:45.770 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:45.770 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:45.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:45.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:47.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:47.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:47.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:48.883 [1199044928] >TRACE: clssgmAllocProc: (0x2681a00) allocated [ CSSD]2013-05-23 14:38:48.884 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:38:48.885 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681a00 - 1,2,3 [ CSSD]2013-05-23 14:38:48.885 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26deca0) proc(0x2681a00) pid(5543) version 11:1:1:4 [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681a00), client(1/0x2682150) [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2682150) [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2682150 with con 0x2681930, requested num -1 [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b3c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:48.891 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:48.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2682150) [ CSSD]2013-05-23 14:38:48.897 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2682150), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:38:48.897 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b3f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:48.897 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b3f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:49.100 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681a00 [ CSSD]2013-05-23 14:38:49.100 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681a00) con(0x26deca0) skgpid ospid 5543 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:49.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:49.772 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:49.772 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:38:49.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:49.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:51.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:51.727 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:38:51.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:51.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:51.898 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 14:38:51.898 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef0a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:38:51.898 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef0a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:38:51.898 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 14:38:51.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 14:38:51.901 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a67c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:38:51.901 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a67c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:38:51.901 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:38:51.902 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:38:51.902 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid 31986 ospid 31986 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:51.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a9002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:52.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06aa002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:52.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:38:52.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:38:52.763 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:38:52.763 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:52.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ab002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:52.770 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:38:52.770 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:38:52.967 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:38:52.968 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:38:52.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:38:52.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(5580) version 11:1:1:4 [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:38:52.975 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:52.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:38:52.984 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:38:52.984 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2691430) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:38:52.984 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2691430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:38:53.186 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:38:53.186 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 5580 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:38:53.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:53.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:53.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:54.774 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:54.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:55.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:55.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:55.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:57.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:57.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:57.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:38:57.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ac002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:57.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:38:57.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:38:57.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:38:57.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:38:58.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ad002b) incarnation(174631051) [ CSSD]2013-05-23 14:38:58.000 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:38:58.000 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:38:59.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:38:59.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:38:59.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:38:59.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:38:59.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:01.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:01.750 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:01.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:01.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:01.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ae002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:03.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:03.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:03.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:04.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:04.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:05.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:05.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:05.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:07.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:07.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:07.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:08.227 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:08.228 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:39:08.229 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:08.229 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(5770) version 11:1:1:4 [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:08.236 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:08.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:08.243 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:39:08.243 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2691430) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:08.243 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2691430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:08.445 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:08.445 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 5770 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:09.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:09.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:09.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:09.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:09.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:11.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:11.772 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:11.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06af002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:12.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:12.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:13.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b0002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:13.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:39:13.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:39:13.243 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:39:13.243 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:13.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b1002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:13.250 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:39:13.250 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:39:13.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:13.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:13.785 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:39:14.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:14.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:15.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:16.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:16.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:17.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:18.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:18.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:18.720 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:18.721 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:39:18.721 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:18.721 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(5910) version 11:1:1:4 [ CSSD]2013-05-23 14:39:18.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:18.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:18.847 [1199044928] >TRACE: clssgmAllocProc: (0x26dee70) allocated [ CSSD]2013-05-23 14:39:18.848 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:39:18.849 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dee70 - 1,2,3 [ CSSD]2013-05-23 14:39:18.849 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26dee70) pid(5920) version 11:1:1:4 [ CSSD]2013-05-23 14:39:18.865 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:39:18.867 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:39:18.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dee70 [ CSSD]2013-05-23 14:39:18.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dee70) con(0x2660e70) skgpid ospid 5920 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5324/0x26e8790) [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5324 (0x26e8790) [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26e8790 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26de710/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:18.942 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:39:18.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5324 (0x26e8790) [ CSSD]2013-05-23 14:39:18.951 [1199044928] >TRACE: clssgmExitGrock: client 5324 (0x26e8790), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:39:18.951 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:39:18.951 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:18.952 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:18.952 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 5910 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:19.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:20.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:20.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:21.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:21.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:22.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b2002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:22.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:22.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:23.493 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:23.494 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:39:23.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:23.495 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:23.495 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(5973) version 11:1:1:4 [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:23.501 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:23.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:23.508 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:39:23.508 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:23.509 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:23.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:23.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 5973 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:23.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:23.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:24.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:24.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:25.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:26.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:26.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:27.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:28.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:28.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:28.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b3002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:28.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:39:28.494 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:39:28.494 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:39:28.495 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:28.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b4002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:28.501 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:39:28.501 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:39:28.793 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:28.794 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:29.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:30.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:30.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:31.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:31.821 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:32.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b5002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:32.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:32.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:33.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:33.797 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:33.797 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:34.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:34.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:35.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:36.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:36.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:37.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:37.799 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:37.799 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:39:38.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:38.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:38.748 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:38.749 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:39:38.750 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:38.750 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(6129) version 11:1:1:4 [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:38.757 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:38.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:38.764 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:39:38.764 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:38.764 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:38.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:38.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 6129 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:39.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:40.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:40.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:41.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:41.845 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:42.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b6002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:42.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:42.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:42.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:42.802 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:43.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b7002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:43.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:39:43.754 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:39:43.754 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:39:43.755 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:43.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b8002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:43.761 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:39:43.761 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:39:43.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:44.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:44.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:45.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:46.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:46.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:47.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:47.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:47.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:48.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:48.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:49.145 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:49.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:39:49.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:49.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(6257) version 11:1:1:4 [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:49.153 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:49.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:49.160 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:39:49.161 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:49.161 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:49.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:49.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 6257 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:49.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:50.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:50.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:51.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:51.867 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:39:52.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b9002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:52.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:52.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:52.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:52.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:53.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ba002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:53.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:39:53.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:39:53.034 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:39:53.034 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:53.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06bb002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:53.042 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:39:53.042 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:39:53.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:54.007 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:39:54.007 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:39:54.008 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:39:54.008 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(6306) version 11:1:1:4 [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26e8790) [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8790 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:39:54.014 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:54.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8790) [ CSSD]2013-05-23 14:39:54.021 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8790), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:39:54.021 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:39:54.021 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:39:54.224 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:39:54.224 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid ospid 6306 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:39:54.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:54.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:55.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:56.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:56.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:57.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:39:57.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:39:57.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:39:58.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:39:58.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:39:59.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06bc002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:59.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:39:59.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:39:59.004 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:39:59.004 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:39:59.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06bd002b) incarnation(174631051) [ CSSD]2013-05-23 14:39:59.011 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:39:59.011 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:39:59.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:00.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:00.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:01.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:01.813 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:40:01.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:01.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:02.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06be002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:02.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:02.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:03.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:04.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:04.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:04.625 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:40:04.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:40:04.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:40:04.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(6642/6642) version 11:1:1:4 [ CSSD]2013-05-23 14:40:04.632 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x26a67c0) [ CSSD]2013-05-23 14:40:04.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 14:40:04.632 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:40:04.632 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:40:04.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 14:40:04.917 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a67c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:40:04.917 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a67c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:40:04.917 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:40:04.918 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:40:04.918 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid 6642 ospid 6642 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:06.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:06.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:06.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:06.815 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:06.815 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:08.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:08.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:08.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:09.259 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:40:09.260 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:40:09.261 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:40:09.261 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x266f0d0) pid(6681) version 11:1:1:4 [ CSSD]2013-05-23 14:40:09.267 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x266f0d0), client(1/0x268fa20) [ CSSD]2013-05-23 14:40:09.267 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:40:09.267 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:40:09.267 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:09.267 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:40:09.268 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:40:09.268 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:09.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:40:09.274 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:40:09.274 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:09.274 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:40:09.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:40:09.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26ee500) skgpid ospid 6681 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:10.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:10.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:10.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:11.818 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:11.818 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26de5a0) [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26de5a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26de5a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:40:11.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ed1a0) skgpid 5367 ospid 5367 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:11.925 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:12.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:12.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06bf002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:12.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:12.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:14.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:14.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c0002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:14.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:40:14.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:40:14.254 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:40:14.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:14.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c1002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:14.260 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:40:14.260 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:40:14.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:14.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:16.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:16.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:16.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:16.821 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:16.821 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cd970) [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cd970), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cd970), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd520 [ CSSD]2013-05-23 14:40:17.485 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd520) con(0x261be70) skgpid 760 ospid 760 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:18.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:18.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:18.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:20.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:20.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:20.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:21.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:21.824 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:21.947 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:22.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:22.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c2002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:22.388 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:40:22.389 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:40:22.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:40:22.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x266f0d0) pid(6780/6780) version 11:1:1:4 [ CSSD]2013-05-23 14:40:22.396 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f0d0), client(1/0x26cda40) [ CSSD]2013-05-23 14:40:22.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cda40) [ CSSD]2013-05-23 14:40:22.396 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:40:22.396 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:40:22.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:22.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:24.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:24.512 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:40:24.512 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:40:24.513 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:40:24.513 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed0d0) proc(0x26ce250) pid(6828) version 11:1:1:4 [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ce190, requested num -1 [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:40:24.520 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:24.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:24.527 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:40:24.527 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:24.527 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:40:24.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:24.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:24.729 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:40:24.729 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ed0d0) skgpid ospid 6828 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:25.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:25.826 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:40:26.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:26.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:26.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:28.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:28.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:28.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:29.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c3002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:29.504 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:40:29.504 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:40:29.504 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:40:29.504 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:29.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c4002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:29.510 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:40:29.510 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:40:30.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:30.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:30.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:30.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:30.829 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:31.969 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:32.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c5002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:32.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:32.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:32.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:34.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:34.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:34.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:35.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:35.832 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:36.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:36.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:36.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:38.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:38.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:38.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:39.766 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:40:39.767 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:40:39.768 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:40:39.768 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(6977) version 11:1:1:4 [ CSSD]2013-05-23 14:40:39.774 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:40:39.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:39.774 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ed1a0, requested num -1 [ CSSD]2013-05-23 14:40:39.774 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:39.774 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:40:39.775 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:40:39.775 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:39.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:39.782 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:40:39.782 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:39.782 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:40:39.985 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:40:39.985 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid ospid 6977 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:40.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:40.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:40.834 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:40.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:40.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:42.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c6002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:42.212 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:42.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:42.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:42.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:44.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:44.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c7002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:44.768 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:40:44.768 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:40:44.768 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:40:44.768 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:44.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c8002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:44.775 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:40:44.776 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:40:44.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:44.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:45.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:45.837 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:46.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:46.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:46.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:48.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:48.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:48.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:49.412 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:40:49.413 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:40:49.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:40:49.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7084) version 11:1:1:4 [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ed1a0, requested num -1 [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:40:49.421 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:49.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:49.429 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:40:49.429 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:49.429 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:40:49.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:40:49.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid ospid 7084 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:50.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:50.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:50.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:50.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:50.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:52.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c9002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:52.237 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:40:52.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:53.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:53.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:53.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ca002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:53.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:40:53.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:40:53.238 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:40:53.238 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:53.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cb002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:53.245 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:40:53.245 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:40:53.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06cc002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:53.289 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:40:53.289 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:40:53.289 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:40:53.289 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:53.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cd002b) incarnation(174631051) [ CSSD]2013-05-23 14:40:53.297 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:40:53.297 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:40:54.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:55.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:55.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:55.029 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:40:55.030 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:40:55.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:40:55.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7125) version 11:1:1:4 [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ed1a0, requested num -1 [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:40:55.037 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:40:55.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:40:55.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:40:55.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:40:55.044 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:40:55.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:40:55.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid ospid 7125 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:40:55.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:40:55.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:40:56.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:57.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:57.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:40:58.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:40:59.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:40:59.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:00.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ce002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:00.021 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:00.021 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:00.021 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:41:00.021 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:00.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cf002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:00.028 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:00.028 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:00.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:00.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:00.846 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:01.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:01.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:02.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d0002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:02.260 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:02.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:03.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:03.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:04.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:05.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:05.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:05.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:05.849 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:06.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:07.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:07.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:08.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:09.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:09.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:10.280 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:41:10.280 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:41:10.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:41:10.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7269) version 11:1:1:4 [ CSSD]2013-05-23 14:41:10.297 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ed1a0, requested num -1 [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:41:10.298 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:10.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:10.304 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:41:10.304 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:10.304 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:41:10.507 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:41:10.507 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid ospid 7269 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:10.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:10.852 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:10.852 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:11.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:11.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:11.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d1002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:11.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:11.253 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:11.253 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:41:11.253 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:11.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d2002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:11.261 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:11.261 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:11.394 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:41:11.394 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:41:11.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:41:11.397 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:41:12.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d3002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:12.284 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:12.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:13.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:13.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:14.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:14.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:14.854 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:41:15.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:15.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:15.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d4002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:15.274 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:15.274 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:15.274 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:41:15.274 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:15.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d5002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:15.280 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:15.280 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:15.613 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:41:15.614 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:41:15.615 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:41:15.615 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7350/7350) version 11:1:1:4 [ CSSD]2013-05-23 14:41:15.621 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:41:15.621 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:15.621 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:41:15.621 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:41:15.639 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid 7350 ospid 7350 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:16.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:17.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:17.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:18.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:19.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:19.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:19.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:19.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:20.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:21.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:21.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:22.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d6002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:22.305 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:22.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:23.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:23.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:24.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:24.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:24.860 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:25.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:25.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:25.544 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:41:25.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:41:25.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:41:25.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7425) version 11:1:1:4 [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x26ed1a0, requested num -1 [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed320/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:41:25.553 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:25.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:25.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:41:25.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:25.560 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:41:25.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:41:25.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid ospid 7425 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:26.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:27.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:27.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:27.861 [1199044928] >TRACE: clssgmAllocProc: (0x26ce250) allocated [ CSSD]2013-05-23 14:41:27.862 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:41:27.863 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce250 - 1,2,3 [ CSSD]2013-05-23 14:41:27.863 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce250) pid(7399/7399) version 11:1:1:4 [ CSSD]2013-05-23 14:41:27.869 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(1/0x26ef0b0) [ CSSD]2013-05-23 14:41:27.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:41:27.869 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:41:27.869 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:41:28.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:29.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:29.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:29.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:29.863 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:30.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d7002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:30.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:30.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:30.523 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:41:30.524 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:30.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d8002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:30.532 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:30.532 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:30.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:31.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:31.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:32.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:32.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d9002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:32.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:33.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:33.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:34.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:34.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:34.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:35.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:35.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:36.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:37.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:37.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:38.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:38.868 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:41:38.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:39.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:39.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:40.810 [1199044928] >TRACE: clssgmAllocProc: (0x26ee140) allocated [ CSSD]2013-05-23 14:41:40.811 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:41:40.811 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee140 - 1,2,3 [ CSSD]2013-05-23 14:41:40.811 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce8a0) proc(0x26ee140) pid(7584) version 11:1:1:4 [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26ee140), client(1/0x26ce650) [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ce650) [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ce650 with con 0x26dddc0, requested num -1 [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de3e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:41:40.818 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:40.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ce650) [ CSSD]2013-05-23 14:41:40.825 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ce650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:41:40.825 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:40.825 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:41:40.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:41.028 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee140 [ CSSD]2013-05-23 14:41:41.028 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee140) con(0x26ce8a0) skgpid ospid 7584 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:41.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:41.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:42.353 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:42.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06da002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:42.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:43.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:43.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:43.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:43.871 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:44.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:45.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:45.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:45.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06db002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:45.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:45.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:45.775 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:41:45.775 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:45.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06dc002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:45.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:45.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:46.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:47.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:47.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:48.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:48.874 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:48.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:49.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:49.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:49.671 [1199044928] >TRACE: clssgmAllocProc: (0x26ee140) allocated [ CSSD]2013-05-23 14:41:49.672 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:41:49.672 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee140 - 1,2,3 [ CSSD]2013-05-23 14:41:49.672 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce8a0) proc(0x26ee140) pid(7687) version 11:1:1:4 [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26ee140), client(1/0x26ce650) [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ce650) [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ce650 with con 0x26dddc0, requested num -1 [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de3e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:41:49.679 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:49.685 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ce650) [ CSSD]2013-05-23 14:41:49.685 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ce650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:41:49.685 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:49.685 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:41:49.888 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee140 [ CSSD]2013-05-23 14:41:49.888 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee140) con(0x26ce8a0) skgpid ospid 7687 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:50.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:51.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:51.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:52.100 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x26eebf0), client(2/0x268fa20) [ CSSD]2013-05-23 14:41:52.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x268fa20) [ CSSD]2013-05-23 14:41:52.101 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:41:52.101 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:41:52.377 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:41:52.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06dd002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:53.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:53.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:53.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:53.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06de002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:53.546 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:41:53.546 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:41:53.546 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:41:53.546 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:53.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06df002b) incarnation(174631051) [ CSSD]2013-05-23 14:41:53.554 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:41:53.554 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:41:53.877 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:53.878 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:41:55.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:55.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:55.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:56.061 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:41:56.061 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:41:56.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:41:56.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce640) proc(0x26de070) pid(7734) version 11:1:1:4 [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de070), client(1/0x26de6c0) [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de6c0) [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de6c0 with con 0x26ddfa0, requested num -1 [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26de830/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:41:56.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:41:56.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de6c0) [ CSSD]2013-05-23 14:41:56.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de6c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:41:56.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26deb30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:41:56.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26deb30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:41:56.277 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:41:56.277 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26ce640) skgpid ospid 7734 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:41:57.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:57.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:57.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:41:57.880 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:41:57.880 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:41:59.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:41:59.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:41:59.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:01.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e0002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:01.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:01.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:01.027 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:01.027 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:01.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e1002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:01.034 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:01.035 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:01.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:01.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:01.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:02.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:02.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e2002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:02.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:02.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:03.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:03.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e3002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:03.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:03.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:03.198 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:03.199 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:03.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e4002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:03.205 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:03.205 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:03.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:03.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:05.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:05.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:05.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:07.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:07.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:07.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:07.878 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce250), client(2/0x26cea10) [ CSSD]2013-05-23 14:42:07.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26cea10) [ CSSD]2013-05-23 14:42:07.878 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:42:07.878 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:42:07.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:07.887 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:09.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:09.235 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:42:09.236 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:42:09.237 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:42:09.238 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:42:09.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e5002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:09.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:09.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:09.313 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:42:09.313 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:42:09.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e6002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:09.320 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:09.320 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:09.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:09.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:11.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:11.315 [1199044928] >TRACE: clssgmAllocProc: (0x26de670) allocated [ CSSD]2013-05-23 14:42:11.316 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:42:11.316 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de670 - 1,2,3 [ CSSD]2013-05-23 14:42:11.316 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ede60) proc(0x26de670) pid(7992) version 11:1:1:4 [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de670), client(1/0x26ded70) [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ded70) [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ded70 with con 0x26de5a0, requested num -1 [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:42:11.321 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:11.326 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ded70) [ CSSD]2013-05-23 14:42:11.326 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ded70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:42:11.326 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:11.326 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:42:11.524 [1199044928] >TRACE: clssgmAllocProc: (0x26b3b70) allocated [ CSSD]2013-05-23 14:42:11.525 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:42:11.526 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b3b70 - 1,2,3 [ CSSD]2013-05-23 14:42:11.526 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dee60) proc(0x26b3b70) pid(7965) version 11:1:1:4 [ CSSD]2013-05-23 14:42:11.529 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de670 [ CSSD]2013-05-23 14:42:11.529 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de670) con(0x26ede60) skgpid ospid 7992 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:11.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:11.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:12.421 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:12.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e7002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:12.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:12.889 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:13.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:13.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:13.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:14.237 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b3b70 [ CSSD]2013-05-23 14:42:14.237 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b3b70) con(0x26dee60) skgpid ospid 7965 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:15.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:15.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:15.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:16.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e8002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:16.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:16.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:16.281 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:16.281 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:16.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e9002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:16.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:16.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:17.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:17.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:17.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:17.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:17.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:19.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:19.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:19.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:21.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:21.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:21.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:21.894 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:21.894 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:42:22.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:22.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ea002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:23.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:23.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:23.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:25.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:25.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:25.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:26.572 [1199044928] >TRACE: clssgmAllocProc: (0x26de560) allocated [ CSSD]2013-05-23 14:42:26.573 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:42:26.574 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de560 - 1,2,3 [ CSSD]2013-05-23 14:42:26.574 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edd50) proc(0x26de560) pid(8415) version 11:1:1:4 [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de560), client(1/0x26dec60) [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dec60) [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dec60 with con 0x26de490, requested num -1 [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:42:26.580 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:26.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dec60) [ CSSD]2013-05-23 14:42:26.587 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dec60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:42:26.587 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dedd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:26.587 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dedd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:42:26.789 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de560 [ CSSD]2013-05-23 14:42:26.789 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de560) con(0x26edd50) skgpid ospid 8415 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:26.897 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:26.897 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:27.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:27.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:27.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:29.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:29.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:29.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:31.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:31.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06eb002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:31.532 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:31.532 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:31.532 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:31.532 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:31.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ec002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:31.539 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:31.539 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:31.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:31.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:31.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:31.900 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:32.465 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:32.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ed002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:33.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:33.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:33.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:35.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:35.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:35.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:36.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:36.903 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:37.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:37.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:37.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:39.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:39.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:39.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:41.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:41.825 [1199044928] >TRACE: clssgmAllocProc: (0x26de670) allocated [ CSSD]2013-05-23 14:42:41.826 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:42:41.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de670 - 1,2,3 [ CSSD]2013-05-23 14:42:41.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ede60) proc(0x26de670) pid(8569) version 11:1:1:4 [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de670), client(1/0x26ded70) [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ded70) [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ded70 with con 0x26de5a0, requested num -1 [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:42:41.833 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:41.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ded70) [ CSSD]2013-05-23 14:42:41.841 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ded70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:42:41.841 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:41.841 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:42:41.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:41.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:41.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:41.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:42.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de670 [ CSSD]2013-05-23 14:42:42.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de670) con(0x26ede60) skgpid ospid 8569 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:42.496 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:42.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ee002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:43.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:43.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:43.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:45.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:45.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:45.909 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:42:45.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:45.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:46.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ef002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:46.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:46.792 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:46.792 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:46.792 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:46.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f0002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:46.799 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:46.799 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:47.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:47.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2678b70) [ CSSD]2013-05-23 14:42:47.526 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2678b70), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:42:47.526 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2678b70), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:42:47.526 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268bcd0) [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268bcd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268bcd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bd80 [ CSSD]2013-05-23 14:42:47.533 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bd80) con(0x26cdda0) skgpid 2508 ospid 2508 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:47.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:47.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:49.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:49.939 [1199044928] >TRACE: clssgmAllocProc: (0x267b8d0) allocated [ CSSD]2013-05-23 14:42:49.941 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:42:49.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267b8d0 - 1,2,3 [ CSSD]2013-05-23 14:42:49.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed4b0) proc(0x267b8d0) pid(8690) version 11:1:1:4 [ CSSD]2013-05-23 14:42:49.947 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x267b8d0), client(1/0x2678b80) [ CSSD]2013-05-23 14:42:49.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:42:49.947 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678b80 with con 0x26ee290, requested num -1 [ CSSD]2013-05-23 14:42:49.947 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:49.947 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:42:49.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:42:49.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:49.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:49.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:49.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:42:49.955 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:42:49.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:49.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:42:50.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x267b8d0 [ CSSD]2013-05-23 14:42:50.158 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267b8d0) con(0x26ed4b0) skgpid ospid 8690 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:50.912 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:50.912 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:51.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:51.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:51.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:52.526 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:42:52.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f1002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:53.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:53.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f2002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:53.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:42:53.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:42:53.813 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:42:53.813 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:53.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f3002b) incarnation(174631051) [ CSSD]2013-05-23 14:42:53.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:42:53.820 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:42:53.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:53.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:55.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:55.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:42:55.915 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:42:55.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:55.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:57.075 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1e0) allocated [ CSSD]2013-05-23 14:42:57.076 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:42:57.076 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1e0 - 1,2,3 [ CSSD]2013-05-23 14:42:57.076 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678e60) proc(0x26ee1e0) pid(8762) version 11:1:1:4 [ CSSD]2013-05-23 14:42:57.083 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ee1e0), client(1/0x2678b80) [ CSSD]2013-05-23 14:42:57.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:42:57.083 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678b80 with con 0x26ed630, requested num -1 [ CSSD]2013-05-23 14:42:57.083 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:57.083 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:42:57.084 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:42:57.084 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:42:57.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:42:57.091 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:42:57.091 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267ba30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:42:57.091 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267ba30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:42:57.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1e0 [ CSSD]2013-05-23 14:42:57.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1e0) con(0x2678e60) skgpid ospid 8762 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:57.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ecce0) [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ecce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ecce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aade0 [ CSSD]2013-05-23 14:42:57.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aade0) con(0x267d670) skgpid 4600 ospid 4600 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:42:58.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:42:58.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:42:59.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:00.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:00.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:00.918 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:00.919 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:01.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:02.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f4002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:02.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:43:02.064 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:43:02.064 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:43:02.064 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:02.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f5002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:02.071 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:43:02.071 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:43:02.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:02.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:02.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:02.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f6002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:03.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:04.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:04.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:04.921 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:04.921 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:43:05.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:06.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:06.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:07.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:08.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:08.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:09.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:09.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:09.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:10.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:10.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:11.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:12.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:12.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:12.331 [1199044928] >TRACE: clssgmAllocProc: (0x26ed580) allocated [ CSSD]2013-05-23 14:43:12.332 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:43:12.332 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed580 - 1,2,3 [ CSSD]2013-05-23 14:43:12.332 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678e50) proc(0x26ed580) pid(8999) version 11:1:1:4 [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ed580), client(1/0x26ceab0) [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ceab0 with con 0x267d670, requested num -1 [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:12.349 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:12.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:12.356 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ceab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:43:12.356 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:12.356 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:12.559 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed580 [ CSSD]2013-05-23 14:43:12.559 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed580) con(0x2678e50) skgpid ospid 8999 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:12.576 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:12.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f7002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:13.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:14.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:14.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:14.927 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:14.927 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:15.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:16.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:16.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:17.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f8002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:17.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:43:17.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:43:17.314 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:43:17.314 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:17.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f9002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:17.322 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:43:17.322 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:43:17.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:18.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:18.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:19.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:19.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:19.931 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:20.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:20.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:21.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:22.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:22.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:22.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:22.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fa002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:23.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:23.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:23.933 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:43:24.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:24.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:25.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:26.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:26.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:27.602 [1199044928] >TRACE: clssgmAllocProc: (0x26ed580) allocated [ CSSD]2013-05-23 14:43:27.602 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:43:27.603 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed580 - 1,2,3 [ CSSD]2013-05-23 14:43:27.603 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678e50) proc(0x26ed580) pid(9171) version 11:1:1:4 [ CSSD]2013-05-23 14:43:27.609 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ed580), client(1/0x26ceab0) [ CSSD]2013-05-23 14:43:27.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:27.609 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ceab0 with con 0x267d670, requested num -1 [ CSSD]2013-05-23 14:43:27.609 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:27.609 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:43:27.610 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:27.610 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:27.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:27.616 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ceab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:43:27.616 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:27.616 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:27.819 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed580 [ CSSD]2013-05-23 14:43:27.819 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed580) con(0x2678e50) skgpid ospid 9171 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:27.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:28.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:28.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:28.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:28.936 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:29.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:30.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:30.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:31.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:32.393 [1199044928] >TRACE: clssgmAllocProc: (0x26ed580) allocated [ CSSD]2013-05-23 14:43:32.394 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:43:32.395 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed580 - 1,2,3 [ CSSD]2013-05-23 14:43:32.395 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d670) proc(0x26ed580) pid(9250) version 11:1:1:4 [ CSSD]2013-05-23 14:43:32.402 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ed580), client(1/0x2678b80) [ CSSD]2013-05-23 14:43:32.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:43:32.402 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2678b80 with con 0x26ee290, requested num -1 [ CSSD]2013-05-23 14:43:32.402 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:43:32.402 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cea0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:43:32.403 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:32.403 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:32.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:43:32.408 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:43:32.408 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ee110) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:43:32.408 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26ee110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:32.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:32.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:32.518 [1199044928] >TRACE: clssgmAllocProc: (0x26e1690) allocated [ CSSD]2013-05-23 14:43:32.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:43:32.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1690 - 1,2,3 [ CSSD]2013-05-23 14:43:32.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679140) proc(0x26e1690) pid(9255) version 11:1:1:4 [ CSSD]2013-05-23 14:43:32.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:43:32.537 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:43:32.539 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:43:32.540 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1690 [ CSSD]2013-05-23 14:43:32.540 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1690) con(0x2679140) skgpid ospid 9255 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:32.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06fb002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:32.566 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:43:32.566 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:43:32.566 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:43:32.566 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:32.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06fc002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:32.573 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:43:32.573 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:43:32.611 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed580 [ CSSD]2013-05-23 14:43:32.611 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed580) con(0x267d670) skgpid ospid 9250 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:32.617 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:32.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fd002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:33.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:33.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:34.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:34.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:34.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:36.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:36.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:36.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:38.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:38.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:38.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:38.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:38.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:40.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:40.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:40.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:41.334 [1199044928] >TRACE: clssgmAllocProc: (0x26a8f40) allocated [ CSSD]2013-05-23 14:43:41.335 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:43:41.336 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a8f40 - 1,2,3 [ CSSD]2013-05-23 14:43:41.336 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d660) proc(0x26a8f40) pid(9335) version 11:1:1:4 [ CSSD]2013-05-23 14:43:41.983 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a8f40 [ CSSD]2013-05-23 14:43:41.983 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a8f40) con(0x267d660) skgpid ospid 9335 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:42.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:42.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:42.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:42.637 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:42.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fe002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:42.864 [1199044928] >TRACE: clssgmAllocProc: (0x26ed580) allocated [ CSSD]2013-05-23 14:43:42.865 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:43:42.865 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed580 - 1,2,3 [ CSSD]2013-05-23 14:43:42.865 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678e50) proc(0x26ed580) pid(9487) version 11:1:1:4 [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ed580), client(1/0x26ceab0) [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ceab0 with con 0x267d670, requested num -1 [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:42.870 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:42.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:43:42.876 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ceab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:43:42.876 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:42.877 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:43.079 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed580 [ CSSD]2013-05-23 14:43:43.079 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed580) con(0x2678e50) skgpid ospid 9487 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:43.945 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:43.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:44.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:44.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:44.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:46.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:46.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:46.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:47.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ff002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:47.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:43:47.822 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:43:47.822 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:43:47.822 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:47.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0700002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:47.829 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:43:47.829 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:43:47.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:47.948 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:43:48.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:48.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:48.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:50.202 [1199044928] >TRACE: clssgmAllocProc: (0x26ed580) allocated [ CSSD]2013-05-23 14:43:50.203 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:43:50.203 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed580 - 1,2,3 [ CSSD]2013-05-23 14:43:50.203 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed250) proc(0x26ed580) pid(9605) version 11:1:1:4 [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ed580), client(1/0x2678b80) [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678b80 with con 0x267d670, requested num -1 [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:50.209 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:50.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678b80) [ CSSD]2013-05-23 14:43:50.215 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:43:50.215 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:50.215 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:50.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:50.417 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed580 [ CSSD]2013-05-23 14:43:50.417 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed580) con(0x26ed250) skgpid ospid 9605 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:50.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:50.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678c20) [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678c20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678c20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678730 [ CSSD]2013-05-23 14:43:51.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678730) con(0x267c0c0) skgpid 3250 ospid 3250 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:52.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2679210) [ CSSD]2013-05-23 14:43:52.016 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2679210), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:43:52.016 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2679210), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:43:52.016 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26790a0) [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26790a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26790a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690fe0 [ CSSD]2013-05-23 14:43:52.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690fe0) con(0x2690120) skgpid 3254 ospid 3254 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:52.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:52.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:52.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:52.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:43:52.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0701002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:52.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:52.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:54.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0702002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:54.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:43:54.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:43:54.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:43:54.063 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:54.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0703002b) incarnation(174631051) [ CSSD]2013-05-23 14:43:54.071 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:43:54.071 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:43:54.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:54.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:54.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:56.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:56.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:56.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:43:57.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:43:57.954 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:43:58.110 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1a0) allocated [ CSSD]2013-05-23 14:43:58.111 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:43:58.111 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1a0 - 1,2,3 [ CSSD]2013-05-23 14:43:58.111 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd6b0) proc(0x26ee1a0) pid(9671) version 11:1:1:4 [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26ee1a0), client(1/0x26ee2d0) [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x267d590, requested num -1 [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e15e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:43:58.118 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:43:58.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 14:43:58.125 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:43:58.125 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e18e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:43:58.125 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e18e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:43:58.328 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1a0 [ CSSD]2013-05-23 14:43:58.328 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1a0) con(0x26cd6b0) skgpid ospid 9671 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:43:58.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:43:58.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:43:58.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:00.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:00.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:00.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:02.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:02.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:02.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:02.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:02.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0704002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:02.957 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:02.957 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:03.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0705002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:03.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:44:03.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:44:03.073 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:44:03.073 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:03.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0706002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:03.080 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:44:03.080 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:44:04.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:04.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:04.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:06.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:06.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:06.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:07.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:07.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:08.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:08.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:08.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:10.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:10.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:10.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:11.864 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1a0) allocated [ CSSD]2013-05-23 14:44:11.865 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:44:11.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1a0 - 1,2,3 [ CSSD]2013-05-23 14:44:11.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd6b0) proc(0x26ee1a0) pid(8673/8673) version 11:1:1:4 [ CSSD]2013-05-23 14:44:11.882 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26ee1a0), client(1/0x26ee2d0) [ CSSD]2013-05-23 14:44:11.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 14:44:11.882 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:44:11.882 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 14:44:12.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:12.738 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:12.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0707002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:12.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:12.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:12.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:12.963 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:13.361 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:13.362 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:44:13.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:13.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(9857) version 11:1:1:4 [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ecdb0), client(1/0x26ceab0) [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ceab0 with con 0x26ecd00, requested num -1 [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c2c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:13.369 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:13.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:44:13.376 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ceab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:44:13.376 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:13.376 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:13.579 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:44:13.579 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid ospid 9857 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:14.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:14.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:14.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:16.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:16.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:16.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:17.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:17.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:18.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0708002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:18.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:44:18.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:44:18.342 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:44:18.342 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:18.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0709002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:18.349 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:44:18.349 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:44:18.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:18.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:18.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:19.022 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:19.023 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:44:19.023 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:19.024 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(9940) version 11:1:1:4 [ CSSD]2013-05-23 14:44:19.145 [1199044928] >TRACE: clssgmAllocProc: (0x268fb90) allocated [ CSSD]2013-05-23 14:44:19.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:44:19.147 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268fb90 - 1,2,3 [ CSSD]2013-05-23 14:44:19.147 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c300) proc(0x268fb90) pid(9950) version 11:1:1:4 [ CSSD]2013-05-23 14:44:19.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:44:19.166 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:44:19.169 [1199044928] >TRACE: clssgmDeadProc: proc 0x268fb90 [ CSSD]2013-05-23 14:44:19.169 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268fb90) con(0x267c300) skgpid ospid 9950 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5325/0x26ceab0) [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5325 (0x26ceab0) [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26ceab0 with con 0x26ecb80, requested num -1 [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x267bfa0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:19.245 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:44:19.251 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5325 (0x26ceab0) [ CSSD]2013-05-23 14:44:19.251 [1199044928] >TRACE: clssgmExitGrock: client 5325 (0x26ceab0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:44:19.251 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e170) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:44:19.251 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x269e170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:19.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:44:19.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid ospid 9940 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:20.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:20.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:20.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:22.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:22.758 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:22.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070a002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:22.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:22.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:22.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:22.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:24.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:24.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:24.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:26.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:26.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:26.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:27.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:27.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:28.618 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:28.619 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:44:28.619 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:28.619 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(10021) version 11:1:1:4 [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ecdb0), client(1/0x26ceab0) [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ceab0 with con 0x26ecd00, requested num -1 [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c2c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:28.627 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:28.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:44:28.634 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ceab0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:44:28.634 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:28.634 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:28.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:28.837 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:44:28.837 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid ospid 10021 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:28.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:28.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:30.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:30.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:30.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:31.974 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:31.974 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:44:32.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:32.780 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:32.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070b002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:32.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:32.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:33.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(070c002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:33.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:44:33.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:44:33.593 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:44:33.593 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:33.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(070d002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:33.601 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:44:33.601 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:44:34.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:34.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:34.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:36.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:36.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:36.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:36.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:36.977 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:38.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:38.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:38.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:40.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:40.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:40.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:41.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:41.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:42.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:42.800 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:42.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070e002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:42.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:42.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:43.870 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:43.871 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:44:43.872 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:43.872 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(10204) version 11:1:1:4 [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ecdb0), client(1/0x26e13a0) [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e13a0 with con 0x26ecd00, requested num -1 [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c2c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:43.878 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:43.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:44:43.885 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e13a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:44:43.885 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:43.885 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:44.088 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:44:44.088 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid ospid 10204 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:44.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:45.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:45.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:46.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:46.983 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:46.983 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:47.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:47.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:48.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(070f002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:48.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:44:48.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:44:48.844 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:44:48.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:48.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0710002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:48.852 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:44:48.852 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:44:48.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:49.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:49.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:50.461 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:50.461 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:44:50.462 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:50.462 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(10282) version 11:1:1:4 [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ecdb0), client(1/0x26e13a0) [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e13a0 with con 0x26ecd00, requested num -1 [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c2c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:50.469 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:50.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:44:50.475 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e13a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:44:50.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:50.476 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:50.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:44:50.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid ospid 10282 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:44:50.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:51.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:51.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:51.986 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:51.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:52.819 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:44:52.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0711002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:52.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:53.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:53.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:54.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0712002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:54.331 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:44:54.331 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:44:54.331 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:44:54.331 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:54.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0713002b) incarnation(174631051) [ CSSD]2013-05-23 14:44:54.337 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:44:54.337 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:44:54.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:55.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:55.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:56.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:56.989 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:44:56.989 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:44:57.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:57.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:57.663 [1199044928] >TRACE: clssgmAllocProc: (0x26ecdb0) allocated [ CSSD]2013-05-23 14:44:57.663 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:44:57.664 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecdb0 - 1,2,3 [ CSSD]2013-05-23 14:44:57.664 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ecdb0) pid(10339/10339) version 11:1:1:4 [ CSSD]2013-05-23 14:44:57.681 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ecdb0), client(1/0x26ceab0) [ CSSD]2013-05-23 14:44:57.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:44:57.681 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:44:57.681 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:44:58.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:44:59.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:44:59.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:44:59.120 [1199044928] >TRACE: clssgmAllocProc: (0x2678d70) allocated [ CSSD]2013-05-23 14:44:59.121 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:44:59.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678d70 - 1,2,3 [ CSSD]2013-05-23 14:44:59.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ecd00) proc(0x2678d70) pid(10356) version 11:1:1:4 [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678d70), client(1/0x269ec40) [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2678cb0, requested num -1 [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26907f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:44:59.138 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:44:59.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:44:59.145 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:44:59.145 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690af0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:44:59.145 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:44:59.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678d70 [ CSSD]2013-05-23 14:44:59.347 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678d70) con(0x26ecd00) skgpid ospid 10356 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:00.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:01.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:01.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:01.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:01.992 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:02.839 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:02.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0714002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:02.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:03.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:03.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:04.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0715002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:04.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:45:04.110 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:45:04.110 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:45:04.110 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:04.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0716002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:04.119 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:45:04.119 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:45:04.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:05.123 [1199044928] >TRACE: clssgmAllocProc: (0x2678ec0) allocated [ CSSD]2013-05-23 14:45:05.124 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:45:05.125 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678ec0 - 1,2,3 [ CSSD]2013-05-23 14:45:05.125 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e320) proc(0x2678ec0) pid(10454/10454) version 11:1:1:4 [ CSSD]2013-05-23 14:45:05.131 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678ec0), client(1/0x267c080) [ CSSD]2013-05-23 14:45:05.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c080) [ CSSD]2013-05-23 14:45:05.131 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:45:05.131 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:45:05.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:05.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c080) [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c080), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c080), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678ec0 [ CSSD]2013-05-23 14:45:05.414 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678ec0) con(0x269e320) skgpid 10454 ospid 10454 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:06.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:06.995 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:07.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:07.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:07.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:09.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:09.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:09.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:11.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:11.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:11.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:11.570 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26ee1a0), client(2/0x267c080) [ CSSD]2013-05-23 14:45:11.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x267c080) [ CSSD]2013-05-23 14:45:11.570 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:45:11.570 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:45:11.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:11.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:12.860 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:12.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0717002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:13.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:13.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:13.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:14.383 [1199044928] >TRACE: clssgmAllocProc: (0x26904e0) allocated [ CSSD]2013-05-23 14:45:14.384 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:45:14.384 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26904e0 - 1,2,3 [ CSSD]2013-05-23 14:45:14.384 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e170) proc(0x26904e0) pid(10521) version 11:1:1:4 [ CSSD]2013-05-23 14:45:14.390 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26904e0), client(1/0x267c440) [ CSSD]2013-05-23 14:45:14.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 14:45:14.390 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x26790d0, requested num -1 [ CSSD]2013-05-23 14:45:14.390 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:14.390 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2690c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:45:14.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:45:14.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:14.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 14:45:14.397 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:45:14.397 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:14.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:45:14.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x26904e0 [ CSSD]2013-05-23 14:45:14.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26904e0) con(0x269e170) skgpid ospid 10521 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:15.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:15.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:15.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:16.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:16.000 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:45:17.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:17.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:17.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:19.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:19.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:19.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:19.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0718002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:19.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:45:19.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:45:19.362 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:45:19.362 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:19.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0719002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:19.369 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:45:19.369 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:45:21.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:21.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:21.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:21.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:21.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:22.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:22.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071a002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:23.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:23.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:23.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:25.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:25.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:25.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:26.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:26.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:27.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:27.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:27.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:27.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ceab0) [ CSSD]2013-05-23 14:45:27.736 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ceab0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:45:27.736 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ceab0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:45:27.736 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:45:27.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecdb0 [ CSSD]2013-05-23 14:45:27.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecdb0) con(0x267d590) skgpid 10339 ospid 10339 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:29.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:29.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:29.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:29.638 [1199044928] >TRACE: clssgmAllocProc: (0x26ec800) allocated [ CSSD]2013-05-23 14:45:29.639 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:45:29.640 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ec800 - 1,2,3 [ CSSD]2013-05-23 14:45:29.640 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ec800) pid(10681) version 11:1:1:4 [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ec800), client(1/0x26e13a0) [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e13a0 with con 0x267be40, requested num -1 [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269e470/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:45:29.647 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:29.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:45:29.655 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e13a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:45:29.655 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ecbc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:29.655 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ecbc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:45:29.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ec800 [ CSSD]2013-05-23 14:45:29.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ec800) con(0x267d590) skgpid ospid 10681 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:31.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:31.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:31.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:31.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:31.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:32.910 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:32.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071b002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:33.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:33.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:33.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:34.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(071c002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:34.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:45:34.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:45:34.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:45:34.611 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:34.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(071d002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:34.618 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:45:34.618 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:45:34.786 [1199044928] >TRACE: clssgmAllocProc: (0x26ec800) allocated [ CSSD]2013-05-23 14:45:34.786 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:45:34.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ec800 - 1,2,3 [ CSSD]2013-05-23 14:45:34.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26ec800) pid(10605/10605) version 11:1:1:4 [ CSSD]2013-05-23 14:45:34.793 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ec800), client(1/0x26e13a0) [ CSSD]2013-05-23 14:45:34.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:45:34.793 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:45:34.793 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:45:35.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:35.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:35.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:35.940 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ec800), client(2/0x26ceab0) [ CSSD]2013-05-23 14:45:35.940 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ceab0) [ CSSD]2013-05-23 14:45:35.940 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:45:35.940 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:45:36.012 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:36.012 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:37.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:37.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:37.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:39.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:39.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:39.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:40.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:40.015 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:45:41.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:41.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:41.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:42.931 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:42.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071e002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:43.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:43.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:43.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:44.896 [1199044928] >TRACE: clssgmAllocProc: (0x26909d0) allocated [ CSSD]2013-05-23 14:45:44.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:45:44.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26909d0 - 1,2,3 [ CSSD]2013-05-23 14:45:44.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x26909d0) pid(10829) version 11:1:1:4 [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26909d0), client(1/0x269ec40) [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699e40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:45:44.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:44.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:45:44.913 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:45:44.913 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:44.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:45:45.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:45.018 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:45.116 [1199044928] >TRACE: clssgmDeadProc: proc 0x26909d0 [ CSSD]2013-05-23 14:45:45.116 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26909d0) con(0x269e6c0) skgpid ospid 10829 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:45.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:45.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:45.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:47.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:47.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:47.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:49.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:49.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:49.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:49.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(071f002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:49.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:45:49.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:45:49.862 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:45:49.862 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:49.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0720002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:49.869 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:45:49.869 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:45:50.020 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:50.021 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:50.720 [1199044928] >TRACE: clssgmAllocProc: (0x2690a30) allocated [ CSSD]2013-05-23 14:45:50.721 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:45:50.722 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690a30 - 1,2,3 [ CSSD]2013-05-23 14:45:50.722 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x2690a30) pid(10912) version 11:1:1:4 [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690a30), client(1/0x269ec40) [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699fb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:45:50.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:50.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:45:50.735 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:45:50.735 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:45:50.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:45:50.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690a30 [ CSSD]2013-05-23 14:45:50.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690a30) con(0x269e6c0) skgpid ospid 10912 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:45:51.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:51.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:51.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:52.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:45:52.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0721002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:53.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:53.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:53.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:54.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0722002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:54.581 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:45:54.581 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:45:54.581 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:45:54.581 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:45:54.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0723002b) incarnation(174631051) [ CSSD]2013-05-23 14:45:54.588 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:45:54.588 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:45:55.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:45:55.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:45:55.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:55.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:55.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:57.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:57.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:57.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:45:59.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:45:59.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:45:59.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:00.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:00.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:00.151 [1199044928] >TRACE: clssgmAllocProc: (0x26909d0) allocated [ CSSD]2013-05-23 14:46:00.152 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:46:00.152 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26909d0 - 1,2,3 [ CSSD]2013-05-23 14:46:00.152 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x26909d0) pid(11006) version 11:1:1:4 [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26909d0), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699e40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:46:00.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:00.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:00.167 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:46:00.167 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:00.167 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:46:00.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x26909d0 [ CSSD]2013-05-23 14:46:00.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26909d0) con(0x269e6c0) skgpid ospid 11006 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:01.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:01.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:01.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:02.981 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:03.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0724002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:03.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:03.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:03.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:04.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:04.029 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:46:05.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0725002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:05.122 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:05.122 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:05.122 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:46:05.122 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:05.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0726002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:05.129 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:05.129 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:05.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:05.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:05.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:07.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:07.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:07.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:09.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:09.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:09.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:09.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:09.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:11.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0727002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:11.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:11.553 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:11.553 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:46:11.553 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:11.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0728002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:11.560 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:11.560 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:11.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:46:11.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:46:11.689 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:46:11.689 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:46:11.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:11.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:11.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:13.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:13.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0729002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:13.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:13.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:13.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:14.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:14.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:15.405 [1199044928] >TRACE: clssgmAllocProc: (0x2690a30) allocated [ CSSD]2013-05-23 14:46:15.406 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:46:15.407 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690a30 - 1,2,3 [ CSSD]2013-05-23 14:46:15.407 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x2690a30) pid(11152) version 11:1:1:4 [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690a30), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699fb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:46:15.413 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:15.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:15.421 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:46:15.421 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:15.421 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:46:15.623 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690a30 [ CSSD]2013-05-23 14:46:15.623 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690a30) con(0x269e6c0) skgpid ospid 11152 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:15.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:15.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:15.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:16.109 [1199044928] >TRACE: clssgmAllocProc: (0x2690a30) allocated [ CSSD]2013-05-23 14:46:16.109 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:46:16.110 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690a30 - 1,2,3 [ CSSD]2013-05-23 14:46:16.110 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x2690a30) pid(11201/11201) version 11:1:1:4 [ CSSD]2013-05-23 14:46:16.116 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690a30), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:16.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:16.116 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:46:16.116 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:46:16.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:16.135 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269ec40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:46:16.135 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269ec40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:46:16.135 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:46:16.136 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690a30 [ CSSD]2013-05-23 14:46:16.136 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690a30) con(0x269e6c0) skgpid 11201 ospid 11201 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:17.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:17.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:17.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:19.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:19.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:19.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:19.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:19.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:20.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072a002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:20.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:20.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:20.385 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:46:20.385 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:20.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072b002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:20.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:20.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:21.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:21.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:21.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:23.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:23.040 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:23.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:46:23.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072c002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:23.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:23.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:23.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:25.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:25.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:25.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:27.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:27.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:27.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:28.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:28.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:29.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:29.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:29.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:30.656 [1199044928] >TRACE: clssgmAllocProc: (0x2690aa0) allocated [ CSSD]2013-05-23 14:46:30.657 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:46:30.658 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690aa0 - 1,2,3 [ CSSD]2013-05-23 14:46:30.658 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2677ec0) proc(0x2690aa0) pid(11335) version 11:1:1:4 [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690aa0), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x26909e0, requested num -1 [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699fb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:46:30.663 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:30.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:30.670 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:46:30.670 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:30.670 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:46:30.872 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690aa0 [ CSSD]2013-05-23 14:46:30.872 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690aa0) con(0x2677ec0) skgpid ospid 11335 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:31.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:31.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:31.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:33.043 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:33.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:33.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:33.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072d002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:33.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:33.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:33.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:35.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072e002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:35.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:35.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:35.646 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:46:35.646 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:35.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072f002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:35.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:35.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:36.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:36.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:36.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:38.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:38.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:38.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:38.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:38.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:40.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:40.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:40.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:42.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:42.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:42.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:43.053 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:43.053 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:43.092 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:43.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0730002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:44.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:44.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:44.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:45.906 [1199044928] >TRACE: clssgmAllocProc: (0x2690b00) allocated [ CSSD]2013-05-23 14:46:45.906 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:46:45.907 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690b00 - 1,2,3 [ CSSD]2013-05-23 14:46:45.907 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2677ec0) proc(0x2690b00) pid(11484) version 11:1:1:4 [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2690b00), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x26909e0, requested num -1 [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699fb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:46:45.913 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:45.920 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:45.920 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:46:45.920 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a2b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:45.920 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a2b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:46:46.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:46.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:46.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:46.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690b00 [ CSSD]2013-05-23 14:46:46.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690b00) con(0x2677ec0) skgpid ospid 11484 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:48.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:48.056 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:48.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:48.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:48.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:50.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:50.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:50.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:50.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0731002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:50.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:50.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:50.897 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:46:50.897 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:50.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0732002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:50.905 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:50.905 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:50.975 [1199044928] >TRACE: clssgmAllocProc: (0x26909d0) allocated [ CSSD]2013-05-23 14:46:50.976 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:46:50.976 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26909d0 - 1,2,3 [ CSSD]2013-05-23 14:46:50.976 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269e6c0) proc(0x26909d0) pid(11566) version 11:1:1:4 [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26909d0), client(1/0x269ec40) [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec40 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699e40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:46:50.983 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:50.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec40) [ CSSD]2013-05-23 14:46:50.990 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:46:50.990 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:46:50.990 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:46:51.193 [1199044928] >TRACE: clssgmDeadProc: proc 0x26909d0 [ CSSD]2013-05-23 14:46:51.193 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26909d0) con(0x269e6c0) skgpid ospid 11566 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:46:52.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:52.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:52.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:53.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:53.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:53.112 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:46:53.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0733002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:53.268 [1199044928] >TRACE: clssgmAllocProc: (0x26909d0) allocated [ CSSD]2013-05-23 14:46:53.269 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:46:53.270 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26909d0 - 1,2,3 [ CSSD]2013-05-23 14:46:53.270 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2677de0) proc(0x26909d0) pid(11268/11268) version 11:1:1:4 [ CSSD]2013-05-23 14:46:53.286 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26909d0), client(1/0x269e550) [ CSSD]2013-05-23 14:46:53.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269e550) [ CSSD]2013-05-23 14:46:53.286 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:46:53.286 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:46:54.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:54.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:54.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:54.371 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26909d0), client(2/0x26ecc40) [ CSSD]2013-05-23 14:46:54.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ecc40) [ CSSD]2013-05-23 14:46:54.371 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:46:54.371 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 14:46:54.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0734002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:54.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:46:54.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:46:54.844 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:46:54.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:46:54.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0735002b) incarnation(174631051) [ CSSD]2013-05-23 14:46:54.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:46:54.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:46:56.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:56.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:56.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:46:57.751 [1199044928] >TRACE: clssgmAllocProc: (0x26aa1a0) allocated [ CSSD]2013-05-23 14:46:57.751 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:46:57.752 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aa1a0 - 1,2,3 [ CSSD]2013-05-23 14:46:57.752 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a7a0) proc(0x26aa1a0) pid(11619/11619) version 11:1:1:4 [ CSSD]2013-05-23 14:46:57.768 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26aa1a0), client(1/0x2691090) [ CSSD]2013-05-23 14:46:57.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:46:57.768 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:46:57.768 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:46:58.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:46:58.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:46:58.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:46:58.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:46:58.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:00.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:00.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:00.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:01.156 [1199044928] >TRACE: clssgmAllocProc: (0x26deb10) allocated [ CSSD]2013-05-23 14:47:01.156 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:47:01.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26deb10 - 1,2,3 [ CSSD]2013-05-23 14:47:01.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc850) proc(0x26deb10) pid(11648) version 11:1:1:4 [ CSSD]2013-05-23 14:47:01.163 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26deb10), client(1/0x267fd50) [ CSSD]2013-05-23 14:47:01.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fd50) [ CSSD]2013-05-23 14:47:01.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fd50 with con 0x26de8c0, requested num -1 [ CSSD]2013-05-23 14:47:01.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:01.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fec0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:01.164 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:01.164 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:01.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fd50) [ CSSD]2013-05-23 14:47:01.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:01.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26deed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:01.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26deed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:01.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x26deb10 [ CSSD]2013-05-23 14:47:01.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26deb10) con(0x26dc850) skgpid ospid 11648 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:02.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:02.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:02.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:03.065 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:03.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:03.143 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:03.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0736002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:04.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:04.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:04.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:06.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0737002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:06.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:06.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:06.153 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:47:06.153 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:06.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0738002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:06.159 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:06.159 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:06.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:06.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:06.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:08.069 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:08.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:08.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:08.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:08.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:08.806 [1199044928] >TRACE: clssgmAllocProc: (0x26deb10) allocated [ CSSD]2013-05-23 14:47:08.807 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:47:08.807 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26deb10 - 1,2,3 [ CSSD]2013-05-23 14:47:08.807 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc850) proc(0x26deb10) pid(11755) version 11:1:1:4 [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26deb10), client(1/0x267fd50) [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fd50) [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fd50 with con 0x26de8c0, requested num -1 [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fec0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:08.813 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:08.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fd50) [ CSSD]2013-05-23 14:47:08.819 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:08.819 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26deed0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:08.819 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26deed0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:09.022 [1199044928] >TRACE: clssgmDeadProc: proc 0x26deb10 [ CSSD]2013-05-23 14:47:09.022 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26deb10) con(0x26dc850) skgpid ospid 11755 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:09.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:47:09.553 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:47:09.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:47:09.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:47:09.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0739002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:09.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:09.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:09.633 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:47:09.633 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:47:09.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073a002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:09.640 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:09.640 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:10.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:10.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:10.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:10.888 [1199044928] >TRACE: clssgmAllocProc: (0x26deb70) allocated [ CSSD]2013-05-23 14:47:10.889 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:47:10.889 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26deb70 - 1,2,3 [ CSSD]2013-05-23 14:47:10.889 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc850) proc(0x26deb70) pid(11827) version 11:1:1:4 [ CSSD]2013-05-23 14:47:12.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:12.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:12.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:13.072 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:13.072 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:13.173 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:13.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073b002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:13.763 [1199044928] >TRACE: clssgmDeadProc: proc 0x26deb70 [ CSSD]2013-05-23 14:47:13.763 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26deb70) con(0x26dc850) skgpid ospid 11827 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:14.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:14.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:14.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:16.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:16.415 [1199044928] >TRACE: clssgmAllocProc: (0x26debd0) allocated [ CSSD]2013-05-23 14:47:16.416 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:47:16.417 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26debd0 - 1,2,3 [ CSSD]2013-05-23 14:47:16.417 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc910) proc(0x26debd0) pid(12167) version 11:1:1:4 [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26debd0), client(1/0x267fe10) [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fe10) [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fe10 with con 0x26deb00, requested num -1 [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267ff80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:16.423 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:16.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:16.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:16.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fe10) [ CSSD]2013-05-23 14:47:16.429 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fe10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:16.429 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:16.429 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:16.632 [1199044928] >TRACE: clssgmDeadProc: proc 0x26debd0 [ CSSD]2013-05-23 14:47:16.632 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26debd0) con(0x26dc910) skgpid ospid 12167 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:18.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:18.076 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:18.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:18.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:18.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:20.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:20.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:20.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:21.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(073c002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:21.421 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:21.421 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:21.421 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:47:21.421 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:21.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073d002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:21.427 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:21.427 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:22.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:22.079 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:47:22.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:22.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:22.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:23.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:23.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073e002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:24.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:24.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:24.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:26.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:26.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:26.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:27.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:27.082 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:28.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:28.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:28.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2691090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2691090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aa1a0 [ CSSD]2013-05-23 14:47:28.867 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aa1a0) con(0x269a7a0) skgpid 11619 ospid 11619 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:30.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:30.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:30.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:31.666 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:47:31.667 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:47:31.667 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:47:31.668 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699d70) proc(0x269b5b0) pid(12327) version 11:1:1:4 [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x2691090) [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2691090 with con 0x269a090, requested num -1 [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:31.674 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:31.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:31.681 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2691090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:31.681 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaa70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:31.681 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaa70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:31.883 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:47:31.883 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x2699d70) skgpid ospid 12327 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:32.085 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:32.085 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:32.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:32.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:32.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:33.213 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:33.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073f002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:34.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:34.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:34.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:36.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:36.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:36.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:36.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0740002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:36.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:36.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:36.669 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:47:36.669 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:36.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0741002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:36.675 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:36.675 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:37.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:37.089 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:38.296 [1199044928] >TRACE: clssgmAllocProc: (0x269b590) allocated [ CSSD]2013-05-23 14:47:38.297 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:47:38.297 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b590 - 1,2,3 [ CSSD]2013-05-23 14:47:38.297 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a6d0) proc(0x269b590) pid(12414) version 11:1:1:4 [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b590), client(1/0x2691090) [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2691090 with con 0x269b4d0, requested num -1 [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa8c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:38.303 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:38.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:38.310 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2691090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:38.310 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aabc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:38.310 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aabc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:38.512 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b590 [ CSSD]2013-05-23 14:47:38.512 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b590) con(0x269a6d0) skgpid ospid 12414 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:38.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:38.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:38.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:40.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:40.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:40.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:41.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:41.092 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:47:42.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:42.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:42.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:43.234 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:43.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0742002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:44.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:44.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:44.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:46.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:46.095 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:46.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:46.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:46.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:46.916 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:47:46.917 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:47:46.917 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:47:46.917 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699d70) proc(0x269b5b0) pid(12477) version 11:1:1:4 [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x2691090) [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2691090 with con 0x269a090, requested num -1 [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:46.935 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:46.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:46.942 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2691090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:46.942 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaa70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:46.942 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaa70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:47.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:47:47.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x2699d70) skgpid ospid 12477 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:47.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cda40) [ CSSD]2013-05-23 14:47:47.605 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cda40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:47:47.605 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cda40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:47:47.605 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:47:47.606 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:47:47.606 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26a67c0) skgpid 6780 ospid 6780 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:48.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:48.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:48.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:50.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:50.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:50.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:51.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:51.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:51.238 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:47:51.238 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:47:51.239 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:47:51.239 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(12548) version 11:1:1:4 [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f0d0), client(1/0x2691090) [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2691090 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:47:51.245 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:51.251 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:51.251 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2691090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:47:51.251 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:47:51.251 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:47:51.454 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:47:51.454 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid ospid 12548 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:47:51.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0743002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:51.918 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:51.918 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:51.918 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:47:51.918 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:51.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0744002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:51.924 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:51.924 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:52.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:52.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:52.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:53.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:47:53.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0745002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:54.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:54.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:54.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:55.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0746002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:55.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:47:55.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:47:55.107 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:47:55.107 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:47:55.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0747002b) incarnation(174631051) [ CSSD]2013-05-23 14:47:55.113 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:47:55.113 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:47:56.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:47:56.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:47:56.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:56.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:56.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:47:57.816 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:47:57.817 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:47:57.817 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:47:57.817 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(12595/12595) version 11:1:1:4 [ CSSD]2013-05-23 14:47:57.823 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f0d0), client(1/0x2691090) [ CSSD]2013-05-23 14:47:57.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:47:57.823 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:47:57.823 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:47:58.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:47:58.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:47:58.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:00.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:00.105 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:48:00.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:00.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:00.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:02.177 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:48:02.178 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:48:02.179 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:48:02.179 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b5b0) pid(12630) version 11:1:1:4 [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x26aa700) [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa700) [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa700 with con 0x269b4f0, requested num -1 [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa870/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:02.185 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:02.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa700) [ CSSD]2013-05-23 14:48:02.192 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa700), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:48:02.192 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aab70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:02.192 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aab70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:02.394 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:48:02.394 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x26cda30) skgpid ospid 12630 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:02.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:02.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:02.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:03.284 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:03.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0748002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:04.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:04.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:04.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:05.108 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:05.108 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:06.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:06.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:06.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:07.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0749002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:07.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:48:07.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:48:07.165 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:48:07.165 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:07.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(074a002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:07.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:48:07.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:48:08.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:08.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:08.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:10.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:10.111 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:10.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:10.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:10.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:12.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:12.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:12.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:13.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:13.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074b002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:14.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:14.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:14.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:15.114 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:15.114 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:16.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:16.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:16.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:17.427 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:48:17.428 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:48:17.429 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:48:17.429 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b5b0) pid(12802) version 11:1:1:4 [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x269a0a0) [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269a0a0 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:17.436 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:17.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:17.443 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269a0a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:48:17.443 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaa70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:17.443 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaa70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:17.645 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:48:17.645 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x26cda30) skgpid ospid 12802 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:18.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:18.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:18.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:20.117 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:20.117 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:20.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:20.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:20.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:22.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(074c002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:22.412 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:48:22.412 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:48:22.412 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:48:22.412 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:22.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(074d002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:22.418 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:48:22.418 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:48:22.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:23.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:23.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:23.345 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:23.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074e002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:24.120 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:24.120 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:48:25.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:25.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:25.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:27.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:27.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:27.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:28.303 [1199044928] >TRACE: clssgmAllocProc: (0x269b610) allocated [ CSSD]2013-05-23 14:48:28.304 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:28.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b610 - 1,2,3 [ CSSD]2013-05-23 14:48:28.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b610) pid(12910/12910) version 11:1:1:4 [ CSSD]2013-05-23 14:48:28.320 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b610), client(1/0x269a0a0) [ CSSD]2013-05-23 14:48:28.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:28.320 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:48:28.320 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269a0a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269a0a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b610 [ CSSD]2013-05-23 14:48:28.353 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b610) con(0x26cda30) skgpid 12910 ospid 12910 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:28.538 [1199044928] >TRACE: clssgmAllocProc: (0x269b610) allocated [ CSSD]2013-05-23 14:48:28.538 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:28.539 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b610 - 1,2,3 [ CSSD]2013-05-23 14:48:28.539 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x269b610) pid(12919/12919) version 11:1:1:4 [ CSSD]2013-05-23 14:48:28.556 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b610), client(1/0x269a0a0) [ CSSD]2013-05-23 14:48:28.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:28.556 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:48:28.556 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269a0a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269a0a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b610 [ CSSD]2013-05-23 14:48:28.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b610) con(0x26a67c0) skgpid 12919 ospid 12919 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:29.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:29.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:29.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:29.123 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:29.123 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:31.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:31.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:31.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:32.690 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:48:32.691 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:48:32.692 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:48:32.692 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b5b0) pid(12950) version 11:1:1:4 [ CSSD]2013-05-23 14:48:32.695 [1199044928] >TRACE: clssgmAllocProc: (0x26de670) allocated [ CSSD]2013-05-23 14:48:32.696 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:32.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de670 - 1,2,3 [ CSSD]2013-05-23 14:48:32.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa800) proc(0x26de670) pid(12951) version 11:1:1:4 [ CSSD]2013-05-23 14:48:32.697 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x26decc0) [ CSSD]2013-05-23 14:48:32.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26decc0) [ CSSD]2013-05-23 14:48:32.697 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26decc0 with con 0x26de5a0, requested num -1 [ CSSD]2013-05-23 14:48:32.697 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:32.697 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:48:32.698 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:32.698 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de670), client(1/0x26def20) [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26def20) [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26def20 with con 0x26de4f0, requested num -1 [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26804f0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:32.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:32.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26decc0) [ CSSD]2013-05-23 14:48:32.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26decc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:48:32.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dee30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:32.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dee30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:32.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26def20) [ CSSD]2013-05-23 14:48:32.710 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26def20), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:48:32.710 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26807f0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:48:32.710 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26807f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:32.819 [1199044928] >TRACE: clssgmAllocProc: (0x26820d0) allocated [ CSSD]2013-05-23 14:48:32.820 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:32.821 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26820d0 - 1,2,3 [ CSSD]2013-05-23 14:48:32.821 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26de8f0) proc(0x26820d0) pid(12987) version 11:1:1:4 [ CSSD]2013-05-23 14:48:32.836 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:48:32.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:48:32.840 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:48:32.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x26820d0 [ CSSD]2013-05-23 14:48:32.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26820d0) con(0x26de8f0) skgpid ospid 12987 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:32.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:48:32.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x26cda30) skgpid ospid 12950 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:32.912 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de670 [ CSSD]2013-05-23 14:48:32.912 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de670) con(0x26aa800) skgpid ospid 12951 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:33.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:33.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:33.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:33.365 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:33.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074f002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:34.126 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:34.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:35.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:35.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:35.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:37.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:37.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:37.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:37.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0750002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:37.659 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:48:37.659 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:48:37.659 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:48:37.659 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:37.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0751002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:37.665 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:48:37.665 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:48:39.130 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:39.130 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:39.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:39.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:39.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:40.758 [1199044928] >TRACE: clssgmAllocProc: (0x269b610) allocated [ CSSD]2013-05-23 14:48:40.758 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:40.759 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b610 - 1,2,3 [ CSSD]2013-05-23 14:48:40.759 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b610) pid(13075) version 11:1:1:4 [ CSSD]2013-05-23 14:48:41.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:41.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:41.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:41.320 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b610 [ CSSD]2013-05-23 14:48:41.320 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b610) con(0x26cda30) skgpid ospid 13075 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:43.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:43.132 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:48:43.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:43.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:43.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:43.386 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:43.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0752002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:45.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:45.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:45.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:47.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:47.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:47.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:47.945 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:48:47.946 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:48:47.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:48:47.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x269b5b0) pid(13274) version 11:1:1:4 [ CSSD]2013-05-23 14:48:47.963 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x269a0a0) [ CSSD]2013-05-23 14:48:47.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:47.963 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269a0a0 with con 0x26cda30, requested num -1 [ CSSD]2013-05-23 14:48:47.963 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:47.963 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:48:47.964 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:47.964 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:47.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269a0a0) [ CSSD]2013-05-23 14:48:47.970 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269a0a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:48:47.970 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaa70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:47.970 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaa70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:48.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:48.136 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:48.173 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:48:48.173 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x26a67c0) skgpid ospid 13274 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:49.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:49.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:49.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:51.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:51.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:51.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:51.495 [1199044928] >TRACE: clssgmAllocProc: (0x269b5b0) allocated [ CSSD]2013-05-23 14:48:51.496 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:51.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5b0 - 1,2,3 [ CSSD]2013-05-23 14:48:51.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x269b5b0) pid(13338) version 11:1:1:4 [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b5b0), client(1/0x26aa700) [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa700) [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa700 with con 0x269b4f0, requested num -1 [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa870/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:48:51.514 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:51.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa700) [ CSSD]2013-05-23 14:48:51.521 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa700), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:48:51.521 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aab70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:48:51.521 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aab70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:48:51.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5b0 [ CSSD]2013-05-23 14:48:51.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5b0) con(0x26cda30) skgpid ospid 13338 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:52.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26cea10) [ CSSD]2013-05-23 14:48:52.101 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26cea10), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:48:52.101 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26cea10), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:48:52.101 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce250 [ CSSD]2013-05-23 14:48:52.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce250) con(0x26ee500) skgpid 7399 ospid 7399 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:48:52.647 [1199044928] >TRACE: clssgmAllocProc: (0x26ce880) allocated [ CSSD]2013-05-23 14:48:52.648 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:48:52.649 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce880 - 1,2,3 [ CSSD]2013-05-23 14:48:52.649 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cda30) proc(0x26ce880) pid(13361/13361) version 11:1:1:4 [ CSSD]2013-05-23 14:48:52.665 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce880), client(1/0x26ee500) [ CSSD]2013-05-23 14:48:52.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 14:48:52.665 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:48:52.665 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:48:52.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0753002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:52.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:48:52.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:48:52.906 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:48:52.906 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:52.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0754002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:52.912 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:48:52.912 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:48:53.140 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:53.140 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:53.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:53.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:53.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:53.406 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:48:53.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0755002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:55.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:55.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:55.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:55.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0756002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:55.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:48:55.368 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:48:55.368 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:48:55.368 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:48:55.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0757002b) incarnation(174631051) [ CSSD]2013-05-23 14:48:55.374 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:48:55.374 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:48:57.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:48:57.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:57.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:58.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:48:58.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:48:59.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:48:59.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:48:59.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:01.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:01.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:01.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:02.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:02.146 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:49:03.205 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:49:03.206 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:49:03.207 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:49:03.207 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x269b280) pid(13460) version 11:1:1:4 [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x26ed1a0) [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed1a0) [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed1a0 with con 0x26a6a40, requested num -1 [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa3e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:03.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:03.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed1a0) [ CSSD]2013-05-23 14:49:03.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:49:03.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:03.219 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:03.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:03.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:03.421 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:49:03.421 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26a67c0) skgpid ospid 13460 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:03.426 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:03.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0758002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:03.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:05.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:05.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:05.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:07.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:07.149 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:07.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:07.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:07.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:08.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0759002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:08.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:49:08.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:49:08.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:49:08.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:08.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(075a002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:08.161 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:49:08.161 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:49:09.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:09.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:09.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:11.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:11.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:11.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:12.152 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:12.152 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:13.447 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:13.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075b002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:13.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:13.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:13.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:15.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:15.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:15.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:17.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:17.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:17.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:17.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:17.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:17.839 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce880), client(2/0x26ed1a0) [ CSSD]2013-05-23 14:49:17.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ed1a0) [ CSSD]2013-05-23 14:49:17.839 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:49:17.839 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 14:49:18.454 [1199044928] >TRACE: clssgmAllocProc: (0x269b410) allocated [ CSSD]2013-05-23 14:49:18.454 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:49:18.455 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b410 - 1,2,3 [ CSSD]2013-05-23 14:49:18.455 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x269b410) pid(13609) version 11:1:1:4 [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b410), client(1/0x26aa570) [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa570) [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa570 with con 0x269b690, requested num -1 [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:18.461 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:18.468 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa570) [ CSSD]2013-05-23 14:49:18.468 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa570), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:49:18.468 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa9e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:18.468 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa9e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:18.670 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b410 [ CSSD]2013-05-23 14:49:18.670 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b410) con(0x269a090) skgpid ospid 13609 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:19.333 [1199044928] >TRACE: clssgmAllocProc: (0x269b340) allocated [ CSSD]2013-05-23 14:49:19.334 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:49:19.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b340 - 1,2,3 [ CSSD]2013-05-23 14:49:19.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x269b340) pid(13659) version 11:1:1:4 [ CSSD]2013-05-23 14:49:19.452 [1199044928] >TRACE: clssgmAllocProc: (0x26de950) allocated [ CSSD]2013-05-23 14:49:19.453 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:49:19.454 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de950 - 1,2,3 [ CSSD]2013-05-23 14:49:19.454 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa730) proc(0x26de950) pid(13669) version 11:1:1:4 [ CSSD]2013-05-23 14:49:19.470 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:49:19.472 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:49:19.475 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de950 [ CSSD]2013-05-23 14:49:19.475 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de950) con(0x26aa730) skgpid ospid 13669 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:19.556 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5326/0x26dee90) [ CSSD]2013-05-23 14:49:19.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5326 (0x26dee90) [ CSSD]2013-05-23 14:49:19.556 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26dee90 with con 0x269b280, requested num -1 [ CSSD]2013-05-23 14:49:19.556 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:49:19.556 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26aa4b0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:49:19.557 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:19.557 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:49:19.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5326 (0x26dee90) [ CSSD]2013-05-23 14:49:19.562 [1199044928] >TRACE: clssgmExitGrock: client 5326 (0x26dee90), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:49:19.562 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7b0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:49:19.563 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26aa7b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:19.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b340 [ CSSD]2013-05-23 14:49:19.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b340) con(0x269a090) skgpid ospid 13659 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:19.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:19.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:19.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:21.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:21.158 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:49:21.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:21.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:21.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:23.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(075c002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:23.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:49:23.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:49:23.404 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:49:23.404 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:23.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(075d002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:23.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:49:23.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:49:23.467 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:23.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075e002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:23.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:23.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:23.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:25.623 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:25.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:25.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:26.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:26.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:27.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:27.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:27.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:29.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:29.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:29.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:31.165 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:31.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:31.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:31.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:31.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:33.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:33.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075f002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:33.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:33.706 [1199044928] >TRACE: clssgmAllocProc: (0x269b4d0) allocated [ CSSD]2013-05-23 14:49:33.707 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:49:33.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4d0 - 1,2,3 [ CSSD]2013-05-23 14:49:33.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26915e0) proc(0x269b4d0) pid(13801) version 11:1:1:4 [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4d0), client(1/0x26aa630) [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa630 with con 0x269b410, requested num -1 [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:33.713 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:33.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:49:33.720 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:49:33.720 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaaa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:33.720 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaaa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:33.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:33.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:33.922 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4d0 [ CSSD]2013-05-23 14:49:33.922 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4d0) con(0x26915e0) skgpid ospid 13801 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:35.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:35.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:35.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:36.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:36.168 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:37.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:37.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:37.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:38.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0760002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:38.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:49:38.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:49:38.679 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:49:38.679 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:38.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0761002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:38.685 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:49:38.685 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:49:39.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:39.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:39.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:40.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:40.171 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:49:41.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:41.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:41.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:43.527 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:43.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0762002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:43.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:43.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:43.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:45.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:45.175 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:45.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:45.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:45.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:47.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:47.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:47.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:48.965 [1199044928] >TRACE: clssgmAllocProc: (0x269b410) allocated [ CSSD]2013-05-23 14:49:48.966 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:49:48.967 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b410 - 1,2,3 [ CSSD]2013-05-23 14:49:48.967 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x269b410) pid(13951) version 11:1:1:4 [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b410), client(1/0x26aa630) [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa630 with con 0x269b350, requested num -1 [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:48.973 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:48.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:49:48.979 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:49:48.979 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaaa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:48.979 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaaa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:49.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b410 [ CSSD]2013-05-23 14:49:49.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b410) con(0x269a090) skgpid ospid 13951 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:49.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:49.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:49.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:50.178 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:50.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:51.764 [1199044928] >TRACE: clssgmAllocProc: (0x269b0e0) allocated [ CSSD]2013-05-23 14:49:51.765 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:49:51.765 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b0e0 - 1,2,3 [ CSSD]2013-05-23 14:49:51.765 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x269b0e0) pid(14004) version 11:1:1:4 [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b0e0), client(1/0x269b5b0) [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b5b0) [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b5b0 with con 0x269b020, requested num -1 [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa3e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:49:51.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:51.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b5b0) [ CSSD]2013-05-23 14:49:51.779 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b5b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:49:51.779 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa6e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:49:51.779 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa6e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:49:51.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:51.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:51.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:51.981 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b0e0 [ CSSD]2013-05-23 14:49:51.981 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b0e0) con(0x269a090) skgpid ospid 14004 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:49:53.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:49:53.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0763002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:53.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:53.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:53.891 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:53.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0764002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:53.929 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:49:53.929 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:49:53.929 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:49:53.929 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:53.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0765002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:53.935 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:49:53.935 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:49:55.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:55.182 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:49:55.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0766002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:55.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:49:55.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:49:55.621 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:49:55.621 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:49:55.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0767002b) incarnation(174631051) [ CSSD]2013-05-23 14:49:55.628 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:49:55.628 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:49:55.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:55.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:55.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:57.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:57.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:57.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:49:59.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:49:59.184 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:49:59.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:49:59.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:49:59.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:01.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:01.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:01.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:03.570 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:03.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0768002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:03.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:03.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:03.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:04.188 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:04.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:04.214 [1199044928] >TRACE: clssgmAllocProc: (0x269b4d0) allocated [ CSSD]2013-05-23 14:50:04.216 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:50:04.216 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4d0 - 1,2,3 [ CSSD]2013-05-23 14:50:04.216 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26915e0) proc(0x269b4d0) pid(14290) version 11:1:1:4 [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4d0), client(1/0x26aa630) [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa630 with con 0x269b410, requested num -1 [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:50:04.222 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:04.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa630) [ CSSD]2013-05-23 14:50:04.229 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:50:04.229 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aaaa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:04.229 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aaaa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:50:04.432 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4d0 [ CSSD]2013-05-23 14:50:04.432 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4d0) con(0x26915e0) skgpid ospid 14290 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:04.627 [1199044928] >TRACE: clssgmAllocProc: (0x269b530) allocated [ CSSD]2013-05-23 14:50:04.628 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:50:04.628 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b530 - 1,2,3 [ CSSD]2013-05-23 14:50:04.628 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26915c0) proc(0x269b530) pid(14333/14333) version 11:1:1:4 [ CSSD]2013-05-23 14:50:04.644 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b530), client(1/0x26aa5f0) [ CSSD]2013-05-23 14:50:04.644 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aa5f0) [ CSSD]2013-05-23 14:50:04.644 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:50:04.644 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aa5f0) [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aa5f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aa5f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b530 [ CSSD]2013-05-23 14:50:04.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b530) con(0x26915c0) skgpid 14333 ospid 14333 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:05.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:05.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:05.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:07.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:07.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:08.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:09.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0769002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:09.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:09.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:09.180 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:09.180 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:09.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(076a002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:09.186 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:09.186 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:09.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:09.191 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:09.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:09.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:10.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:11.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:11.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:12.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:13.590 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:13.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076b002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:13.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:13.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:14.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:14.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:14.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:15.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:15.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:16.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:17.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x267c080) [ CSSD]2013-05-23 14:50:17.678 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x267c080), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:50:17.678 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x267c080), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:50:17.678 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1a0 [ CSSD]2013-05-23 14:50:17.682 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1a0) con(0x26cd6b0) skgpid 8673 ospid 8673 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:18.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:18.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:18.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:18.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:18.197 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:50:19.484 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:50:19.485 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:50:19.486 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:50:19.486 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x26ce310) pid(14460) version 11:1:1:4 [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5c0 with con 0x26cd830, requested num -1 [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:50:19.492 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:19.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:19.498 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:50:19.498 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:19.498 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:50:19.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:50:19.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x269a090) skgpid ospid 14460 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:20.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:20.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:20.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:22.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:22.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:22.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:23.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:23.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:23.610 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:23.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076c002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:24.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:24.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:24.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:24.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(076d002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:24.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:24.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:24.439 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:24.439 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:24.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(076e002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:24.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:24.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:26.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:26.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:26.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:28.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:28.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:28.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:28.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:28.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:30.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:30.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:30.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:32.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:32.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:32.200 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:33.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:33.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:33.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:33.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076f002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:34.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:34.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:34.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:34.733 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:50:34.734 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:50:34.734 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:50:34.734 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x26ce310) pid(14598) version 11:1:1:4 [ CSSD]2013-05-23 14:50:34.740 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:50:34.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:34.740 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5c0 with con 0x26cd830, requested num -1 [ CSSD]2013-05-23 14:50:34.740 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:34.740 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:50:34.741 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:50:34.741 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:34.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:34.747 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:50:34.747 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:34.747 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:50:34.950 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:50:34.950 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x269a090) skgpid ospid 14598 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:36.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:36.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:36.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:37.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:37.210 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:50:38.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:38.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:38.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:39.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0770002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:39.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:39.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:39.687 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:39.687 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:39.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0771002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:39.694 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:39.694 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:40.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:40.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:40.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:42.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:42.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:42.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:42.213 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:42.300 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:43.883 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:43.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0772002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:44.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:44.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:44.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:46.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:46.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:46.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:47.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:47.216 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:48.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:48.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:48.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:49.983 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:50:49.983 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:50:49.984 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:50:49.984 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ecd00) proc(0x26ce310) pid(14740) version 11:1:1:4 [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5c0 with con 0x26cd830, requested num -1 [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:50:49.990 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:49.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:49.997 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:50:49.997 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:49.997 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:50:50.199 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:50:50.199 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x26ecd00) skgpid ospid 14740 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:50.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:50.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:50.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:52.022 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:50:52.023 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:50:52.024 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:50:52.024 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x26ce310) pid(14793) version 11:1:1:4 [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5c0 with con 0x26cd830, requested num -1 [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:50:52.030 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:52.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:50:52.037 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:50:52.037 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:50:52.037 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:50:52.219 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:52.219 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:50:52.240 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:50:52.240 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x269a090) skgpid ospid 14793 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:50:52.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:52.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:52.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:53.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0773002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:53.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:53.575 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:53.575 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:53.575 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:53.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0774002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:53.581 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:53.581 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:53.907 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:50:53.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0775002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:54.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:54.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:54.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:54.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0776002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:54.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:54.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:54.943 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:54.944 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:54.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0777002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:54.950 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:54.950 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:55.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0778002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:55.882 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:50:55.882 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:50:55.882 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:50:55.882 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:50:55.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0779002b) incarnation(174631051) [ CSSD]2013-05-23 14:50:55.889 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:50:55.889 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:50:56.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:50:56.222 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:50:56.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:56.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:56.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:50:58.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:50:58.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:50:58.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:00.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:00.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:00.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:01.225 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:01.225 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:02.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:02.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:02.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:03.931 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:03.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(077a002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:04.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:04.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:04.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:05.233 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:51:05.234 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:51:05.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:51:05.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ecd00) proc(0x26ce310) pid(14891) version 11:1:1:4 [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5c0 with con 0x26cd830, requested num -1 [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:51:05.240 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:05.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:51:05.247 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:51:05.247 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdbb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:05.247 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdbb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:51:05.450 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:51:05.450 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x26ecd00) skgpid ospid 14891 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:06.228 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:06.228 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:06.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:06.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:06.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:08.340 [1199044928] >TRACE: clssgmAllocProc: (0x26ce310) allocated [ CSSD]2013-05-23 14:51:08.341 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:51:08.341 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce310 - 1,2,3 [ CSSD]2013-05-23 14:51:08.341 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a090) proc(0x26ce310) pid(13359/13359) version 11:1:1:4 [ CSSD]2013-05-23 14:51:08.358 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ce310), client(1/0x26ed5c0) [ CSSD]2013-05-23 14:51:08.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:51:08.358 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:51:08.358 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:51:08.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:08.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:08.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:10.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077b002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:10.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:10.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:10.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:51:10.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:10.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077c002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:10.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:10.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:10.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:10.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:10.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:11.231 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:11.231 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:11.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077d002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:11.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:11.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:11.840 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:51:11.840 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:11.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077e002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:11.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:11.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:11.973 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:51:11.974 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:51:11.976 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:51:11.976 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:51:12.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:12.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:12.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:13.951 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:13.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(077f002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:14.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:14.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:14.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:15.622 [1199044928] >TRACE: clssgmAllocProc: (0x269b2e0) allocated [ CSSD]2013-05-23 14:51:15.665 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:51:15.665 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b2e0 - 1,2,3 [ CSSD]2013-05-23 14:51:15.665 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b2e0) pid(15014/15014) version 11:1:1:4 [ CSSD]2013-05-23 14:51:15.682 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b2e0), client(1/0x269b1c0) [ CSSD]2013-05-23 14:51:15.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269b1c0) [ CSSD]2013-05-23 14:51:15.682 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:51:15.682 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269b1c0) [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269b1c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269b1c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b2e0 [ CSSD]2013-05-23 14:51:15.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b2e0) con(0x26cdae0) skgpid 15014 ospid 15014 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:16.234 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:16.235 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:16.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:16.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:16.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:18.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:18.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:18.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:20.493 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:51:20.494 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:51:20.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:51:20.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(15058) version 11:1:1:4 [ CSSD]2013-05-23 14:51:20.510 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6a0) [ CSSD]2013-05-23 14:51:20.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:20.510 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269b1c0, requested num -1 [ CSSD]2013-05-23 14:51:20.510 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:20.510 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:51:20.511 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:51:20.511 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:20.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:20.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:51:20.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:20.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:51:20.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:20.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:20.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:20.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:51:20.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 15058 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:21.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:21.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:22.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:22.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:22.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:23.974 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:24.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0780002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:24.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:24.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:24.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:25.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0781002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:25.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:25.446 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:25.446 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:51:25.446 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:25.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0782002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:25.454 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:25.454 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:26.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:26.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:26.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:26.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:26.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:28.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:28.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:28.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:30.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:30.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:30.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:31.245 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:31.245 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:32.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:32.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:32.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:34.017 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:34.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0783002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:34.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:34.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:34.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:35.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:35.248 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:51:35.753 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:51:35.754 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:51:35.754 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:51:35.754 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(15213) version 11:1:1:4 [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6a0) [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269b1c0, requested num -1 [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:51:35.760 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:35.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:35.767 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:51:35.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:35.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:51:35.969 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:51:35.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 15213 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:36.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:36.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:36.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:38.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:38.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:38.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:40.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:40.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:40.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0784002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:40.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:40.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:40.695 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:51:40.695 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:40.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0785002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:40.702 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:40.702 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:40.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:40.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:40.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:42.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:42.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:42.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:44.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:44.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0786002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:44.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:44.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:44.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:45.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:45.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:46.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:46.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:46.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:48.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:48.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:48.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:50.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:50.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:51:50.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:50.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:50.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:51.002 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:51:51.003 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:51:51.004 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:51:51.004 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(15362) version 11:1:1:4 [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6a0) [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269b1c0, requested num -1 [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:51:51.010 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:51.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:51:51.016 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:51:51.016 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:51.016 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:51:51.219 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:51:51.219 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 15362 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:52.282 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:51:52.283 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:51:52.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:51:52.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(15411) version 11:1:1:4 [ CSSD]2013-05-23 14:51:52.290 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6b0) [ CSSD]2013-05-23 14:51:52.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:51:52.290 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6b0 with con 0x269b040, requested num -1 [ CSSD]2013-05-23 14:51:52.290 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:52.290 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:51:52.291 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:51:52.291 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:52.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:51:52.298 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:51:52.298 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:51:52.298 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:51:52.500 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:51:52.500 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 15411 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:51:52.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:52.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:52.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:54.066 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:51:54.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0787002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:54.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:54.261 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:51:54.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:54.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:54.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:55.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0788002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:55.953 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:55.953 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:55.953 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:51:55.953 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:55.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0789002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:55.960 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:55.960 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:56.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078a002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:56.144 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:51:56.144 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:51:56.144 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:51:56.144 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:51:56.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078b002b) incarnation(174631051) [ CSSD]2013-05-23 14:51:56.151 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:51:56.151 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:51:56.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:56.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:56.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:59.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:51:59.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:51:59.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:51:59.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:51:59.264 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:01.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:01.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:01.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:03.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:03.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:03.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:03.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078c002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:03.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:03.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:03.543 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:03.543 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:03.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078d002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:03.550 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:03.550 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:04.087 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:04.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(078e002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:04.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:04.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:05.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:05.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:05.028 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:06.253 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:52:06.254 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:52:06.254 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:52:06.254 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(15547) version 11:1:1:4 [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6a0) [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269b1c0, requested num -1 [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:52:06.260 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:06.267 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:52:06.267 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:52:06.267 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:06.267 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:52:06.470 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:52:06.470 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 15547 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:07.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:07.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:07.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:09.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:09.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:09.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:09.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:09.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:09.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:52:09.860 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:52:09.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:52:09.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:52:09.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078f002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:09.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:09.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:09.943 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:52:09.943 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:52:09.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0790002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:09.951 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:09.951 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:11.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:11.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:11.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:11.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0791002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:11.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:11.204 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:11.204 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:11.204 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:11.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0792002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:11.211 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:11.211 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:11.495 [1199044928] >TRACE: clssgmAllocProc: (0x269b230) allocated [ CSSD]2013-05-23 14:52:11.496 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:52:11.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b230 - 1,2,3 [ CSSD]2013-05-23 14:52:11.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ecd00) proc(0x269b230) pid(15664) version 11:1:1:4 [ CSSD]2013-05-23 14:52:13.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:13.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:13.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:14.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b230 [ CSSD]2013-05-23 14:52:14.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b230) con(0x26ecd00) skgpid ospid 15664 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:14.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:14.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0793002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:14.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:14.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:15.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:15.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:15.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:17.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:17.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:17.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:19.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:19.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:19.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:19.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:19.278 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:21.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:21.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:21.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:21.513 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:52:21.514 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:52:21.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:52:21.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x269b280) pid(16053) version 11:1:1:4 [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b6a0) [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6a0 with con 0x269b1c0, requested num -1 [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:52:21.521 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:21.528 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6a0) [ CSSD]2013-05-23 14:52:21.528 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:52:21.528 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:21.528 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:52:21.730 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:52:21.730 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26cdae0) skgpid ospid 16053 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:23.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:23.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:23.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:24.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:24.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0794002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:24.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:24.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:25.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:25.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:25.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:26.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0795002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:26.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:26.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:26.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:26.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:26.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0796002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:26.461 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:26.461 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:27.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:27.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:27.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:29.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:29.284 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:29.285 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:29.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:29.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:31.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:31.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:31.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:33.287 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:33.287 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:52:33.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:33.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:33.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:34.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:34.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0797002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:35.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:35.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:35.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:36.762 [1199044928] >TRACE: clssgmAllocProc: (0x269b1b0) allocated [ CSSD]2013-05-23 14:52:36.763 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:52:36.764 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b1b0 - 1,2,3 [ CSSD]2013-05-23 14:52:36.764 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ecd00) proc(0x269b1b0) pid(16196) version 11:1:1:4 [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b1b0), client(1/0x269b680) [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b680) [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b680 with con 0x269b0f0, requested num -1 [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa4b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:52:36.770 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:36.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b680) [ CSSD]2013-05-23 14:52:36.777 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:52:36.777 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:36.777 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa7b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:52:36.979 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b1b0 [ CSSD]2013-05-23 14:52:36.979 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b1b0) con(0x26ecd00) skgpid ospid 16196 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:37.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:37.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:37.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:38.290 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:38.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:39.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:39.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:39.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:41.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:41.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:41.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:41.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0798002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:41.704 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:41.704 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:41.704 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:41.704 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:41.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0799002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:41.712 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:41.712 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:43.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:43.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:43.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:43.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:43.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:44.169 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:44.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079a002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:45.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:45.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:45.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:47.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:47.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:47.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:47.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ceab0) [ CSSD]2013-05-23 14:52:47.712 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ceab0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:52:47.712 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ceab0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:52:47.712 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e13a0) [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e13a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e13a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ec800 [ CSSD]2013-05-23 14:52:47.719 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ec800) con(0x267d590) skgpid 10605 ospid 10605 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:48.298 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:48.298 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:49.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:49.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:49.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:51.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:51.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:51.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:52.015 [1199044928] >TRACE: clssgmAllocProc: (0x26ecce0) allocated [ CSSD]2013-05-23 14:52:52.016 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:52:52.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ecce0 - 1,2,3 [ CSSD]2013-05-23 14:52:52.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c2b0) proc(0x26ecce0) pid(16348) version 11:1:1:4 [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ecce0), client(1/0x26ecf70) [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ecf70) [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ecf70 with con 0x26e1390, requested num -1 [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e18f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:52:52.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:52.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ecf70) [ CSSD]2013-05-23 14:52:52.030 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ecf70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:52:52.030 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1bf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:52.030 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1bf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:52:52.232 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ecce0 [ CSSD]2013-05-23 14:52:52.232 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ecce0) con(0x267c2b0) skgpid ospid 16348 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:52.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:52.301 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:52:52.449 [1199044928] >TRACE: clssgmAllocProc: (0x267bcf0) allocated [ CSSD]2013-05-23 14:52:52.450 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:52:52.451 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bcf0 - 1,2,3 [ CSSD]2013-05-23 14:52:52.451 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdae0) proc(0x267bcf0) pid(16322/16322) version 11:1:1:4 [ CSSD]2013-05-23 14:52:52.457 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267bcf0), client(1/0x26ee2c0) [ CSSD]2013-05-23 14:52:52.457 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee2c0) [ CSSD]2013-05-23 14:52:52.457 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:52:52.457 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:52:52.545 [1199044928] >TRACE: clssgmAllocProc: (0x269b280) allocated [ CSSD]2013-05-23 14:52:52.546 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:52:52.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b280 - 1,2,3 [ CSSD]2013-05-23 14:52:52.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eca80) proc(0x269b280) pid(16395) version 11:1:1:4 [ CSSD]2013-05-23 14:52:52.552 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b280), client(1/0x269b1d0) [ CSSD]2013-05-23 14:52:52.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b1d0) [ CSSD]2013-05-23 14:52:52.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b1d0 with con 0x26ecb30, requested num -1 [ CSSD]2013-05-23 14:52:52.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:52.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:52:52.553 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:52:52.553 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:52.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b1d0) [ CSSD]2013-05-23 14:52:52.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b1d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:52:52.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b660) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:52:52.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b660) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:52:52.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b280 [ CSSD]2013-05-23 14:52:52.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b280) con(0x26eca80) skgpid ospid 16395 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:53.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:53.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:53.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:54.189 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:52:54.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079b002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:55.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:55.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:55.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:56.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(079c002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:56.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:56.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:56.405 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:56.405 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:56.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079d002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:56.412 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:56.412 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:56.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(079e002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:56.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:52:56.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:52:56.954 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:52:56.954 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:52:56.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079f002b) incarnation(174631051) [ CSSD]2013-05-23 14:52:56.960 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:52:56.960 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:52:57.304 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:52:57.304 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:52:57.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:57.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:57.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:52:57.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:52:57.855 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2691090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:52:57.855 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2691090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:52:57.855 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:52:57.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:52:57.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid 12595 ospid 12595 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:52:59.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:52:59.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:52:59.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:01.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:01.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:01.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:02.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:02.308 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:03.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:03.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:03.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:04.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:04.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a0002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:05.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:05.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:05.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:06.066 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:53:06.067 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:06.068 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:53:06.068 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c430) proc(0x266f0d0) pid(15119/15119) version 11:1:1:4 [ CSSD]2013-05-23 14:53:06.090 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f0d0), client(1/0x2691090) [ CSSD]2013-05-23 14:53:06.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:53:06.090 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:53:06.090 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:53:07.266 [1199044928] >TRACE: clssgmAllocProc: (0x269b560) allocated [ CSSD]2013-05-23 14:53:07.266 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:53:07.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b560 - 1,2,3 [ CSSD]2013-05-23 14:53:07.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x269b560) pid(16519) version 11:1:1:4 [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b560), client(1/0x26a9ed0) [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9ed0) [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9ed0 with con 0x269b690, requested num -1 [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa040/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:07.273 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:07.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9ed0) [ CSSD]2013-05-23 14:53:07.279 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9ed0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:53:07.279 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:07.279 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:07.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:07.311 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:07.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b560 [ CSSD]2013-05-23 14:53:07.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b560) con(0x261f650) skgpid ospid 16519 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:07.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:07.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:07.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:09.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:09.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:09.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:11.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:11.314 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:53:11.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:11.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:11.763 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:12.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a1002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:12.207 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:53:12.207 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:53:12.207 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:53:12.207 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:12.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a2002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:12.214 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:53:12.214 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:53:12.441 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x266f0d0), client(2/0x261f650) [ CSSD]2013-05-23 14:53:12.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x261f650) [ CSSD]2013-05-23 14:53:12.441 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:53:12.441 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:53:13.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:13.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:13.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:14.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:14.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a3002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:15.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:15.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:15.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:16.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:16.317 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:17.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:17.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:17.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:19.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:19.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:19.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:21.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:21.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:21.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:21.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:21.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:22.515 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:53:22.516 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:53:22.516 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:53:22.516 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eca60) proc(0x26a9cc0) pid(16684) version 11:1:1:4 [ CSSD]2013-05-23 14:53:22.532 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(1/0x269b6b0) [ CSSD]2013-05-23 14:53:22.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:22.532 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6b0 with con 0x26a9c00, requested num -1 [ CSSD]2013-05-23 14:53:22.533 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:22.533 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:53:22.533 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:22.533 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:22.540 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:22.540 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:53:22.540 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:22.540 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:22.742 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:53:22.742 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x26eca60) skgpid ospid 16684 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:23.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:23.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:23.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:24.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:24.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a4002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:25.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:25.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:25.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:26.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:26.324 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:27.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a5002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:27.458 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:53:27.458 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:53:27.458 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:53:27.458 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:27.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a6002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:27.465 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:53:27.465 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:53:27.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:27.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:27.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:29.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:29.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:29.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:30.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:30.327 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:53:31.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:31.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:31.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:32.986 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:53:32.987 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:32.988 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:53:32.988 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eca60) proc(0x26a9cc0) pid(16798) version 11:1:1:4 [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(1/0x269b6b0) [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x269b6b0 with con 0x26a9c00, requested num -1 [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa4f0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:32.994 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:33.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:33.000 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6b0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:53:33.000 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7f0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:53:33.000 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26aa7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:33.106 [1199044928] >TRACE: clssgmAllocProc: (0x26de670) allocated [ CSSD]2013-05-23 14:53:33.107 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:33.107 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de670 - 1,2,3 [ CSSD]2013-05-23 14:53:33.107 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa450) proc(0x26de670) pid(16803) version 11:1:1:4 [ CSSD]2013-05-23 14:53:33.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:53:33.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:53:33.126 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:53:33.127 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de670 [ CSSD]2013-05-23 14:53:33.127 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de670) con(0x26aa450) skgpid ospid 16803 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:33.202 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:53:33.202 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x26eca60) skgpid ospid 16798 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:33.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:33.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:33.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:34.271 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:34.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a7002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:35.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:35.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:35.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:35.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:35.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:37.784 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:53:37.785 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:53:37.786 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:53:37.786 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eca60) proc(0x26a9cc0) pid(16841) version 11:1:1:4 [ CSSD]2013-05-23 14:53:37.791 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(1/0x269b6b0) [ CSSD]2013-05-23 14:53:37.791 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:37.791 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6b0 with con 0x26a9c00, requested num -1 [ CSSD]2013-05-23 14:53:37.791 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:37.791 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:53:37.792 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:37.792 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:37.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:53:37.798 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:53:37.798 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:37.798 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:37.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:37.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:38.001 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:53:38.001 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x26eca60) skgpid ospid 16841 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:38.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:39.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:39.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:40.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:40.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:40.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:41.307 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:53:41.308 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:41.308 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:53:41.308 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eca60) proc(0x26a9cc0) pid(16921) version 11:1:1:4 [ CSSD]2013-05-23 14:53:41.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:53:41.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x26eca60) skgpid ospid 16921 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:41.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:41.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:42.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:42.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a8002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:42.708 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:53:42.708 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:53:42.708 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:53:42.708 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:42.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a9002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:42.714 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:53:42.714 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:53:43.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:43.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:44.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:44.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:44.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:44.337 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:53:44.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07aa002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:46.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:46.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:46.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:48.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:48.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:48.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:49.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:49.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:50.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:50.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:50.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:52.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:52.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:52.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x268fa20) [ CSSD]2013-05-23 14:53:52.151 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x268fa20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:53:52.151 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x268fa20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:53:52.151 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26916a0) [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26916a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26916a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eebf0 [ CSSD]2013-05-23 14:53:52.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eebf0) con(0x268c5c0) skgpid 26470 ospid 26470 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:52.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:52.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ecc40) [ CSSD]2013-05-23 14:53:52.176 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ecc40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:53:52.176 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ecc40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:53:52.176 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269e550) [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269e550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269e550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmDeadProc: proc 0x26909d0 [ CSSD]2013-05-23 14:53:52.180 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26909d0) con(0x2677de0) skgpid 11268 ospid 11268 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:52.803 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:53:52.804 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:52.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:53:52.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699e40) proc(0x269e390) pid(17159) version 11:1:1:4 [ CSSD]2013-05-23 14:53:52.810 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:53:52.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:53:52.810 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x2691360, requested num -1 [ CSSD]2013-05-23 14:53:52.810 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:52.810 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e18f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:53:52.811 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:52.811 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:52.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:53:52.816 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:53:52.816 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26911e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:52.816 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26911e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:53.019 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:53:53.019 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x2699e40) skgpid ospid 17159 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:53.033 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 14:53:53.033 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:53:53.034 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 14:53:53.034 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce190) proc(0x268c1a0) pid(17168) version 11:1:1:4 [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268c1a0), client(1/0x268fa20) [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x268c740, requested num -1 [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e18f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:53:53.039 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:53.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:53:53.045 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:53:53.045 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1bf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:53:53.045 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1bf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:53:53.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 14:53:53.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x26ce190) skgpid ospid 17168 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:53:54.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:54.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:54.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:54.313 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:53:54.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:54.343 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:53:54.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ab002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:56.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:56.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:56.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:56.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ac002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:56.665 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:53:56.665 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:53:56.665 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:53:56.665 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:56.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ad002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:56.671 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:53:56.671 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:53:57.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ae002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:57.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:53:57.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:53:57.963 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:53:57.963 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:53:57.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07af002b) incarnation(174631051) [ CSSD]2013-05-23 14:53:57.969 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:53:57.969 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:53:58.049 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 14:53:58.049 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:53:58.050 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 14:53:58.050 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x268c1a0) pid(17121/17121) version 11:1:1:4 [ CSSD]2013-05-23 14:53:58.066 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268c1a0), client(1/0x268fa20) [ CSSD]2013-05-23 14:53:58.066 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:53:58.066 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:53:58.066 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 14:53:58.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:53:58.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:53:58.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:53:59.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:53:59.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:00.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:00.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:00.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:02.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:02.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:02.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:04.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:04.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:04.334 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:04.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:04.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:04.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:04.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b0002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:05.341 [1199044928] >TRACE: clssgmAllocProc: (0x268fdd0) allocated [ CSSD]2013-05-23 14:54:05.342 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:54:05.342 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268fdd0 - 1,2,3 [ CSSD]2013-05-23 14:54:05.342 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eece0) proc(0x268fdd0) pid(16320/16320) version 11:1:1:4 [ CSSD]2013-05-23 14:54:05.358 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268fdd0), client(1/0x269e550) [ CSSD]2013-05-23 14:54:05.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269e550) [ CSSD]2013-05-23 14:54:05.359 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:54:05.359 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:54:06.024 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267bcf0), client(2/0x26901a0) [ CSSD]2013-05-23 14:54:06.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26901a0) [ CSSD]2013-05-23 14:54:06.024 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:54:06.024 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 14:54:06.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:06.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:06.284 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268fdd0), client(2/0x26909f0) [ CSSD]2013-05-23 14:54:06.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26909f0) [ CSSD]2013-05-23 14:54:06.284 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:54:06.284 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 14:54:06.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:08.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:08.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:08.280 [1199044928] >TRACE: clssgmAllocProc: (0x26a9b20) allocated [ CSSD]2013-05-23 14:54:08.281 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:54:08.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9b20 - 1,2,3 [ CSSD]2013-05-23 14:54:08.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690940) proc(0x26a9b20) pid(17321) version 11:1:1:4 [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9b20), client(1/0x269b6b0) [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b6b0 with con 0x26a9a60, requested num -1 [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa370/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:08.287 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:08.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b6b0) [ CSSD]2013-05-23 14:54:08.293 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b6b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:54:08.293 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa670) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:08.293 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa670) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:08.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:08.496 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9b20 [ CSSD]2013-05-23 14:54:08.496 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9b20) con(0x2690940) skgpid ospid 17321 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:09.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:09.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:10.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:10.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:10.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:12.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:12.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:12.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:13.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b1002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:13.211 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:54:13.211 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:54:13.211 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:54:13.211 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:13.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b2002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:13.217 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:54:13.217 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:54:14.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:14.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:14.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:14.357 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:14.357 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:14.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b3002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:14.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:16.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:16.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:16.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:18.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:18.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:18.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:19.360 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:19.360 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:19.649 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:54:19.649 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:54:19.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:54:19.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a2f0) proc(0x26a9cc0) pid(17457) version 11:1:1:4 [ CSSD]2013-05-23 14:54:19.771 [1199044928] >TRACE: clssgmAllocProc: (0x26de070) allocated [ CSSD]2013-05-23 14:54:19.772 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:54:19.773 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de070 - 1,2,3 [ CSSD]2013-05-23 14:54:19.773 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa450) proc(0x26de070) pid(17467) version 11:1:1:4 [ CSSD]2013-05-23 14:54:19.790 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:54:19.792 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:54:19.795 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de070 [ CSSD]2013-05-23 14:54:19.795 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de070) con(0x26aa450) skgpid ospid 17467 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5327/0x26a9c00) [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5327 (0x26a9c00) [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26a9c00 with con 0x269b690, requested num -1 [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26aa4f0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:19.871 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:54:19.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5327 (0x26a9c00) [ CSSD]2013-05-23 14:54:19.877 [1199044928] >TRACE: clssgmExitGrock: client 5327 (0x26a9c00), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:54:19.877 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa7f0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:54:19.877 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26aa7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:19.878 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:54:19.878 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x269a2f0) skgpid ospid 17457 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:20.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:20.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:20.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:22.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:22.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:22.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:23.531 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:54:23.532 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:54:23.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:54:23.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a2f0) proc(0x26a9cc0) pid(17504) version 11:1:1:4 [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(1/0x2690ff0) [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690ff0) [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690ff0 with con 0x269b690, requested num -1 [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa450/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:23.538 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:23.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690ff0) [ CSSD]2013-05-23 14:54:23.545 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690ff0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:54:23.545 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa750) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:23.545 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa750) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:23.748 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 14:54:23.748 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x269a2f0) skgpid ospid 17504 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:24.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:24.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:24.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:24.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:24.377 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:24.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b4002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:24.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:26.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:26.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:26.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 14:54:28.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x26916a0) skgpid 17121 ospid 17121 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:28.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:28.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:28.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b5002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:28.470 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:54:28.470 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:54:28.470 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:54:28.470 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:28.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b6002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:28.477 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:54:28.477 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:54:28.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:29.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:29.366 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:30.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:30.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:30.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:32.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:32.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:32.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:34.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:34.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:34.401 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:34.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:34.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:34.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b7002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:34.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:36.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:36.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:36.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:38.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:38.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:38.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:38.781 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:54:38.781 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:54:38.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:54:38.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce7c0) proc(0x269e390) pid(17642) version 11:1:1:4 [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce580, requested num -1 [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a140/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:38.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:38.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:38.795 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:54:38.795 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:38.795 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:38.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:54:38.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x26ce7c0) skgpid ospid 17642 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:39.373 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:39.373 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:40.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:40.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:40.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:42.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:42.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:42.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:43.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:43.376 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:54:43.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b8002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:43.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:54:43.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:54:43.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:54:43.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:43.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b9002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:43.747 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:54:43.747 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:54:44.425 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:44.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ba002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:44.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:44.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:44.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:46.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:46.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:46.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:48.379 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:48.379 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:48.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:48.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:48.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:50.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:50.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:50.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:52.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:52.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:52.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:53.061 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:54:53.062 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:54:53.063 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:54:53.063 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699e40) proc(0x269e390) pid(17786) version 11:1:1:4 [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce580, requested num -1 [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a140/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:53.069 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:53.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:53.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:54:53.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26911e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:53.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26911e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:53.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:54:53.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x2699e40) skgpid ospid 17786 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:53.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:53.383 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:54.032 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:54:54.033 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:54:54.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:54:54.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce7c0) proc(0x269e390) pid(17797) version 11:1:1:4 [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce580, requested num -1 [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2690b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:54:54.039 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:54.047 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:54:54.047 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:54:54.047 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690e60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:54:54.047 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:54:54.249 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:54:54.249 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x26ce7c0) skgpid ospid 17797 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:54:54.452 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:54:54.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bb002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:54.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:54.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:54.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:56.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:56.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:56.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:56.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07bc002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:56.930 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:54:56.930 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:54:56.930 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:54:56.930 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:56.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07bd002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:56.936 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:54:56.936 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:54:58.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:54:58.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:54:58.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:54:58.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:54:58.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:54:58.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07be002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:58.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:54:58.998 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:54:58.998 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:54:58.998 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:54:59.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07bf002b) incarnation(174631051) [ CSSD]2013-05-23 14:54:59.005 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:54:59.005 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:55:00.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:00.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:00.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:02.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:02.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:02.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:03.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:03.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:04.474 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:04.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c0002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:04.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:04.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:04.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:05.157 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:55:05.157 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:55:05.158 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:55:05.158 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699e40) proc(0x269e390) pid(17968/17968) version 11:1:1:4 [ CSSD]2013-05-23 14:55:05.174 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:55:05.174 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:55:05.174 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:55:05.174 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:55:06.630 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x2699e40) skgpid 17968 ospid 17968 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:06.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:06.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:06.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:08.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:08.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:08.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:08.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:08.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:09.283 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:55:09.283 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:55:09.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:55:09.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ce7c0) proc(0x269e390) pid(17994) version 11:1:1:4 [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268fa20 with con 0x26ce580, requested num -1 [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a140/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:55:09.300 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:09.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:55:09.307 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268fa20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:55:09.307 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:09.307 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:55:09.509 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 14:55:09.509 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x26ce7c0) skgpid ospid 17994 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:10.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:10.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:10.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:12.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:12.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:13.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:13.396 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:13.396 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:14.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c1002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:14.247 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:55:14.247 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:55:14.247 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:55:14.247 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:14.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c2002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:14.254 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:55:14.254 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:55:14.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:14.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c3002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:14.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:14.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:15.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:16.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:16.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:17.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:18.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:18.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:18.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:18.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:19.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:19.917 [1199044928] >TRACE: clssgmAllocProc: (0x269e390) allocated [ CSSD]2013-05-23 14:55:19.918 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:55:19.918 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e390 - 1,2,3 [ CSSD]2013-05-23 14:55:19.918 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699e40) proc(0x269e390) pid(18094/18094) version 11:1:1:4 [ CSSD]2013-05-23 14:55:19.935 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(1/0x268fa20) [ CSSD]2013-05-23 14:55:19.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 14:55:19.935 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:55:19.935 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 14:55:20.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:20.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:21.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:21.706 [1199044928] >TRACE: clssgmAllocProc: (0x26a9cc0) allocated [ CSSD]2013-05-23 14:55:21.707 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:55:21.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9cc0 - 1,2,3 [ CSSD]2013-05-23 14:55:21.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a3b0) proc(0x26a9cc0) pid(18092/18092) version 11:1:1:4 [ CSSD]2013-05-23 14:55:21.712 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(1/0x26aa240) [ CSSD]2013-05-23 14:55:21.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aa240) [ CSSD]2013-05-23 14:55:21.712 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:55:21.712 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:55:22.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:22.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:23.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:23.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:23.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:24.515 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:24.544 [1199044928] >TRACE: clssgmAllocProc: (0x26de5c0) allocated [ CSSD]2013-05-23 14:55:24.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:55:24.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de5c0 - 1,2,3 [ CSSD]2013-05-23 14:55:24.545 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa940) proc(0x26de5c0) pid(18164) version 11:1:1:4 [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de5c0), client(1/0x26ded30) [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ded30) [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ded30 with con 0x26de490, requested num -1 [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:55:24.562 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:24.571 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ded30) [ CSSD]2013-05-23 14:55:24.571 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ded30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:55:24.571 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26de310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:24.571 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26de310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:55:24.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c4002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:24.773 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de5c0 [ CSSD]2013-05-23 14:55:24.773 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de5c0) con(0x26aa940) skgpid ospid 18164 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:24.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:24.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:25.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:26.739 [1199044928] >TRACE: clssgmAllocProc: (0x26de5c0) allocated [ CSSD]2013-05-23 14:55:26.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:55:26.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de5c0 - 1,2,3 [ CSSD]2013-05-23 14:55:26.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa940) proc(0x26de5c0) pid(18090/18090) version 11:1:1:4 [ CSSD]2013-05-23 14:55:26.757 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de5c0), client(1/0x26deba0) [ CSSD]2013-05-23 14:55:26.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26deba0) [ CSSD]2013-05-23 14:55:26.757 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:55:26.757 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:55:26.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:26.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:27.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:27.853 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269e390), client(2/0x26dedd0) [ CSSD]2013-05-23 14:55:27.853 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26dedd0) [ CSSD]2013-05-23 14:55:27.853 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:55:27.853 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 14:55:28.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:28.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:28.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:28.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:29.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:29.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c5002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:29.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:55:29.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:55:29.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:55:29.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:29.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c6002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:29.512 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:55:29.512 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:55:29.671 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de5c0), client(2/0x267fee0) [ CSSD]2013-05-23 14:55:29.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x267fee0) [ CSSD]2013-05-23 14:55:29.671 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:55:29.671 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 14:55:30.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:30.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:31.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:32.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:32.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:33.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:33.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:33.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:34.542 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:34.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c7002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:34.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:34.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:35.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:36.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:36.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:37.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:38.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:38.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:38.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:38.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:39.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:39.814 [1199044928] >TRACE: clssgmAllocProc: (0x2682020) allocated [ CSSD]2013-05-23 14:55:39.815 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:55:39.815 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682020 - 1,2,3 [ CSSD]2013-05-23 14:55:39.815 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26806b0) proc(0x2682020) pid(18308) version 11:1:1:4 [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2682020), client(1/0x26b4960) [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4960 with con 0x2681f50, requested num -1 [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:55:39.821 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:39.828 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:55:39.828 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:55:39.828 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:39.828 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:55:40.030 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682020 [ CSSD]2013-05-23 14:55:40.030 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682020) con(0x26806b0) skgpid ospid 18308 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:40.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:40.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:41.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:43.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:43.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:43.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:43.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:43.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:44.565 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:44.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c8002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:44.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c9002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:44.758 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:55:44.758 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:55:44.758 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:55:44.758 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:44.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ca002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:44.765 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:55:44.765 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:55:45.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:45.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:45.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:47.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:47.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:47.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:48.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:48.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:49.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:49.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:49.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:51.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:51.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:51.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:53.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:53.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:53.324 [1199044928] >TRACE: clssgmAllocProc: (0x2681e90) allocated [ CSSD]2013-05-23 14:55:53.324 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:55:53.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681e90 - 1,2,3 [ CSSD]2013-05-23 14:55:53.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2680520) proc(0x2681e90) pid(18441) version 11:1:1:4 [ CSSD]2013-05-23 14:55:53.341 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681e90), client(1/0x26b47d0) [ CSSD]2013-05-23 14:55:53.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:55:53.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b47d0 with con 0x2681c40, requested num -1 [ CSSD]2013-05-23 14:55:53.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:53.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4940/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:55:53.342 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:55:53.342 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:53.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:55:53.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b47d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:55:53.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4c40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:53.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4c40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:55:53.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:53.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:53.422 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:53.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681e90 [ CSSD]2013-05-23 14:55:53.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681e90) con(0x2680520) skgpid ospid 18441 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:54.586 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:55:54.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cb002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:55.064 [1199044928] >TRACE: clssgmAllocProc: (0x2681e90) allocated [ CSSD]2013-05-23 14:55:55.065 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:55:55.066 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681e90 - 1,2,3 [ CSSD]2013-05-23 14:55:55.066 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2680520) proc(0x2681e90) pid(18464) version 11:1:1:4 [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681e90), client(1/0x26b47d0) [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b47d0 with con 0x2681c40, requested num -1 [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4940/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:55:55.072 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:55.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:55:55.078 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b47d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:55:55.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4c40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:55:55.078 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4c40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:55:55.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:55.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:55.280 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681e90 [ CSSD]2013-05-23 14:55:55.280 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681e90) con(0x2680520) skgpid ospid 18464 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:55:55.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:57.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:57.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:57.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07cc002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:57.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:55:57.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:55:57.186 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:55:57.186 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:55:57.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07cd002b) incarnation(174631051) [ CSSD]2013-05-23 14:55:57.192 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:55:57.192 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:55:57.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:55:58.424 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:55:58.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:55:59.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:55:59.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:55:59.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:00.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ce002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:00.011 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:00.011 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:00.011 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:56:00.011 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:00.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07cf002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:00.018 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:00.018 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:01.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:01.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:01.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:03.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:03.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:03.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:03.427 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:03.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:04.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:04.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d0002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:05.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:05.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:05.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:07.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:07.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:07.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:07.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:07.430 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:56:09.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:09.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:09.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:10.319 [1199044928] >TRACE: clssgmAllocProc: (0x2682020) allocated [ CSSD]2013-05-23 14:56:10.320 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:56:10.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682020 - 1,2,3 [ CSSD]2013-05-23 14:56:10.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26806b0) proc(0x2682020) pid(18603) version 11:1:1:4 [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2682020), client(1/0x26b4960) [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4960 with con 0x2681f50, requested num -1 [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:56:10.327 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:10.333 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:56:10.333 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:56:10.333 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:10.333 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:56:10.535 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682020 [ CSSD]2013-05-23 14:56:10.535 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682020) con(0x26806b0) skgpid ospid 18603 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:11.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:11.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:11.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:12.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d1002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:12.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:12.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:12.129 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 14:56:12.129 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:12.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d2002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:12.136 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:12.136 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:12.256 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:56:12.257 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:56:12.258 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:56:12.259 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:56:12.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:12.434 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:13.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:13.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:13.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:14.659 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:14.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d3002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:15.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d4002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:15.257 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:15.257 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:15.257 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:56:15.257 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:15.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d5002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:15.264 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:15.264 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:15.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:15.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:15.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:16.105 [1199044928] >TRACE: clssgmAllocProc: (0x2682020) allocated [ CSSD]2013-05-23 14:56:16.106 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:56:16.107 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682020 - 1,2,3 [ CSSD]2013-05-23 14:56:16.107 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26806b0) proc(0x2682020) pid(18711/18711) version 11:1:1:4 [ CSSD]2013-05-23 14:56:16.123 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2682020), client(1/0x26b47d0) [ CSSD]2013-05-23 14:56:16.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:56:16.123 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:56:16.123 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:56:16.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b47d0) [ CSSD]2013-05-23 14:56:16.181 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b47d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:56:16.181 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b47d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:56:16.181 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:56:16.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682020 [ CSSD]2013-05-23 14:56:16.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682020) con(0x26806b0) skgpid 18711 ospid 18711 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:17.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:17.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:17.437 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:17.437 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:17.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:19.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:19.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:19.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:21.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:21.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:21.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:22.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ed5c0) [ CSSD]2013-05-23 14:56:22.212 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ed5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:56:22.212 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ed5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:56:22.213 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 14:56:22.213 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce310 [ CSSD]2013-05-23 14:56:22.213 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce310) con(0x269a090) skgpid 13359 ospid 13359 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:22.220 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ed1a0) [ CSSD]2013-05-23 14:56:22.220 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ed1a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:56:22.220 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ed1a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:56:22.220 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce880 [ CSSD]2013-05-23 14:56:22.227 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce880) con(0x26cda30) skgpid 13361 ospid 13361 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:22.440 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:22.440 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:23.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:23.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:23.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:24.334 [1199044928] >TRACE: clssgmAllocProc: (0x26ce010) allocated [ CSSD]2013-05-23 14:56:24.335 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:56:24.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce010 - 1,2,3 [ CSSD]2013-05-23 14:56:24.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ce010) pid(18757/18757) version 11:1:1:4 [ CSSD]2013-05-23 14:56:24.351 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce010), client(1/0x26cda30) [ CSSD]2013-05-23 14:56:24.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cda30) [ CSSD]2013-05-23 14:56:24.351 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:56:24.351 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 14:56:24.724 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:24.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d6002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:24.881 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ce010), client(2/0x26ef0a0) [ CSSD]2013-05-23 14:56:24.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 14:56:24.881 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:56:24.881 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 14:56:25.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:25.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:25.579 [1199044928] >TRACE: clssgmAllocProc: (0x26edd40) allocated [ CSSD]2013-05-23 14:56:25.580 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:56:25.580 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edd40 - 1,2,3 [ CSSD]2013-05-23 14:56:25.580 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd840) proc(0x26edd40) pid(18779) version 11:1:1:4 [ CSSD]2013-05-23 14:56:25.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:25.586 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edd40), client(1/0x267fe40) [ CSSD]2013-05-23 14:56:25.586 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fe40) [ CSSD]2013-05-23 14:56:25.586 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fe40 with con 0x26ed190, requested num -1 [ CSSD]2013-05-23 14:56:25.587 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:25.587 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680370/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:56:25.587 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:56:25.587 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:25.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fe40) [ CSSD]2013-05-23 14:56:25.592 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fe40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:56:25.593 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680670) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:25.593 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680670) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:56:25.795 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edd40 [ CSSD]2013-05-23 14:56:25.795 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edd40) con(0x26cd840) skgpid ospid 18779 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:26.442 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:26.443 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:56:27.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:27.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:27.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:29.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:29.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:29.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:30.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d7002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:30.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:30.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:30.527 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:56:30.527 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:30.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d8002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:30.533 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:30.534 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:31.446 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:31.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:31.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:31.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:31.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:33.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:33.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:33.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:34.747 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:34.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d9002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:35.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:35.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:35.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:36.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:36.449 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:37.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:37.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:37.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:39.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:39.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:39.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:40.829 [1199044928] >TRACE: clssgmAllocProc: (0x26edd40) allocated [ CSSD]2013-05-23 14:56:40.830 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:56:40.831 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edd40 - 1,2,3 [ CSSD]2013-05-23 14:56:40.831 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cd840) proc(0x26edd40) pid(18925) version 11:1:1:4 [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edd40), client(1/0x267fe40) [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fe40) [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fe40 with con 0x26a6a70, requested num -1 [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26802a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:56:40.837 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:40.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fe40) [ CSSD]2013-05-23 14:56:40.844 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fe40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:56:40.844 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26805a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:40.844 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26805a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:56:41.047 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edd40 [ CSSD]2013-05-23 14:56:41.047 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edd40) con(0x26cd840) skgpid ospid 18925 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:41.453 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:41.453 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:41.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:41.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:41.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:43.185 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26a9cc0), client(2/0x26cd840) [ CSSD]2013-05-23 14:56:43.185 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26cd840) [ CSSD]2013-05-23 14:56:43.185 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:56:43.185 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 14:56:43.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:43.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:43.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:44.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:44.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07da002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:45.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:45.456 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:56:45.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:45.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:45.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:45.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07db002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:45.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:45.775 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:45.775 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:56:45.775 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:45.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07dc002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:45.781 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:45.781 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:47.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:47.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:47.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:49.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:49.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:49.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:50.459 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:50.459 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:51.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:51.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:51.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:53.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:53.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:53.589 [1199044928] >TRACE: clssgmAllocProc: (0x2680050) allocated [ CSSD]2013-05-23 14:56:53.590 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:56:53.590 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2680050 - 1,2,3 [ CSSD]2013-05-23 14:56:53.590 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699fd0) proc(0x2680050) pid(19047) version 11:1:1:4 [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2680050), client(1/0x26805a0) [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26805a0) [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26805a0 with con 0x26edec0, requested num -1 [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:56:53.597 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:53.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26805a0) [ CSSD]2013-05-23 14:56:53.603 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26805a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:56:53.603 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680a10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:53.603 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680a10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:56:53.805 [1199044928] >TRACE: clssgmDeadProc: proc 0x2680050 [ CSSD]2013-05-23 14:56:53.805 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2680050) con(0x2699fd0) skgpid ospid 19047 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:53.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:54.791 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:56:54.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07dd002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:55.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:56:55.462 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:56:55.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:55.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:55.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:56.078 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:56:56.078 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:56:56.079 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:56:56.079 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(19076) version 11:1:1:4 [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:56:56.085 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:56.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:56:56.091 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:56:56.091 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:56:56.091 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:56:56.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:56:56.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 19076 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:56:57.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07de002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:57.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:56:57.443 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:56:57.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:56:57.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:56:57.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07df002b) incarnation(174631051) [ CSSD]2013-05-23 14:56:57.451 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:56:57.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:56:57.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:57.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:57.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:56:59.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:56:59.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:56:59.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:00.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:00.465 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:01.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e0002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:01.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:01.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:01.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:57:01.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:01.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e1002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:01.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:01.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:01.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:01.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:01.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:03.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:03.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:03.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:04.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:04.468 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:57:04.812 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:04.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e2002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:05.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:05.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:05.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:07.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:07.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:07.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:09.147 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:09.148 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:57:09.149 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:09.149 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(19228) version 11:1:1:4 [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:09.155 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:09.162 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:09.162 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:09.162 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:09.162 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:09.365 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:09.365 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 19228 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:09.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:09.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:09.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:09.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:10.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:10.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:57:10.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:57:10.177 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:57:10.177 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:57:10.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e3002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:10.255 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:10.255 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:10.255 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 14:57:10.255 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 14:57:10.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e4002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:10.263 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:10.263 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:10.941 [1199044928] >TRACE: clssgmAllocProc: (0x2680050) allocated [ CSSD]2013-05-23 14:57:10.942 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:57:10.943 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2680050 - 1,2,3 [ CSSD]2013-05-23 14:57:10.943 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699fd0) proc(0x2680050) pid(19272) version 11:1:1:4 [ CSSD]2013-05-23 14:57:11.339 [1199044928] >TRACE: clssgmAllocProc: (0x2681fe0) allocated [ CSSD]2013-05-23 14:57:11.340 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:57:11.341 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681fe0 - 1,2,3 [ CSSD]2013-05-23 14:57:11.341 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2680670) proc(0x2681fe0) pid(19346) version 11:1:1:4 [ CSSD]2013-05-23 14:57:11.354 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681fe0), client(1/0x26b4960) [ CSSD]2013-05-23 14:57:11.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:57:11.354 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4960 with con 0x2681f10, requested num -1 [ CSSD]2013-05-23 14:57:11.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:11.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:11.355 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:11.355 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:11.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4960) [ CSSD]2013-05-23 14:57:11.360 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:11.360 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:11.360 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:11.562 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681fe0 [ CSSD]2013-05-23 14:57:11.562 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681fe0) con(0x2680670) skgpid ospid 19346 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:11.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:11.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:12.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:13.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x2680050 [ CSSD]2013-05-23 14:57:13.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2680050) con(0x2699fd0) skgpid ospid 19272 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:13.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:13.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:14.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:14.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:14.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:14.833 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:14.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e5002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:15.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:15.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:16.069 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:16.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e6002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:16.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:16.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:16.273 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:57:16.273 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:16.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e7002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:16.280 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:16.280 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:17.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:17.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:18.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:19.477 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:19.478 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:19.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:19.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:20.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:21.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:21.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:22.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:23.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:23.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:24.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:24.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:24.481 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:24.860 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:24.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e8002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:25.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:25.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:26.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:26.595 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:26.596 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:57:26.596 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:26.596 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(19737) version 11:1:1:4 [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:26.603 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:26.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:26.609 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:26.609 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:26.609 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:26.812 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:26.812 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 19737 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:27.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:27.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:28.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:29.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:29.484 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:29.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:29.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:30.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:31.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e9002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:31.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:31.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:31.521 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:57:31.521 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:31.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ea002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:31.528 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:31.528 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:31.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:31.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:32.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:33.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:33.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:34.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:34.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:34.487 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:34.881 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:35.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07eb002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:35.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:35.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:36.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:37.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:37.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:38.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:38.634 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:38.635 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:57:38.636 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:38.636 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(19861) version 11:1:1:4 [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:38.642 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:38.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:38.648 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:38.648 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:38.648 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:38.851 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:38.851 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 19861 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:39.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:39.490 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:39.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:39.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:40.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:41.844 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:41.845 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:57:41.845 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:41.845 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(19887) version 11:1:1:4 [ CSSD]2013-05-23 14:57:41.851 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:41.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:41.851 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:41.851 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:41.851 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:41.852 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:41.852 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:41.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:41.858 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:41.858 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:41.858 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:41.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:41.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:42.061 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:42.061 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 19887 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:42.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:43.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:43.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:44.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:44.493 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:44.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:44.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:45.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ec002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:46.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:46.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:46.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:46.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ed002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:46.772 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:46.772 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:46.772 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:57:46.772 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:46.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ee002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:46.778 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:46.778 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:48.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:48.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:48.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:48.496 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:48.496 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:57:50.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:50.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:50.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:52.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:52.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:52.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:53.499 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:53.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:57:53.853 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:53.854 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:57:53.855 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:53.855 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(20027) version 11:1:1:4 [ CSSD]2013-05-23 14:57:53.860 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:53.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:53.860 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:53.860 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:53.860 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:53.861 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:53.861 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:53.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:53.867 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:53.867 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:53.867 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:54.069 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:54.070 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 20027 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:54.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:54.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:54.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:54.923 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:57:55.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ef002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:56.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:56.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:56.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:57.104 [1199044928] >TRACE: clssgmAllocProc: (0x26edf20) allocated [ CSSD]2013-05-23 14:57:57.104 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:57:57.105 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edf20 - 1,2,3 [ CSSD]2013-05-23 14:57:57.105 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26edf20) pid(20064) version 11:1:1:4 [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edf20), client(1/0x2680660) [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680660 with con 0x26801d0, requested num -1 [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26807d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:57:57.112 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:57.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680660) [ CSSD]2013-05-23 14:57:57.120 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:57:57.120 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:57:57.120 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:57:57.322 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edf20 [ CSSD]2013-05-23 14:57:57.322 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edf20) con(0x26a6970) skgpid ospid 20064 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:57:57.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f0002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:57.711 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:57:57.711 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:57:57.711 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:57:57.711 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:57:57.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f1002b) incarnation(174631051) [ CSSD]2013-05-23 14:57:57.718 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:57:57.718 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:57:58.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:57:58.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:57:58.221 [1199044928] >TRACE: clssgmAllocProc: (0x2680050) allocated [ CSSD]2013-05-23 14:57:58.222 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:57:58.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2680050 - 1,2,3 [ CSSD]2013-05-23 14:57:58.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699fd0) proc(0x2680050) pid(20115/20115) version 11:1:1:4 [ CSSD]2013-05-23 14:57:58.228 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2680050), client(1/0x26edf90) [ CSSD]2013-05-23 14:57:58.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26edf90) [ CSSD]2013-05-23 14:57:58.228 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:57:58.228 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 14:57:58.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:57:58.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:57:58.502 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:00.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:00.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:00.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:02.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f2002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:02.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:58:02.041 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:58:02.041 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:58:02.042 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:02.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f3002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:02.049 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:58:02.049 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:58:02.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:02.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:02.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:03.506 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:03.506 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:04.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:04.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:04.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:04.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:05.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f4002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:06.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:06.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:06.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:07.509 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:07.509 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:58:08.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:08.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:08.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:09.686 [1199044928] >TRACE: clssgmAllocProc: (0x26b47e0) allocated [ CSSD]2013-05-23 14:58:09.687 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:58:09.688 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b47e0 - 1,2,3 [ CSSD]2013-05-23 14:58:09.688 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2680c10) proc(0x26b47e0) pid(19986/19986) version 11:1:1:4 [ CSSD]2013-05-23 14:58:09.693 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b47e0), client(1/0x26b4d50) [ CSSD]2013-05-23 14:58:09.693 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b4d50) [ CSSD]2013-05-23 14:58:09.693 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 14:58:09.693 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 14:58:10.202 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b47e0), client(2/0x26b51d0) [ CSSD]2013-05-23 14:58:10.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b51d0) [ CSSD]2013-05-23 14:58:10.202 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 14:58:10.202 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 14:58:10.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:10.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:10.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:12.365 [1199044928] >TRACE: clssgmAllocProc: (0x26b6550) allocated [ CSSD]2013-05-23 14:58:12.366 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:58:12.366 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6550 - 1,2,3 [ CSSD]2013-05-23 14:58:12.366 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b58d0) proc(0x26b6550) pid(20232) version 11:1:1:4 [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6550), client(1/0x26953f0) [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26953f0 with con 0x26b6680, requested num -1 [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695560/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:12.372 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:12.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:12.379 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26953f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:58:12.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2695860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:12.379 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2695860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:12.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:12.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:12.512 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:12.512 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:12.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:12.581 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6550 [ CSSD]2013-05-23 14:58:12.581 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6550) con(0x26b58d0) skgpid ospid 20232 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:14.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:14.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:14.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:14.966 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:15.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f5002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:16.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:16.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:16.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:17.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f6002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:17.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:58:17.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:58:17.311 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:58:17.311 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:17.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f7002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:17.318 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:58:17.318 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:58:17.515 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:17.516 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:18.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:18.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:18.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:20.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:20.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:20.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:22.519 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:22.519 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:22.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:22.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:22.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:24.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:24.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:24.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:24.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:25.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f8002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:26.522 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:26.522 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:58:26.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:26.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:26.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:27.614 [1199044928] >TRACE: clssgmAllocProc: (0x26b6550) allocated [ CSSD]2013-05-23 14:58:27.615 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:58:27.616 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6550 - 1,2,3 [ CSSD]2013-05-23 14:58:27.616 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b58d0) proc(0x26b6550) pid(20405) version 11:1:1:4 [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6550), client(1/0x26953f0) [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26953f0 with con 0x26b6680, requested num -1 [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695560/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:27.621 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:27.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:27.627 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26953f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:58:27.627 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2695860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:27.628 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2695860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:27.830 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6550 [ CSSD]2013-05-23 14:58:27.830 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6550) con(0x26b58d0) skgpid ospid 20405 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:28.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:28.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:28.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:30.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:30.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:30.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:31.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:31.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:32.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f9002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:32.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:58:32.572 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:58:32.572 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:58:32.572 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:32.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07fa002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:32.580 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:58:32.580 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:58:32.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:32.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:32.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:33.273 [1199044928] >TRACE: clssgmAllocProc: (0x26b6550) allocated [ CSSD]2013-05-23 14:58:33.273 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:58:33.274 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6550 - 1,2,3 [ CSSD]2013-05-23 14:58:33.274 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b58d0) proc(0x26b6550) pid(20484) version 11:1:1:4 [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6550), client(1/0x26953f0) [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26953f0 with con 0x26b6680, requested num -1 [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695560/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:33.281 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:33.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:33.287 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26953f0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 14:58:33.287 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2695860) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 14:58:33.287 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x2695860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:33.393 [1199044928] >TRACE: clssgmAllocProc: (0x26958c0) allocated [ CSSD]2013-05-23 14:58:33.394 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:58:33.395 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26958c0 - 1,2,3 [ CSSD]2013-05-23 14:58:33.395 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b6680) proc(0x26958c0) pid(20489) version 11:1:1:4 [ CSSD]2013-05-23 14:58:33.408 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:58:33.409 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:58:33.411 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:58:33.412 [1199044928] >TRACE: clssgmDeadProc: proc 0x26958c0 [ CSSD]2013-05-23 14:58:33.412 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26958c0) con(0x26b6680) skgpid ospid 20489 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:33.489 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6550 [ CSSD]2013-05-23 14:58:33.489 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6550) con(0x26b58d0) skgpid ospid 20484 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:34.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:34.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:34.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:35.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:35.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07fb002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:36.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:36.529 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:36.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:36.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:36.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:38.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:38.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:38.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:40.532 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:40.532 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:58:40.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:40.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:40.820 [1199044928] >TRACE: clssgmAllocProc: (0x2694c10) allocated [ CSSD]2013-05-23 14:58:40.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:40.821 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:58:40.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694c10 - 1,2,3 [ CSSD]2013-05-23 14:58:40.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x2694c10) pid(20556) version 11:1:1:4 [ CSSD]2013-05-23 14:58:41.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694c10 [ CSSD]2013-05-23 14:58:41.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694c10) con(0x26805b0) skgpid ospid 20556 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:42.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:42.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:42.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:42.862 [1199044928] >TRACE: clssgmAllocProc: (0x26b6550) allocated [ CSSD]2013-05-23 14:58:42.863 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:58:42.864 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6550 - 1,2,3 [ CSSD]2013-05-23 14:58:42.864 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b58d0) proc(0x26b6550) pid(20728) version 11:1:1:4 [ CSSD]2013-05-23 14:58:42.870 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6550), client(1/0x26953f0) [ CSSD]2013-05-23 14:58:42.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:42.870 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26953f0 with con 0x26b6680, requested num -1 [ CSSD]2013-05-23 14:58:42.870 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:42.870 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695560/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:58:42.871 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:42.871 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:42.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26953f0) [ CSSD]2013-05-23 14:58:42.877 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26953f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:58:42.877 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2695860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:42.877 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2695860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:43.080 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6550 [ CSSD]2013-05-23 14:58:43.080 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6550) con(0x26b58d0) skgpid ospid 20728 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:44.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:44.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:44.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:45.032 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:45.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07fc002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:45.535 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:45.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:46.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:46.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:46.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:47.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07fd002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:47.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:58:47.821 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:58:47.821 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:58:47.821 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:47.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07fe002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:47.829 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:58:47.829 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:58:48.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:48.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:48.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:50.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:50.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:50.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:50.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:50.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:52.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x261f650) [ CSSD]2013-05-23 14:58:52.254 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x261f650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 14:58:52.254 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x261f650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 14:58:52.254 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2691090) [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2691090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2691090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:58:52.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267c430) skgpid 15119 ospid 15119 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:52.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:52.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:52.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:54.113 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:58:54.114 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:58:54.114 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:58:54.114 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x266f0d0) pid(20844) version 11:1:1:4 [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x26805b0, requested num -1 [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:54.120 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:54.126 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:58:54.126 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:58:54.126 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ecda0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:54.126 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ecda0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:54.329 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:58:54.329 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267d590) skgpid ospid 20844 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:54.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:54.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:54.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:55.055 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:58:55.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ff002b) incarnation(174631051) [ CSSD]2013-05-23 14:58:55.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:55.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:58:56.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:56.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:56.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:57.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0000002c) incarnation(174631051) [ CSSD]2013-05-23 14:58:57.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:58:57.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:58:57.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:58:57.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:57.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0001002c) incarnation(174631051) [ CSSD]2013-05-23 14:58:57.977 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:58:57.977 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:58:58.122 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:58:58.123 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:58:58.123 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:58:58.123 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x266f0d0) pid(20880) version 11:1:1:4 [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x26805b0) [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26805b0) [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26805b0 with con 0x267c430, requested num -1 [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:58:58.129 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:58:58.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26805b0) [ CSSD]2013-05-23 14:58:58.136 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26805b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:58:58.136 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ecda0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:58:58.136 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ecda0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:58:58.338 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:58:58.338 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267d590) skgpid ospid 20880 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:58:58.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:58:58.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:58:58.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:58:59.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:58:59.545 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:59:00.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:00.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:00.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:02.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:02.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:03.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:03.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0002002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:03.078 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:59:03.078 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:59:03.078 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:59:03.078 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:03.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0003002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:03.085 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:59:03.085 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:59:04.548 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:04.548 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:04.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:04.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:05.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:05.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:05.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0004002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:06.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:06.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:07.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:08.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:08.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:09.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:09.551 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:09.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:10.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:10.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:11.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:12.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:12.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:13.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:13.371 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:13.372 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:59:13.373 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:13.373 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x266f0d0) pid(21031) version 11:1:1:4 [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x26805b0, requested num -1 [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:13.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:13.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:13.386 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:59:13.386 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ecda0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:13.386 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ecda0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:13.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:13.589 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x2660e70) skgpid ospid 21031 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:14.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:14.555 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:14.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:14.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:15.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:15.097 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:15.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0005002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:16.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:16.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:17.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:18.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0006002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:18.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:59:18.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:59:18.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:59:18.337 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:18.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0007002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:18.343 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:59:18.343 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:59:18.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:18.558 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:59:19.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:19.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:19.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:19.954 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:19.954 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:59:19.955 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:19.955 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x266f0d0) pid(21137) version 11:1:1:4 [ CSSD]2013-05-23 14:59:20.073 [1199044928] >TRACE: clssgmAllocProc: (0x26945f0) allocated [ CSSD]2013-05-23 14:59:20.074 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:59:20.075 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26945f0 - 1,2,3 [ CSSD]2013-05-23 14:59:20.075 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26945f0) pid(21147) version 11:1:1:4 [ CSSD]2013-05-23 14:59:20.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:59:20.093 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 14:59:20.096 [1199044928] >TRACE: clssgmDeadProc: proc 0x26945f0 [ CSSD]2013-05-23 14:59:20.096 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26945f0) con(0x26805b0) skgpid ospid 21147 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5328/0x261f650) [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5328 (0x261f650) [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x261f650 with con 0x267c430, requested num -1 [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26b5340/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:20.182 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 14:59:20.188 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5328 (0x261f650) [ CSSD]2013-05-23 14:59:20.188 [1199044928] >TRACE: clssgmExitGrock: client 5328 (0x261f650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 14:59:20.188 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 14:59:20.188 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:20.189 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:20.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267d590) skgpid ospid 21137 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:21.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:21.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:21.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:23.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:23.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:23.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:23.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:23.561 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:25.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:25.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:25.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:25.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:25.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0008002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:27.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:27.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:27.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:28.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:28.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:28.622 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:28.622 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:59:28.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:28.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x266f0d0) pid(21207) version 11:1:1:4 [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x267d590, requested num -1 [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:28.629 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:28.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:28.636 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:59:28.636 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:28.636 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:28.838 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:28.838 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26805b0) skgpid ospid 21207 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:29.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:29.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:29.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:31.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:31.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:31.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:33.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:33.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:33.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:33.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:33.568 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:33.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0009002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:33.586 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:59:33.586 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:59:33.586 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:59:33.586 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:33.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000a002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:33.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:59:33.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:59:35.139 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:35.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:35.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:35.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:35.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000b002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:37.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:37.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:37.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:37.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:37.571 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:59:39.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:39.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:39.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:41.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:41.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:41.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:42.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:42.575 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:43.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:43.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:43.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:43.871 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:43.872 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:59:43.873 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:43.873 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c430) proc(0x266f0d0) pid(21349) version 11:1:1:4 [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x26805b0, requested num -1 [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:43.879 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:43.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:43.886 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:59:43.886 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:43.886 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:44.088 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:44.088 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267c430) skgpid ospid 21349 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:45.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:45.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:45.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:45.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000c002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:45.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:47.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:47.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:47.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:47.578 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:47.578 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:48.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000d002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:48.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:59:48.836 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:59:48.836 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:59:48.836 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:48.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000e002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:48.843 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:59:48.843 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:59:49.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:49.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:49.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:51.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:51.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:51.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:52.581 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:52.581 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 14:59:53.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:53.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:53.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:54.371 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:54.372 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 14:59:54.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:54.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x266f0d0) pid(21464) version 11:1:1:4 [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:54.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:54.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 14:59:54.387 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:59:54.387 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:54.387 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:54.589 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:54.589 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26805b0) skgpid ospid 21464 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:55.188 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 14:59:55.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000f002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:55.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:55.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:55.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:56.584 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 14:59:56.584 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 14:59:57.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:57.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:57.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 14:59:58.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0010002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:58.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 14:59:58.235 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 14:59:58.235 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 14:59:58.236 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:58.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0011002c) incarnation(174631051) [ CSSD]2013-05-23 14:59:58.242 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 14:59:58.242 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 14:59:59.123 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 14:59:59.124 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 14:59:59.124 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 14:59:59.124 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x266f0d0) pid(21503) version 11:1:1:4 [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x2660e70) [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x267c430, requested num -1 [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 14:59:59.130 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 14:59:59.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 14:59:59.136 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 14:59:59.136 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 14:59:59.136 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 14:59:59.339 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 14:59:59.339 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26805b0) skgpid ospid 21503 with 0 clients, refcount 0 [ CSSD]2013-05-23 14:59:59.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 14:59:59.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 14:59:59.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:01.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:01.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:01.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:01.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:01.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:03.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:03.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:03.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:04.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0012002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:04.083 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:04.083 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:04.083 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:04.083 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:04.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0013002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:04.091 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:04.091 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:00:04.881 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 15:00:04.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:00:04.883 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 15:00:04.883 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x266f0d0) pid(21777/21777) version 11:1:1:4 [ CSSD]2013-05-23 15:00:04.889 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x2660e70) [ CSSD]2013-05-23 15:00:04.889 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:00:04.889 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:00:04.889 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2660e70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2660e70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 15:00:05.190 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26805b0) skgpid 21777 ospid 21777 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:05.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:05.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0014002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:05.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:05.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:05.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:06.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:06.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:07.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:07.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:07.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:09.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:09.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:09.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:11.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:11.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:11.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:11.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:11.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:13.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:13.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:13.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:14.372 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 15:00:14.372 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:00:14.373 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 15:00:14.373 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c430) proc(0x266f0d0) pid(21853) version 11:1:1:4 [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x266f0d0), client(1/0x267d590) [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d590 with con 0x26805b0, requested num -1 [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:00:14.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:14.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:00:14.386 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:00:14.386 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4f80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:14.386 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4f80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:00:14.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 15:00:14.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267c430) skgpid ospid 21853 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:15.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:15.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0015002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:15.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:15.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:15.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:16.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:16.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:17.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:17.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:17.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:17.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26909f0) [ CSSD]2013-05-23 15:00:17.861 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26909f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:00:17.861 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26909f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:00:17.861 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26901a0) [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26901a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26901a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269e550) [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269e550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269e550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:00:17.864 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:00:17.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x268fdd0 [ CSSD]2013-05-23 15:00:17.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268fdd0) con(0x26eece0) skgpid 16320 ospid 16320 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee2c0) [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee2c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee2c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bcf0 [ CSSD]2013-05-23 15:00:17.868 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bcf0) con(0x26cdae0) skgpid 16322 ospid 16322 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:19.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0016002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:19.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:19.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:19.333 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:19.333 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:19.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0017002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:19.341 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:19.341 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:00:19.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:19.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:19.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:21.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:21.600 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:21.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:21.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:21.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:23.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:23.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:23.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:24.889 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 15:00:24.889 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:00:24.890 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 15:00:24.890 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x266f0d0) pid(21977/21977) version 11:1:1:4 [ CSSD]2013-05-23 15:00:24.896 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 15:00:24.896 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:24.896 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:00:24.896 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:00:25.075 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x266f0d0), client(2/0x26909f0) [ CSSD]2013-05-23 15:00:25.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26909f0) [ CSSD]2013-05-23 15:00:25.075 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:00:25.075 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:00:25.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:25.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0018002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:25.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:25.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:25.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:26.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:26.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:27.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:27.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:27.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:29.622 [1199044928] >TRACE: clssgmAllocProc: (0x267bc20) allocated [ CSSD]2013-05-23 15:00:29.622 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:00:29.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bc20 - 1,2,3 [ CSSD]2013-05-23 15:00:29.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1210) proc(0x267bc20) pid(22017) version 11:1:1:4 [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x267bc20), client(1/0x26e1390) [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1390) [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1390 with con 0x267c430, requested num -1 [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26cdae0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:00:29.629 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:29.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1390) [ CSSD]2013-05-23 15:00:29.636 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1390), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:00:29.636 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26594c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:29.636 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26594c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:00:29.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:29.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:29.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:29.839 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bc20 [ CSSD]2013-05-23 15:00:29.839 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bc20) con(0x26e1210) skgpid ospid 22017 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:31.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:31.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:31.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:31.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:31.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:33.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:33.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:33.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:34.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0019002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:34.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:34.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:34.583 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:34.583 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:34.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001a002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:34.591 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:34.591 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:00:35.290 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:35.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001b002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:35.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:35.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:35.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:36.610 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:36.610 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:37.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:37.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:37.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:38.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26909f0) [ CSSD]2013-05-23 15:00:38.837 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26909f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:00:38.837 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26909f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:00:38.837 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261f650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261f650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 15:00:38.846 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267d590) skgpid 21977 ospid 21977 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:38.857 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:00:38.857 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:00:38.858 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:00:38.858 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(22139/22139) version 11:1:1:4 [ CSSD]2013-05-23 15:00:38.874 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x261f650) [ CSSD]2013-05-23 15:00:38.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:38.874 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:00:38.874 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:00:39.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:39.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:39.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261f650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261f650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:00:40.707 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid 22139 ospid 22139 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:41.614 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:41.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:41.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:41.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:41.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:43.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:43.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:43.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:44.872 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 15:00:44.873 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:00:44.873 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 15:00:44.873 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x266f0d0) pid(22184) version 11:1:1:4 [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ecce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:00:44.879 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:44.886 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:44.886 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:00:44.886 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:44.886 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:00:45.088 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 15:00:45.088 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x26805b0) skgpid ospid 22184 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:45.320 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:45.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001c002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:45.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:45.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:45.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:46.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:46.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:47.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:47.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:47.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:49.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001d002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:49.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:49.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:49.833 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:49.833 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:49.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001e002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:49.840 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:49.840 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:00:49.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:49.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:49.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:51.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:51.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:51.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:51.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:51.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:53.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001f002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:53.912 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:53.912 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:53.912 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:53.912 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:53.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0020002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:53.920 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:53.920 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:00:53.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:53.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:53.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:54.631 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:00:54.632 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:00:54.632 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:00:54.632 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26cea20) pid(22288) version 11:1:1:4 [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x261f650) [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ecce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:00:54.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:54.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:00:54.656 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:00:54.656 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:00:54.656 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:00:54.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:00:54.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x26805b0) skgpid ospid 22288 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:00:55.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:00:55.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0021002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:55.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:55.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:55.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:56.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:00:56.623 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:00:57.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:00:58.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:00:58.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:00:58.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0022002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:58.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:00:58.492 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:00:58.492 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:00:58.492 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:00:58.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0023002c) incarnation(174631051) [ CSSD]2013-05-23 15:00:58.498 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:00:58.498 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:00.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:00.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:00.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:00.130 [1199044928] >TRACE: clssgmAllocProc: (0x266f0d0) allocated [ CSSD]2013-05-23 15:01:00.131 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:01:00.132 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x266f0d0 - 1,2,3 [ CSSD]2013-05-23 15:01:00.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x266f0d0) pid(22344) version 11:1:1:4 [ CSSD]2013-05-23 15:01:00.137 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x266f0d0), client(1/0x261f650) [ CSSD]2013-05-23 15:01:00.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:01:00.137 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x26805b0, requested num -1 [ CSSD]2013-05-23 15:01:00.137 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:00.137 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ecce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:01:00.138 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:01:00.138 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:00.144 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:01:00.144 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:01:00.144 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cea20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:00.144 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cea20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:01:00.346 [1199044928] >TRACE: clssgmDeadProc: proc 0x266f0d0 [ CSSD]2013-05-23 15:01:00.346 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x266f0d0) con(0x267d590) skgpid ospid 22344 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:01.626 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:01.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:02.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:02.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:02.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:04.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:04.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:04.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:05.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0024002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:05.080 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:05.080 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:05.080 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:01:05.080 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:05.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0025002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:05.086 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:05.087 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:05.422 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:05.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0026002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:06.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:06.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:06.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:06.630 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:06.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:08.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:08.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:08.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:10.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:10.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:10.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:11.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:11.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:12.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:12.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:12.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:12.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0027002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:12.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:12.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:12.429 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:01:12.429 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:12.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0028002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:12.436 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:12.437 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:12.562 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:01:12.563 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:01:12.564 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:01:12.564 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:01:14.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:14.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:14.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:15.379 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:01:15.380 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:01:15.380 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:01:15.380 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26cea20) pid(22499) version 11:1:1:4 [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x267d590) [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d590 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ecce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:01:15.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:15.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:01:15.393 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:01:15.393 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x266f0d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:15.393 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x266f0d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:01:15.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:15.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0029002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:15.588 [1199044928] >TRACE: clssgmAllocProc: (0x26cd8f0) allocated [ CSSD]2013-05-23 15:01:15.589 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:01:15.590 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd8f0 - 1,2,3 [ CSSD]2013-05-23 15:01:15.590 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26cd8f0) pid(22544/22544) version 11:1:1:4 [ CSSD]2013-05-23 15:01:15.595 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26cd8f0), client(1/0x267d590) [ CSSD]2013-05-23 15:01:15.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:01:15.595 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:01:15.595 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:01:15.596 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:01:15.596 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x26805b0) skgpid ospid 22499 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd8f0 [ CSSD]2013-05-23 15:01:15.628 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd8f0) con(0x261f650) skgpid 22544 ospid 22544 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:16.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:16.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:16.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:16.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:16.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:18.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:18.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:18.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:20.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:20.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:20.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:20.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002a002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:20.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:20.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:20.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:01:20.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:20.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002b002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:20.334 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:20.335 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:21.639 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:21.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:22.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:22.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:22.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:24.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:24.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:24.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:25.470 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:25.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002c002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:26.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:26.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:26.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:26.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:26.643 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:28.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:28.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:28.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:28.777 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:01:28.778 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:01:28.779 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:01:28.779 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(22595/22595) version 11:1:1:4 [ CSSD]2013-05-23 15:01:28.794 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x267d590) [ CSSD]2013-05-23 15:01:28.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:01:28.794 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:01:28.794 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:01:29.507 [1199044928] >TRACE: clssgmAllocProc: (0x26e1210) allocated [ CSSD]2013-05-23 15:01:29.507 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:01:29.508 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1210 - 1,2,3 [ CSSD]2013-05-23 15:01:29.508 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26909f0) proc(0x26e1210) pid(21933/21933) version 11:1:1:4 [ CSSD]2013-05-23 15:01:29.523 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1210), client(1/0x267c430) [ CSSD]2013-05-23 15:01:29.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c430) [ CSSD]2013-05-23 15:01:29.523 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:01:29.523 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:01:30.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:30.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:30.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:30.643 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd30) allocated [ CSSD]2013-05-23 15:01:30.644 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:01:30.645 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd30 - 1,2,3 [ CSSD]2013-05-23 15:01:30.645 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdd0) proc(0x26cdd30) pid(22675) version 11:1:1:4 [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cdd30), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x2690700, requested num -1 [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5d60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:01:30.651 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:30.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:01:30.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:01:30.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:30.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b6060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:01:30.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd30 [ CSSD]2013-05-23 15:01:30.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd30) con(0x267bdd0) skgpid ospid 22675 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:31.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:31.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:32.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:32.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:32.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:34.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:34.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:34.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:35.518 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:35.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002d002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:35.576 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:35.576 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:35.576 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:01:35.577 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:35.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002e002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:35.583 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:35.583 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:35.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002f002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:36.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:36.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:36.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:36.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:36.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:38.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:38.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:38.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:40.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:40.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:40.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:41.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:41.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:42.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:42.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:42.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:44.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:44.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:44.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:45.543 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:45.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0030002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:45.892 [1199044928] >TRACE: clssgmAllocProc: (0x26e1be0) allocated [ CSSD]2013-05-23 15:01:45.893 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:01:45.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1be0 - 1,2,3 [ CSSD]2013-05-23 15:01:45.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26e1be0) pid(22824) version 11:1:1:4 [ CSSD]2013-05-23 15:01:45.899 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1be0), client(1/0x2659af0) [ CSSD]2013-05-23 15:01:45.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2659af0) [ CSSD]2013-05-23 15:01:45.899 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2659af0 with con 0x2690700, requested num -1 [ CSSD]2013-05-23 15:01:45.899 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:45.899 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5c90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:01:45.900 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:01:45.900 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:45.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2659af0) [ CSSD]2013-05-23 15:01:45.906 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2659af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:01:45.906 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b5f90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:45.906 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b5f90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:01:46.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1be0 [ CSSD]2013-05-23 15:01:46.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1be0) con(0x26805b0) skgpid ospid 22824 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:46.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:46.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:46.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:46.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:46.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:48.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:48.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:48.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:50.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:50.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:50.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:50.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0031002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:50.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:50.839 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:50.839 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:01:50.839 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:50.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0032002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:50.846 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:50.846 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:01:51.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:51.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:01:52.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:52.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:52.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:54.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:54.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:54.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:54.892 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd30) allocated [ CSSD]2013-05-23 15:01:54.892 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:01:54.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd30 - 1,2,3 [ CSSD]2013-05-23 15:01:54.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdd0) proc(0x26cdd30) pid(22921) version 11:1:1:4 [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cdd30), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x2690700, requested num -1 [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5d60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:01:54.899 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:54.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:01:54.906 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:01:54.906 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:01:54.906 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b6060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:01:55.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd30 [ CSSD]2013-05-23 15:01:55.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd30) con(0x267bdd0) skgpid ospid 22921 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:01:55.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:01:55.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:01:55.662 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:01:55.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0033002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:56.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:56.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:56.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:58.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:01:58.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:01:58.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:01:58.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0034002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:58.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:01:58.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:01:58.751 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:01:58.751 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:01:58.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0035002c) incarnation(174631051) [ CSSD]2013-05-23 15:01:58.758 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:01:58.758 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:00.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:00.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:00.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:00.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:00.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:01.152 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd30) allocated [ CSSD]2013-05-23 15:02:01.153 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:02:01.153 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd30 - 1,2,3 [ CSSD]2013-05-23 15:02:01.153 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdd0) proc(0x26cdd30) pid(22983) version 11:1:1:4 [ CSSD]2013-05-23 15:02:01.159 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cdd30), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:02:01.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:02:01.159 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x2690700, requested num -1 [ CSSD]2013-05-23 15:02:01.159 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:01.160 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b5d60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:02:01.160 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:02:01.160 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:01.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:02:01.166 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:02:01.166 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b6060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:01.166 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b6060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:02:01.369 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd30 [ CSSD]2013-05-23 15:02:01.369 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd30) con(0x267bdd0) skgpid ospid 22983 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:02.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:02.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:02.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:03.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0036002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:03.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:03.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:03.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:03.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:03.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0037002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:03.900 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:03.900 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:04.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:04.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:04.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:05.590 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:05.668 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:05.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:05.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0038002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:06.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0039002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:06.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:06.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:06.092 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:06.092 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:06.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003a002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:06.098 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:06.098 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:06.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:06.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:06.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:08.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:08.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:08.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:09.511 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd30) allocated [ CSSD]2013-05-23 15:02:09.512 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:02:09.513 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd30 - 1,2,3 [ CSSD]2013-05-23 15:02:09.513 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdd0) proc(0x26cdd30) pid(23084/23084) version 11:1:1:4 [ CSSD]2013-05-23 15:02:09.518 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cdd30), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:02:09.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:02:09.518 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:02:09.518 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd30 [ CSSD]2013-05-23 15:02:09.537 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd30) con(0x267bdd0) skgpid 23084 ospid 23084 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:10.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:10.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:10.508 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:02:10.508 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:02:10.510 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:02:10.510 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:02:10.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:10.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003b002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:10.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:10.669 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:10.669 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:02:10.670 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:02:10.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:10.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:10.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003c002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:10.676 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:10.676 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:11.481 [1199044928] >TRACE: clssgmAllocProc: (0x26e1be0) allocated [ CSSD]2013-05-23 15:02:11.482 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:02:11.482 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1be0 - 1,2,3 [ CSSD]2013-05-23 15:02:11.482 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26e1be0) pid(23126) version 11:1:1:4 [ CSSD]2013-05-23 15:02:12.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:12.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:12.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:14.138 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1be0 [ CSSD]2013-05-23 15:02:14.138 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1be0) con(0x26805b0) skgpid ospid 23126 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:14.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:14.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:14.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:15.614 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:15.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:15.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:15.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(003d002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:16.401 [1199044928] >TRACE: clssgmAllocProc: (0x26e1be0) allocated [ CSSD]2013-05-23 15:02:16.402 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:02:16.402 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1be0 - 1,2,3 [ CSSD]2013-05-23 15:02:16.402 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26805b0) proc(0x26e1be0) pid(23487) version 11:1:1:4 [ CSSD]2013-05-23 15:02:16.408 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1be0), client(1/0x7f82ac01c9c0) [ CSSD]2013-05-23 15:02:16.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:02:16.408 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01c9c0 with con 0x7f82ac007600, requested num -1 [ CSSD]2013-05-23 15:02:16.409 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:16.409 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:02:16.409 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:02:16.409 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:16.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:02:16.415 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01c9c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:02:16.415 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0191a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:16.415 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0191a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:02:16.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:16.492 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:16.617 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1be0 [ CSSD]2013-05-23 15:02:16.617 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1be0) con(0x26805b0) skgpid ospid 23487 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:16.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:18.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:18.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:18.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:20.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:20.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:20.678 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:20.678 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:20.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:21.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003e002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:21.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:21.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:21.346 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:21.346 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:21.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003f002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:21.352 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:21.352 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:22.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:22.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:22.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:24.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:24.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:24.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:25.637 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:25.682 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:25.682 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:25.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0040002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:26.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:26.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:26.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:28.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:28.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:28.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:30.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:30.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:30.685 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:30.685 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:30.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:31.650 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019590) allocated [ CSSD]2013-05-23 15:02:31.651 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:02:31.652 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019590 - 1,2,3 [ CSSD]2013-05-23 15:02:31.652 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac019590) pid(23647) version 11:1:1:4 [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac019590), client(1/0x7f82ac019ad0) [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019ad0 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006230/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:02:31.658 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:31.664 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:02:31.664 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019ad0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:02:31.664 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006530) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:31.664 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006530) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:02:31.867 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019590 [ CSSD]2013-05-23 15:02:31.867 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019590) con(0x7f82ac018e90) skgpid ospid 23647 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:32.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:32.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:32.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:34.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:34.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:34.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:34.688 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:02:34.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:35.659 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:35.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0041002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:36.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0042002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:36.605 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:36.605 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:36.605 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:36.605 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:36.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0043002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:36.612 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:36.612 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:36.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:36.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:36.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:38.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:38.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:38.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:39.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:39.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:40.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:40.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:40.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:42.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:42.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:42.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:42.949 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1210), client(2/0x7f82ac01c9c0) [ CSSD]2013-05-23 15:02:42.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:02:42.949 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:02:42.949 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:02:44.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:44.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:44.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:44.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:44.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:45.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:45.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0044002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:46.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:46.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:46.902 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0073d0) allocated [ CSSD]2013-05-23 15:02:46.903 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:02:46.903 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0073d0 - 1,2,3 [ CSSD]2013-05-23 15:02:46.903 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007b50) proc(0x7f82ac0073d0) pid(23799) version 11:1:1:4 [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0073d0), client(1/0x7f82ac0063b0) [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0063b0) [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0063b0 with con 0x7f82ac007520, requested num -1 [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006520/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:02:46.909 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:46.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0063b0) [ CSSD]2013-05-23 15:02:46.916 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0063b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:02:46.916 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:46.916 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:02:46.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:47.119 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0073d0 [ CSSD]2013-05-23 15:02:47.119 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0073d0) con(0x7f82ac007b50) skgpid ospid 23799 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:47.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26dedd0) [ CSSD]2013-05-23 15:02:47.878 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26dedd0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:02:47.878 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26dedd0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.878 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:02:47.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x267fee0) [ CSSD]2013-05-23 15:02:47.882 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x267fee0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:02:47.882 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x267fee0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.882 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 15:02:47.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268fa20) [ CSSD]2013-05-23 15:02:47.885 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:02:47.885 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268fa20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.886 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:02:47.886 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e390 [ CSSD]2013-05-23 15:02:47.886 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e390) con(0x2699e40) skgpid 18094 ospid 18094 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:47.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26deba0) [ CSSD]2013-05-23 15:02:47.888 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26deba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:02:47.888 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26deba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.888 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:02:47.888 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de5c0 [ CSSD]2013-05-23 15:02:47.888 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de5c0) con(0x26aa940) skgpid 18090 ospid 18090 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:47.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26cd840) [ CSSD]2013-05-23 15:02:47.897 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26cd840), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:02:47.897 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26cd840), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.897 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aa240) [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aa240), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aa240), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9cc0 [ CSSD]2013-05-23 15:02:47.902 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9cc0) con(0x269a3b0) skgpid 18092 ospid 18092 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:48.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:48.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:48.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:49.698 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:49.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:50.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:50.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:50.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:51.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0045002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:51.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:51.863 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:51.863 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:51.863 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:51.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0046002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:51.869 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:51.869 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0079c0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:52.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:52.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:52.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:53.701 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:53.701 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:02:54.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:54.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:54.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:55.151 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019b90) allocated [ CSSD]2013-05-23 15:02:55.152 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:02:55.153 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019b90 - 1,2,3 [ CSSD]2013-05-23 15:02:55.153 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006fa0) proc(0x7f82ac019b90) pid(23892) version 11:1:1:4 [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac019b90), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:02:55.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:55.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:02:55.165 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:02:55.165 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:02:55.166 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:02:55.368 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019b90 [ CSSD]2013-05-23 15:02:55.368 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019b90) con(0x7f82ac006fa0) skgpid ospid 23892 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:55.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:02:55.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0047002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:56.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:56.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:56.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26edf90) [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26edf90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26edf90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmDeadProc: proc 0x2680050 [ CSSD]2013-05-23 15:02:58.367 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2680050) con(0x2699fd0) skgpid 20115 ospid 20115 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:02:58.420 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:02:58.420 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:02:58.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:02:58.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(23921/23921) version 11:1:1:4 [ CSSD]2013-05-23 15:02:58.436 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 15:02:58.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:02:58.436 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:02:58.436 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:02:58.704 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:02:58.704 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:02:58.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:02:58.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:02:59.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0048002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:59.013 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:02:59.013 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:02:59.013 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:02:59.013 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:02:59.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0049002c) incarnation(174631051) [ CSSD]2013-05-23 15:02:59.019 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:02:59.019 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:02:59.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:00.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:00.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:01.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:02.161 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:02.162 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:03:02.163 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:02.163 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207270) proc(0x7f82b4207a80) pid(23950) version 11:1:1:4 [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42046a0, requested num -1 [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:02.170 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:02.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:03:02.178 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:03:02.178 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:02.178 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:02.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:02.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4207270) skgpid ospid 23950 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:02.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:02.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:03.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:03.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:03.707 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:04.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:04.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:05.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:05.730 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:05.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004a002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:06.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:06.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:07.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:07.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004b002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:07.112 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:03:07.112 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:03:07.112 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:03:07.112 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:07.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004c002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:07.120 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:03:07.120 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:03:08.710 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:08.710 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:08.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:08.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:09.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:10.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:10.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:11.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:12.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:12.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:13.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:13.712 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:13.713 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:14.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:14.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:15.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:15.751 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:15.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004d002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:16.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:16.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:17.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:17.425 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:17.426 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:03:17.427 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:17.427 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e7c0) proc(0x7f82b4207a80) pid(24090) version 11:1:1:4 [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42046a0, requested num -1 [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:17.443 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:17.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:03:17.450 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:03:17.450 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:17.450 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:17.652 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:17.652 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b429e7c0) skgpid ospid 24090 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:17.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:17.715 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:03:18.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:18.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:19.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:21.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:21.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:21.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:22.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004e002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:22.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:03:22.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:03:22.362 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:03:22.362 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:22.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004f002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:22.368 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:03:22.368 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:03:22.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:22.718 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:23.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:23.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:23.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:25.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:25.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:25.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:25.774 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:25.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0050002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:27.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:27.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:27.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:27.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:27.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:28.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:03:28.480 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:03:28.480 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:03:28.480 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:03:28.481 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:03:28.481 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid 23921 ospid 23921 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:28.789 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:28.789 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:28.790 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:28.790 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(24216/24216) version 11:1:1:4 [ CSSD]2013-05-23 15:03:28.806 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:03:28.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:03:28.806 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:03:28.806 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:28.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid 24216 ospid 24216 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:29.052 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:03:29.053 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:29.053 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:03:29.053 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(24224/24224) version 11:1:1:4 [ CSSD]2013-05-23 15:03:29.070 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 15:03:29.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 15:03:29.070 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:03:29.070 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b00d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:03:29.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid 24224 ospid 24224 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:29.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:29.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:29.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:31.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:31.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:31.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:32.686 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:32.687 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:03:32.688 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:32.688 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(24252) version 11:1:1:4 [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:32.695 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:32.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:03:32.703 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:03:32.703 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:32.703 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:32.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:32.725 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:32.906 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:32.906 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 24252 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:33.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:33.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:33.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:33.568 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:03:33.569 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:33.569 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:03:33.569 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(24299) version 11:1:1:4 [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41bf650 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:33.576 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:33.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 15:03:33.582 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:03:33.582 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:03:33.582 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:33.689 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:33.690 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:33.691 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:33.691 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(24304) version 11:1:1:4 [ CSSD]2013-05-23 15:03:33.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:03:33.707 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:03:33.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:03:33.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:33.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 24304 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:33.785 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:03:33.785 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 24299 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:35.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:35.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:35.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:35.805 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:35.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0051002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:36.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:36.727 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:03:37.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:37.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:37.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:37.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0052002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:37.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:03:37.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:03:37.621 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:03:37.621 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:37.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0053002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:37.628 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:03:37.628 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:03:39.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:39.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:39.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:41.241 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:41.241 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:41.242 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:41.242 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(24396) version 11:1:1:4 [ CSSD]2013-05-23 15:03:41.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:41.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:41.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:41.730 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:41.730 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:41.797 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:41.797 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 24396 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:43.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:43.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:43.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:45.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:45.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:45.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:45.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:45.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0054002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:46.734 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:46.734 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:47.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:47.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:47.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:47.938 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:03:47.939 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:03:47.939 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:03:47.939 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(24600) version 11:1:1:4 [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:47.945 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:47.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:03:47.951 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:03:47.951 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:47.951 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:48.154 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:03:48.154 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 24600 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:49.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:49.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:49.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:51.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:51.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:51.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:51.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:51.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:03:52.307 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef0a0) [ CSSD]2013-05-23 15:03:52.307 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef0a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:03:52.307 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef0a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:03:52.307 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cda30) [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cda30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cda30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce010 [ CSSD]2013-05-23 15:03:52.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce010) con(0x26ee500) skgpid 18757 ospid 18757 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:52.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0055002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:52.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:03:52.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:03:52.869 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:03:52.869 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:52.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0056002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:52.876 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:03:52.876 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:03:53.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:53.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:53.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:55.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:55.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:55.416 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:03:55.417 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:03:55.417 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:03:55.417 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(24701) version 11:1:1:4 [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:03:55.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:55.441 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:03:55.441 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:03:55.441 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:03:55.441 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:03:55.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:55.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:03:55.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 24701 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:03:55.740 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:03:55.740 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:03:55.866 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:03:56.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0057002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:57.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:57.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:57.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:03:59.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0058002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:59.268 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:03:59.268 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:03:59.268 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:03:59.268 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:03:59.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0059002c) incarnation(174631051) [ CSSD]2013-05-23 15:03:59.275 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:03:59.275 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:03:59.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:03:59.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:03:59.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:00.743 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:00.743 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:01.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:01.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:01.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:03.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:04:03.187 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:04:03.187 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:04:03.187 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(24774) version 11:1:1:4 [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42b00d0) [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b00d0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:03.193 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:03.199 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b00d0) [ CSSD]2013-05-23 15:04:03.199 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b00d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:04:03.199 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:03.199 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:03.402 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:04:03.402 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 24774 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:03.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:03.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:03.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:05.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:05.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:05.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:05.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:05.746 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:05.892 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:06.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005a002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:07.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:07.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:07.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:08.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005b002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:08.118 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:04:08.118 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:04:08.118 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:04:08.118 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:08.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005c002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:08.124 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:04:08.124 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:04:09.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:09.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:09.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:10.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:10.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:11.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:11.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:11.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:13.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:13.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:13.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:15.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:15.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:15.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:15.752 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:15.752 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:15.917 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:16.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005d002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:17.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:17.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:17.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:18.435 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:04:18.435 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:04:18.436 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:04:18.436 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(24938) version 11:1:1:4 [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:18.443 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:18.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:04:18.449 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:04:18.449 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:18.449 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:18.652 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:04:18.652 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 24938 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:19.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:19.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:19.754 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:19.754 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:04:19.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:20.265 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:04:20.266 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:04:20.266 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:04:20.266 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(24995) version 11:1:1:4 [ CSSD]2013-05-23 15:04:20.388 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:04:20.389 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:04:20.389 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:04:20.389 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(25005) version 11:1:1:4 [ CSSD]2013-05-23 15:04:20.405 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:04:20.408 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:04:20.412 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:04:20.412 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 25005 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5329/0x7f82b429dca0) [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5329 (0x7f82b429dca0) [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3800/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:20.487 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:04:20.493 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5329 (0x7f82b429dca0) [ CSSD]2013-05-23 15:04:20.493 [1199044928] >TRACE: clssgmExitGrock: client 5329 (0x7f82b429dca0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:04:20.493 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7c0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:04:20.493 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:20.494 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:04:20.494 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 24995 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:21.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:21.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:21.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:23.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005e002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:23.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:04:23.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:04:23.378 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:04:23.378 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:23.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005f002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:23.385 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:04:23.385 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:04:23.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:23.597 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:23.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:24.757 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:24.758 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:25.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:25.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:25.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:25.947 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:26.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0060002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:27.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:27.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:27.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:29.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:29.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:29.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:29.761 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:29.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:31.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:31.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:31.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:33.687 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:04:33.688 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:04:33.688 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:04:33.688 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(25123) version 11:1:1:4 [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:33.705 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:33.711 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:04:33.711 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:04:33.711 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:33.711 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:33.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:33.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:33.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:33.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:04:33.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 25123 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:34.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:34.764 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:35.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:35.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:35.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:35.971 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:36.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0061002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:37.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:37.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:37.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:38.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0062002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:38.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:04:38.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:04:38.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:04:38.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:38.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0063002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:38.634 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:04:38.634 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:04:39.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:39.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:39.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:39.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:39.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:41.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:41.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:41.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:43.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:43.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:44.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:44.770 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:44.770 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:45.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:45.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:45.993 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:46.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:46.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0064002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:48.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:48.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:48.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:48.957 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:04:48.958 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:04:48.958 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:04:48.958 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(25267) version 11:1:1:4 [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:48.964 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:48.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:04:48.970 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:04:48.970 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:48.970 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:49.172 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:04:49.172 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 25267 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:49.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:49.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:50.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:50.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:50.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:52.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:52.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:52.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:53.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0065002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:53.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:04:53.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:04:53.883 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:04:53.883 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:53.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0066002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:53.889 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:04:53.890 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:04:54.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:54.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:54.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:54.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:54.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:04:55.685 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:04:55.686 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:04:55.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:04:55.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(25351) version 11:1:1:4 [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:04:55.692 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:55.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:04:55.698 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:04:55.698 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:04:55.699 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:04:55.901 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:04:55.901 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 25351 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:04:56.023 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:04:56.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:56.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:56.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:56.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0067002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:58.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:04:58.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:04:58.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:04:59.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0068002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:59.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:04:59.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:04:59.535 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:04:59.535 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:04:59.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0069002c) incarnation(174631051) [ CSSD]2013-05-23 15:04:59.542 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:04:59.542 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:04:59.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:04:59.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:00.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:00.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:00.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:02.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:02.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:02.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:04.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:04.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:04.204 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:05:04.205 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:05:04.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:05:04.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(25435) version 11:1:1:4 [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:05:04.222 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:04.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 15:05:04.229 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:05:04.229 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:04.229 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:05:04.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:04.431 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:05:04.431 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 25435 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:04.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:04.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:05.158 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:05:05.159 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:05:05.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:05:05.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(25484/25484) version 11:1:1:4 [ CSSD]2013-05-23 15:05:05.175 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207a80), client(1/0x266f1a0) [ CSSD]2013-05-23 15:05:05.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:05:05.175 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:05:05.175 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:05:05.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid 25484 ospid 25484 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:06.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:06.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:06.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:06.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006a002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:06.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:08.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:08.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:08.232 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:05:08.233 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:05:08.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:05:08.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26e1090) pid(23848/23848) version 11:1:1:4 [ CSSD]2013-05-23 15:05:08.239 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26e1090), client(1/0x266f1a0) [ CSSD]2013-05-23 15:05:08.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:05:08.239 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:05:08.239 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:05:08.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:09.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006b002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:09.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:05:09.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:05:09.135 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:05:09.135 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:09.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006c002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:09.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:05:09.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:05:09.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:09.786 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:10.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:10.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:10.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:12.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:12.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:12.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:14.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:14.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:14.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:14.789 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:14.789 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:16.068 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:16.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:16.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:16.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006d002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:16.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:17.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b51d0) [ CSSD]2013-05-23 15:05:17.947 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b51d0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:05:17.947 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b51d0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:05:17.947 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b4d50) [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b4d50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b4d50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b47e0 [ CSSD]2013-05-23 15:05:17.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b47e0) con(0x2680c10) skgpid 19986 ospid 19986 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:18.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:18.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:18.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:19.463 [1199044928] >TRACE: clssgmAllocProc: (0x26cdcb0) allocated [ CSSD]2013-05-23 15:05:19.464 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:05:19.465 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdcb0 - 1,2,3 [ CSSD]2013-05-23 15:05:19.465 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26cdcb0) pid(25605) version 11:1:1:4 [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26cdcb0), client(1/0x2698c30) [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2698c30) [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2698c30 with con 0x26cdc00, requested num -1 [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26594c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:05:19.471 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:19.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2698c30) [ CSSD]2013-05-23 15:05:19.477 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2698c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:05:19.477 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cda80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:19.477 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cda80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:05:19.679 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdcb0 [ CSSD]2013-05-23 15:05:19.679 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdcb0) con(0x26a6970) skgpid ospid 25605 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:19.793 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:19.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:20.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:20.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:20.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:22.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:22.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:22.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:24.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:24.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:24.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006e002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:24.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:05:24.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:05:24.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:05:24.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:24.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006f002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:24.408 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:05:24.408 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:05:24.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:24.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:24.796 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:26.107 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:26.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:26.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:26.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0070002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:26.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:28.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:28.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:28.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:29.799 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:29.800 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:30.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:30.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:30.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:32.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:32.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:32.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:34.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:34.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:34.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:34.723 [1199044928] >TRACE: clssgmAllocProc: (0x26cdcb0) allocated [ CSSD]2013-05-23 15:05:34.723 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:05:34.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdcb0 - 1,2,3 [ CSSD]2013-05-23 15:05:34.724 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x26cdcb0) pid(25745) version 11:1:1:4 [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26cdcb0), client(1/0x2698c30) [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2698c30) [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2698c30 with con 0x26cdc00, requested num -1 [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26594c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:05:34.730 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:34.737 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2698c30) [ CSSD]2013-05-23 15:05:34.737 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2698c30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:05:34.737 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cda80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:34.737 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cda80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:05:34.803 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:34.803 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:34.940 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdcb0 [ CSSD]2013-05-23 15:05:34.940 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdcb0) con(0x26a6970) skgpid ospid 25745 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:36.132 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:36.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0071002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:36.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:36.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:36.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:38.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:38.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:38.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:39.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0072002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:39.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:05:39.656 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:05:39.656 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:05:39.656 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:39.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0073002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:39.663 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:05:39.663 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:05:39.806 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:39.806 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:40.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:40.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:40.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4280f40 [ CSSD]2013-05-23 15:05:40.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4280f40) con(0x7f82b429f120) skgpid 21450 ospid 21450 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:42.059 [1199044928] >TRACE: clssgmAllocProc: (0x26cdd00) allocated [ CSSD]2013-05-23 15:05:42.060 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:05:42.060 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdd00 - 1,2,3 [ CSSD]2013-05-23 15:05:42.060 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6950) proc(0x26cdd00) pid(25588/25588) version 11:1:1:4 [ CSSD]2013-05-23 15:05:42.076 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x26cdd00), client(1/0x2698a90) [ CSSD]2013-05-23 15:05:42.076 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2698a90) [ CSSD]2013-05-23 15:05:42.076 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:05:42.076 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 15:05:42.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:42.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:42.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:44.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:44.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:44.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:44.809 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:44.809 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:46.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:46.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0074002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:46.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:46.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:46.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:48.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:48.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:48.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:49.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:49.813 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:49.973 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bf0) allocated [ CSSD]2013-05-23 15:05:49.973 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:05:49.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bf0 - 1,2,3 [ CSSD]2013-05-23 15:05:49.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698db0) proc(0x26e1bf0) pid(25892) version 11:1:1:4 [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26e1bf0), client(1/0x261c960) [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c960) [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c960 with con 0x261c340, requested num -1 [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:05:49.979 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:49.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c960) [ CSSD]2013-05-23 15:05:49.986 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:05:49.986 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c1c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:49.986 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c1c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:05:50.188 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bf0 [ CSSD]2013-05-23 15:05:50.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bf0) con(0x2698db0) skgpid ospid 25892 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:50.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:50.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:50.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:50.759 [1199044928] >TRACE: clssgmAllocProc: (0x26e1bf0) allocated [ CSSD]2013-05-23 15:05:50.759 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:05:50.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1bf0 - 1,2,3 [ CSSD]2013-05-23 15:05:50.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698db0) proc(0x26e1bf0) pid(25586/25586) version 11:1:1:4 [ CSSD]2013-05-23 15:05:50.776 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26e1bf0), client(1/0x261c340) [ CSSD]2013-05-23 15:05:50.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c340) [ CSSD]2013-05-23 15:05:50.776 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:05:50.776 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:05:52.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:52.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:52.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:54.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:54.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:54.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:54.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:54.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:05:54.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0075002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:54.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:05:54.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:05:54.911 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:05:54.911 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:54.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0076002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:54.918 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:05:54.918 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:05:55.942 [1199044928] >TRACE: clssgmAllocProc: (0x26801d0) allocated [ CSSD]2013-05-23 15:05:55.943 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:05:55.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26801d0 - 1,2,3 [ CSSD]2013-05-23 15:05:55.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26801d0) pid(25969) version 11:1:1:4 [ CSSD]2013-05-23 15:05:55.950 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26801d0), client(1/0x261c7f0) [ CSSD]2013-05-23 15:05:55.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c7f0) [ CSSD]2013-05-23 15:05:55.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c7f0 with con 0x2680120, requested num -1 [ CSSD]2013-05-23 15:05:55.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:55.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edb70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:05:55.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:05:55.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:55.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c7f0) [ CSSD]2013-05-23 15:05:55.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c7f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:05:55.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267ffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:05:55.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267ffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:05:56.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x26801d0 [ CSSD]2013-05-23 15:05:56.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26801d0) con(0x26a67c0) skgpid ospid 25969 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:05:56.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:05:56.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0077002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:56.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:56.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:56.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:58.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:05:58.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:05:58.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:05:59.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0078002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:59.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:05:59.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:05:59.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:05:59.807 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:05:59.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0079002c) incarnation(174631051) [ CSSD]2013-05-23 15:05:59.813 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:05:59.814 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:05:59.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:05:59.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:00.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:00.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:00.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:02.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:02.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:02.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:04.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:04.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:04.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:04.823 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:04.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:05.222 [1199044928] >TRACE: clssgmAllocProc: (0x26802a0) allocated [ CSSD]2013-05-23 15:06:05.223 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:06:05.223 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802a0 - 1,2,3 [ CSSD]2013-05-23 15:06:05.223 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cb10) proc(0x26802a0) pid(26039) version 11:1:1:4 [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26802a0), client(1/0x268bdc0) [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bdc0 with con 0x26801f0, requested num -1 [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:06:05.230 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:05.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:05.236 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bdc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:06:05.236 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edf40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:05.236 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edf40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:06:05.438 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802a0 [ CSSD]2013-05-23 15:06:05.438 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802a0) con(0x261cb10) skgpid ospid 26039 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:06.205 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:06.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007a002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:06.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:06.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:06.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:08.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:08.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:08.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:09.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:09.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:10.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007b002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:10.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:06:10.159 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:06:10.159 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:06:10.159 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:10.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007c002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:10.166 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:06:10.166 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:06:10.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:10.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:10.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:12.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007d002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:12.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:06:12.724 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:06:12.724 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:06:12.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:12.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007e002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:12.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:06:12.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:06:12.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:12.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:12.866 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:06:12.867 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:06:12.868 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:06:12.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:06:12.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:14.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:14.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:14.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:14.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:14.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:16.083 [1199044928] >TRACE: clssgmAllocProc: (0x26802a0) allocated [ CSSD]2013-05-23 15:06:16.083 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:06:16.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802a0 - 1,2,3 [ CSSD]2013-05-23 15:06:16.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cb10) proc(0x26802a0) pid(26157/26157) version 11:1:1:4 [ CSSD]2013-05-23 15:06:16.101 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26802a0), client(1/0x26801f0) [ CSSD]2013-05-23 15:06:16.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26801f0) [ CSSD]2013-05-23 15:06:16.101 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:06:16.101 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:06:16.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26801f0) [ CSSD]2013-05-23 15:06:16.119 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26801f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:06:16.119 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26801f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:06:16.119 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:06:16.120 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802a0 [ CSSD]2013-05-23 15:06:16.120 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802a0) con(0x261cb10) skgpid 26157 ospid 26157 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:16.226 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:16.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007f002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:16.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:16.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:16.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:18.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:18.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:18.832 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:18.832 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:06:18.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:20.472 [1199044928] >TRACE: clssgmAllocProc: (0x26802a0) allocated [ CSSD]2013-05-23 15:06:20.472 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:06:20.473 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802a0 - 1,2,3 [ CSSD]2013-05-23 15:06:20.473 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cb10) proc(0x26802a0) pid(26186) version 11:1:1:4 [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26802a0), client(1/0x268bdc0) [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bdc0 with con 0x26801f0, requested num -1 [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:06:20.479 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:20.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:20.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bdc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:06:20.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edf40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:20.485 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edf40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:06:20.688 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802a0 [ CSSD]2013-05-23 15:06:20.688 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802a0) con(0x261cb10) skgpid ospid 26186 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:20.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:20.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:20.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:22.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:22.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:23.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:23.835 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:23.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:24.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:24.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:25.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:25.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0080002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:25.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:06:25.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:06:25.415 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:06:25.415 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:25.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0081002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:25.422 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:06:25.422 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:06:26.248 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:26.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0082002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:26.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:26.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:27.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:28.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:28.839 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:28.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:28.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:29.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:30.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:30.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:31.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:32.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:32.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:33.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:33.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:33.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:34.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:34.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:35.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:35.731 [1199044928] >TRACE: clssgmAllocProc: (0x26802a0) allocated [ CSSD]2013-05-23 15:06:35.732 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:06:35.732 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802a0 - 1,2,3 [ CSSD]2013-05-23 15:06:35.732 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cb10) proc(0x26802a0) pid(26345) version 11:1:1:4 [ CSSD]2013-05-23 15:06:35.749 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26802a0), client(1/0x268bdc0) [ CSSD]2013-05-23 15:06:35.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:35.749 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bdc0 with con 0x26801f0, requested num -1 [ CSSD]2013-05-23 15:06:35.749 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:35.749 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:06:35.750 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:06:35.750 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:35.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:35.756 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bdc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:06:35.756 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edf40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:35.756 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edf40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:06:35.959 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802a0 [ CSSD]2013-05-23 15:06:35.959 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802a0) con(0x261cb10) skgpid ospid 26345 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:36.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:36.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0083002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:36.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:36.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:37.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:37.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:37.845 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:06:38.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:38.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:39.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:40.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0084002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:40.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:06:40.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:06:40.670 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:06:40.670 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:40.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0085002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:40.678 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:06:40.678 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:06:40.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:40.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:41.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:42.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:42.849 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:42.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:42.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:43.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:44.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:44.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:45.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:46.298 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:46.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0086002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:47.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:47.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:47.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:47.852 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:47.852 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:49.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:49.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:49.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:50.992 [1199044928] >TRACE: clssgmAllocProc: (0x26802a0) allocated [ CSSD]2013-05-23 15:06:50.993 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:06:50.993 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802a0 - 1,2,3 [ CSSD]2013-05-23 15:06:50.993 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cb10) proc(0x26802a0) pid(26506) version 11:1:1:4 [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26802a0), client(1/0x268bdc0) [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268bdc0 with con 0x26801f0, requested num -1 [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:06:50.999 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:51.006 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268bdc0) [ CSSD]2013-05-23 15:06:51.006 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268bdc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:06:51.006 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edf40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:51.006 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edf40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:06:51.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:51.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:51.208 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802a0 [ CSSD]2013-05-23 15:06:51.208 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802a0) con(0x261cb10) skgpid ospid 26506 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:51.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:52.616 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x26cdd00), client(2/0x261c7e0) [ CSSD]2013-05-23 15:06:52.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x261c7e0) [ CSSD]2013-05-23 15:06:52.616 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:06:52.616 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 15:06:52.855 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:52.855 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:06:53.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:53.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:53.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:55.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:55.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:55.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:55.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0087002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:55.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:06:55.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:06:55.932 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:06:55.933 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:55.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0088002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:55.940 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:06:55.940 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:06:56.201 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:06:56.202 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:06:56.203 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:06:56.203 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x268bb70) pid(26583) version 11:1:1:4 [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be50) [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be50 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edf30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:06:56.220 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:06:56.226 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:06:56.226 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:06:56.226 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:06:56.226 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:06:56.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:06:56.429 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:06:56.429 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26a67c0) skgpid ospid 26583 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:06:56.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0089002c) incarnation(174631051) [ CSSD]2013-05-23 15:06:56.858 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:06:56.858 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:06:57.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:57.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:57.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:06:59.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:06:59.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:06:59.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:00.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008a002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:00.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:00.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:00.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:07:00.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:00.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008b002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:00.086 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:00.086 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:01.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:01.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:01.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:01.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:01.861 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:03.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:03.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:03.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:05.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:05.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:05.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:06.250 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:07:06.251 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:07:06.252 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:07:06.252 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26801c0) proc(0x268bb70) pid(26681) version 11:1:1:4 [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be60) [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be60 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edff0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:06.258 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:06.259 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:06.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:06.265 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:06.265 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b3b70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:06.265 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b3b70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:06.353 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:06.467 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:07:06.467 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26801c0) skgpid ospid 26681 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:06.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008c002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:06.864 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:06.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:07.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:07.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:07.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:09.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:09.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:09.480 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:07:09.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:09.481 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:07:09.482 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:07:09.482 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x268bb70) pid(26760) version 11:1:1:4 [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be60) [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be60 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edff0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:09.488 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:09.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:09.494 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:09.494 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b3b70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:09.494 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b3b70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:09.696 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:07:09.696 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26a67c0) skgpid ospid 26760 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:10.898 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:07:10.898 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:07:10.900 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:07:10.900 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:07:10.980 [1199044928] >TRACE: clssgmAllocProc: (0x26802f0) allocated [ CSSD]2013-05-23 15:07:10.980 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:07:10.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26802f0 - 1,2,3 [ CSSD]2013-05-23 15:07:10.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26802f0) pid(26798) version 11:1:1:4 [ CSSD]2013-05-23 15:07:10.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008d002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:10.981 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:10.981 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:10.981 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac018ea0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:07:10.981 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:07:10.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008e002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:10.988 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:10.988 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:11.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008f002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:11.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:11.180 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:11.180 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:07:11.180 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:11.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0090002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:11.186 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:11.186 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:11.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:11.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:11.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:11.867 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:11.867 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:13.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:13.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:13.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:13.690 [1199044928] >TRACE: clssgmDeadProc: proc 0x26802f0 [ CSSD]2013-05-23 15:07:13.690 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26802f0) con(0x26a67c0) skgpid ospid 26798 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:15.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:15.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:15.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:16.383 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:16.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0091002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:16.870 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:16.870 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:17.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:17.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:17.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:19.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:19.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:19.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:20.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:20.873 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:07:21.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:21.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:21.509 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:07:21.510 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:07:21.511 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:07:21.511 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x268bb70) pid(27193) version 11:1:1:4 [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be50) [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be50 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edf30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:21.517 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:21.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:07:21.523 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:21.523 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:21.523 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:21.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:21.726 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:07:21.726 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26a67c0) skgpid ospid 27193 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:23.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:23.433 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:23.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:25.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:25.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:25.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:25.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:25.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:26.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:26.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0092002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:26.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:26.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:26.439 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:07:26.439 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:26.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0093002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:26.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:26.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:26.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0094002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:27.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:27.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:27.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:29.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:29.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:29.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:30.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:30.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:31.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:31.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:31.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:33.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:33.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:33.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:35.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:35.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:35.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:35.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:35.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:36.427 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:36.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0095002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:36.760 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:07:36.761 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:07:36.761 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:07:36.761 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x268bb70) pid(27356) version 11:1:1:4 [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be50) [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be50 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edf30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:36.767 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:36.774 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be50) [ CSSD]2013-05-23 15:07:36.774 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:36.774 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:36.774 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:36.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:07:36.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26a67c0) skgpid ospid 27356 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:37.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:37.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:37.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:38.980 [1199044928] >TRACE: clssgmAllocProc: (0x268bb70) allocated [ CSSD]2013-05-23 15:07:38.981 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:07:38.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bb70 - 1,2,3 [ CSSD]2013-05-23 15:07:38.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26801c0) proc(0x268bb70) pid(27409) version 11:1:1:4 [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268bb70), client(1/0x268be60) [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be60 with con 0x268bac0, requested num -1 [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edff0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:38.988 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:38.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be60) [ CSSD]2013-05-23 15:07:38.995 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:38.995 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b3b70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:38.995 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b3b70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:39.197 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bb70 [ CSSD]2013-05-23 15:07:39.197 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bb70) con(0x26801c0) skgpid ospid 27409 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:39.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:39.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:39.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:39.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:39.885 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:07:41.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:41.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:41.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0096002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:41.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:41.695 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:41.695 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:07:41.695 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:41.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0097002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:41.703 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:41.703 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0191a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:41.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:43.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:43.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:43.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:44.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:44.889 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:45.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:45.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:45.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:46.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:46.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0098002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:47.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:47.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:47.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:47.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:07:47.986 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac01c9c0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:07:47.986 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac01c9c0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:07:47.986 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 15:07:47.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c430) [ CSSD]2013-05-23 15:07:47.990 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c430), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:07:47.990 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c430), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:07:47.991 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:07:47.991 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1210 [ CSSD]2013-05-23 15:07:47.991 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1210) con(0x26909f0) skgpid 21933 ospid 21933 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:49.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:49.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:49.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:49.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:49.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:51.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:51.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:51.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:52.015 [1199044928] >TRACE: clssgmAllocProc: (0x267fa40) allocated [ CSSD]2013-05-23 15:07:52.016 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:07:52.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267fa40 - 1,2,3 [ CSSD]2013-05-23 15:07:52.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4dd0) proc(0x267fa40) pid(27508) version 11:1:1:4 [ CSSD]2013-05-23 15:07:52.022 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267fa40), client(1/0x2680100) [ CSSD]2013-05-23 15:07:52.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680100) [ CSSD]2013-05-23 15:07:52.022 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680100 with con 0x267c3e0, requested num -1 [ CSSD]2013-05-23 15:07:52.022 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:52.022 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:52.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:52.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:52.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680100) [ CSSD]2013-05-23 15:07:52.029 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680100), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:52.029 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:52.029 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:52.231 [1199044928] >TRACE: clssgmDeadProc: proc 0x267fa40 [ CSSD]2013-05-23 15:07:52.231 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267fa40) con(0x26e4dd0) skgpid ospid 27508 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:53.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:53.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:53.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:54.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:54.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:07:55.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:55.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:55.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:56.475 [1199044928] >TRACE: clssgmAllocProc: (0x267fa40) allocated [ CSSD]2013-05-23 15:07:56.475 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:07:56.476 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267fa40 - 1,2,3 [ CSSD]2013-05-23 15:07:56.476 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4dd0) proc(0x267fa40) pid(27573) version 11:1:1:4 [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267fa40), client(1/0x2680100) [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680100) [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680100 with con 0x267c3e0, requested num -1 [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:07:56.482 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:56.489 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680100) [ CSSD]2013-05-23 15:07:56.489 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680100), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:07:56.489 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:07:56.489 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:07:56.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:07:56.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x267fa40 [ CSSD]2013-05-23 15:07:56.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267fa40) con(0x26e4dd0) skgpid ospid 27573 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:07:56.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0099002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:56.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009a002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:56.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:07:56.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:07:56.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:07:56.946 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:07:56.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009b002c) incarnation(174631051) [ CSSD]2013-05-23 15:07:56.952 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:07:56.952 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:07:57.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:57.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:07:57.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:07:58.710 [1199044928] >TRACE: clssgmAllocProc: (0x267fa40) allocated [ CSSD]2013-05-23 15:07:58.710 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:07:58.711 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267fa40 - 1,2,3 [ CSSD]2013-05-23 15:07:58.711 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4dd0) proc(0x267fa40) pid(27605/27605) version 11:1:1:4 [ CSSD]2013-05-23 15:07:58.716 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x267fa40), client(1/0x267ff70) [ CSSD]2013-05-23 15:07:58.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267ff70) [ CSSD]2013-05-23 15:07:58.716 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:07:58.716 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:07:58.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:07:58.898 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:07:59.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:07:59.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:00.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:00.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009c002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:00.341 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:08:00.341 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:08:00.341 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:08:00.341 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:00.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009d002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:00.348 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:08:00.348 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:08:01.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:01.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:02.028 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:03.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:03.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:03.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:03.901 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:04.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:05.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:05.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:06.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:06.550 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:06.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(009e002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:07.264 [1199044928] >TRACE: clssgmAllocProc: (0x26edb70) allocated [ CSSD]2013-05-23 15:08:07.265 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:08:07.266 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edb70 - 1,2,3 [ CSSD]2013-05-23 15:08:07.266 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26edb70) pid(27663) version 11:1:1:4 [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26edb70), client(1/0x267fed0) [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267fed0) [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267fed0 with con 0x2690990, requested num -1 [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677de0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:07.272 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:07.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267fed0) [ CSSD]2013-05-23 15:08:07.279 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267fed0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:08:07.279 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:07.279 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:07.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edb70 [ CSSD]2013-05-23 15:08:07.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edb70) con(0x26a67c0) skgpid ospid 27663 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:07.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:07.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:08.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:08.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:08.905 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:09.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:09.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:10.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:11.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:11.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:12.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:12.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009f002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:12.210 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:08:12.210 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:08:12.210 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:08:12.210 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:12.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a0002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:12.217 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:08:12.217 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:08:13.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:13.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:13.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:13.908 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:14.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:15.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:15.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:16.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:16.581 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:16.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a1002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:17.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:17.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:17.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:17.911 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:08:18.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:19.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:19.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:19.904 [1199044928] >TRACE: clssgmAllocProc: (0x26edb70) allocated [ CSSD]2013-05-23 15:08:19.905 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:19.906 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edb70 - 1,2,3 [ CSSD]2013-05-23 15:08:19.906 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26edb70) pid(27482/27482) version 11:1:1:4 [ CSSD]2013-05-23 15:08:19.912 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26edb70), client(1/0x267fed0) [ CSSD]2013-05-23 15:08:19.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267fed0) [ CSSD]2013-05-23 15:08:19.912 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:08:19.912 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:08:20.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:21.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:21.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:22.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:22.514 [1199044928] >TRACE: clssgmAllocProc: (0x269b540) allocated [ CSSD]2013-05-23 15:08:22.515 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:08:22.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b540 - 1,2,3 [ CSSD]2013-05-23 15:08:22.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26781c0) proc(0x269b540) pid(27824) version 11:1:1:4 [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b540), client(1/0x2679200) [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679200) [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679200 with con 0x269b480, requested num -1 [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680680/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:22.522 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:22.528 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679200) [ CSSD]2013-05-23 15:08:22.528 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679200), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:08:22.528 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:22.528 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:22.731 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b540 [ CSSD]2013-05-23 15:08:22.731 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b540) con(0x26781c0) skgpid ospid 27824 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:22.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:22.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:23.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:23.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:24.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:25.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:25.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:26.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:26.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:26.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a2002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:27.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a3002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:27.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:08:27.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:08:27.465 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:08:27.465 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:27.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a4002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:27.471 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:08:27.471 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:08:27.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:27.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:27.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:27.918 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:28.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:29.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:29.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:30.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:31.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:31.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:32.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:32.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:32.921 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:33.863 [1199044928] >TRACE: clssgmAllocProc: (0x269b540) allocated [ CSSD]2013-05-23 15:08:33.864 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:33.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b540 - 1,2,3 [ CSSD]2013-05-23 15:08:33.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26781c0) proc(0x269b540) pid(27947) version 11:1:1:4 [ CSSD]2013-05-23 15:08:33.872 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b540), client(1/0x2679200) [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679200) [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2679200 with con 0x269b480, requested num -1 [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680680/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:33.873 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:33.879 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679200) [ CSSD]2013-05-23 15:08:33.879 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679200), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:08:33.879 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680980) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:08:33.879 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x2680980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:33.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:33.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:33.986 [1199044928] >TRACE: clssgmAllocProc: (0x2680bf0) allocated [ CSSD]2013-05-23 15:08:33.986 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:33.987 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2680bf0 - 1,2,3 [ CSSD]2013-05-23 15:08:33.987 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee0d0) proc(0x2680bf0) pid(27952) version 11:1:1:4 [ CSSD]2013-05-23 15:08:34.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:08:34.004 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:08:34.006 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:08:34.007 [1199044928] >TRACE: clssgmDeadProc: proc 0x2680bf0 [ CSSD]2013-05-23 15:08:34.007 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2680bf0) con(0x26ee0d0) skgpid ospid 27952 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:34.082 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b540 [ CSSD]2013-05-23 15:08:34.082 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b540) con(0x26781c0) skgpid ospid 27947 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:34.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:35.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:35.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:36.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:36.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:36.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a5002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:36.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:36.923 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:08:37.765 [1199044928] >TRACE: clssgmAllocProc: (0x269b540) allocated [ CSSD]2013-05-23 15:08:37.765 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:08:37.766 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b540 - 1,2,3 [ CSSD]2013-05-23 15:08:37.766 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee280) proc(0x269b540) pid(27978) version 11:1:1:4 [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b540), client(1/0x26edf60) [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26edf60) [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26edf60 with con 0x269b480, requested num -1 [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26805b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:37.772 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:37.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26edf60) [ CSSD]2013-05-23 15:08:37.778 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26edf60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:08:37.778 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26808b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:37.779 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26808b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:37.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:37.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:37.981 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b540 [ CSSD]2013-05-23 15:08:37.981 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b540) con(0x26ee280) skgpid ospid 27978 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:38.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:39.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:39.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:40.377 [1199044928] >TRACE: clssgmAllocProc: (0x269b540) allocated [ CSSD]2013-05-23 15:08:40.378 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:40.378 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b540 - 1,2,3 [ CSSD]2013-05-23 15:08:40.378 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee0d0) proc(0x269b540) pid(28045/28045) version 11:1:1:4 [ CSSD]2013-05-23 15:08:40.384 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b540), client(1/0x2678fc0) [ CSSD]2013-05-23 15:08:40.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678fc0) [ CSSD]2013-05-23 15:08:40.384 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:08:40.384 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:08:40.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:40.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678fc0) [ CSSD]2013-05-23 15:08:40.418 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678fc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:08:40.418 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678fc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:08:40.418 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:08:40.419 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b540 [ CSSD]2013-05-23 15:08:40.419 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b540) con(0x26ee0d0) skgpid 28045 ospid 28045 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:40.556 [1199044928] >TRACE: clssgmAllocProc: (0x269b5a0) allocated [ CSSD]2013-05-23 15:08:40.557 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:40.557 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b5a0 - 1,2,3 [ CSSD]2013-05-23 15:08:40.557 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee0d0) proc(0x269b5a0) pid(28089/28089) version 11:1:1:4 [ CSSD]2013-05-23 15:08:40.574 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b5a0), client(1/0x2679050) [ CSSD]2013-05-23 15:08:40.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2679050) [ CSSD]2013-05-23 15:08:40.574 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:08:40.574 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:08:40.847 [1199044928] >TRACE: clssgmAllocProc: (0x26a9940) allocated [ CSSD]2013-05-23 15:08:40.848 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:40.848 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9940 - 1,2,3 [ CSSD]2013-05-23 15:08:40.848 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678fa0) proc(0x26a9940) pid(28061) version 11:1:1:4 [ CSSD]2013-05-23 15:08:41.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9940 [ CSSD]2013-05-23 15:08:41.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9940) con(0x2678fa0) skgpid ospid 28061 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:41.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:41.926 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:41.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:41.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:42.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:42.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a6002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:42.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:08:42.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:08:42.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:08:42.715 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:42.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a7002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:42.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:08:42.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:08:43.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:43.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:44.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:45.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:45.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:46.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:46.652 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:46.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a8002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:46.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:46.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:48.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:48.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:48.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:50.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:50.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:50.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:51.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:51.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:08:52.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:52.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:52.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:08:52.388 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d590), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:08:52.388 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d590), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:08:52.389 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:08:52.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:08:52.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid 22595 ospid 22595 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:52.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:53.024 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:08:53.025 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:08:53.026 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:08:53.026 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26cea20) pid(28316) version 11:1:1:4 [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x2660e70) [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26808c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:53.032 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:53.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:08:53.039 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:08:53.039 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:53.039 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:53.241 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:08:53.241 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x267d590) skgpid ospid 28316 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:54.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:54.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:54.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:55.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:08:55.936 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:08:56.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:56.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:56.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:08:56.673 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:08:56.735 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:08:56.736 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:08:56.737 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:08:56.737 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26cea20) pid(28377) version 11:1:1:4 [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x2660e70) [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26808c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:08:56.743 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:08:56.744 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:56.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:08:56.750 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:08:56.750 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:08:56.750 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:08:56.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a9002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:56.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:08:56.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2679130) skgpid ospid 28377 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:08:57.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00aa002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:57.966 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:08:57.966 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:08:57.966 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:08:57.966 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:08:57.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ab002c) incarnation(174631051) [ CSSD]2013-05-23 15:08:57.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:08:57.972 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:08:58.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:08:58.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:08:58.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:00.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:00.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:00.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:00.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ac002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:00.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:09:00.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:09:00.601 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:09:00.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:00.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ad002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:00.608 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:09:00.608 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:09:00.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:00.939 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:02.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:02.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:02.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:04.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:04.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:04.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:05.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:05.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:06.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:06.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:06.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:06.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:06.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ae002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:08.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:08.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:08.275 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:09:08.276 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:09:08.277 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:09:08.277 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26cea20) pid(28470) version 11:1:1:4 [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x261f650) [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f650 with con 0x267d590, requested num -1 [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26808c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:08.283 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:08.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f650) [ CSSD]2013-05-23 15:09:08.291 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:09:08.291 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:08.291 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:08.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:09:08.493 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2679130) skgpid ospid 28470 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:08.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:10.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:10.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:10.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:10.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:10.946 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:12.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:12.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:12.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:13.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00af002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:13.221 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:09:13.221 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:09:13.221 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:09:13.221 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:13.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b0002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:13.227 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:09:13.227 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:09:14.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:14.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:14.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:15.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:15.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:16.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:16.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:16.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:16.721 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:16.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b1002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:18.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:18.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:18.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:20.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:20.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:20.583 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:09:20.584 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:20.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:09:20.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(28594) version 11:1:1:4 [ CSSD]2013-05-23 15:09:20.704 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:09:20.705 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:20.705 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:09:20.705 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26a9700) pid(28606) version 11:1:1:4 [ CSSD]2013-05-23 15:09:20.722 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:09:20.725 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:09:20.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:09:20.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x2679130) skgpid ospid 28606 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:20.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5330/0x2679130) [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5330 (0x2679130) [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x2679130 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26808c0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:20.807 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:09:20.814 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5330 (0x2679130) [ CSSD]2013-05-23 15:09:20.814 [1199044928] >TRACE: clssgmExitGrock: client 5330 (0x2679130), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:09:20.814 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:09:20.814 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:20.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:09:20.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid ospid 28594 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:20.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:20.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:22.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:22.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:22.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:23.528 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:09:23.529 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:09:23.530 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:09:23.530 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(28635) version 11:1:1:4 [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x267d590) [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d590 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26808c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:23.536 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:23.542 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d590) [ CSSD]2013-05-23 15:09:23.542 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d590), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:09:23.542 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:23.542 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:23.745 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:09:23.745 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid ospid 28635 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:24.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:24.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:24.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:25.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:25.956 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:26.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:26.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:26.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:26.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:26.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b2002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:28.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:28.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:28.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b3002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:28.479 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:09:28.479 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:09:28.479 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:09:28.479 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:28.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b4002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:28.485 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:09:28.485 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:09:28.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:29.748 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:09:29.749 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:29.749 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:09:29.749 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26cea20) pid(28308/28308) version 11:1:1:4 [ CSSD]2013-05-23 15:09:29.766 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x2660e70) [ CSSD]2013-05-23 15:09:29.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:09:29.766 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:09:29.766 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:09:30.150 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(2/0x2680980) [ CSSD]2013-05-23 15:09:30.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2680980) [ CSSD]2013-05-23 15:09:30.150 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:09:30.150 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 15:09:30.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:30.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:30.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:30.959 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:30.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:32.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:32.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:32.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:34.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:34.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:34.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:34.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:34.962 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:09:36.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:36.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:36.766 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:36.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:37.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b5002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:38.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:38.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:38.779 [1199044928] >TRACE: clssgmAllocProc: (0x2681e90) allocated [ CSSD]2013-05-23 15:09:38.780 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:09:38.780 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681e90 - 1,2,3 [ CSSD]2013-05-23 15:09:38.780 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x2681e90) pid(28802) version 11:1:1:4 [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2681e90), client(1/0x26aa4a0) [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa4a0) [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa4a0 with con 0x26808d0, requested num -1 [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:38.786 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:38.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa4a0) [ CSSD]2013-05-23 15:09:38.793 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa4a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:09:38.793 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:38.794 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:38.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:38.996 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681e90 [ CSSD]2013-05-23 15:09:38.996 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681e90) con(0x2679130) skgpid ospid 28802 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:39.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:39.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:40.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:40.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:40.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:42.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:42.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:42.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:43.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b6002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:43.752 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:09:43.752 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:09:43.752 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:09:43.752 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:43.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b7002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:43.759 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:09:43.759 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:09:44.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:44.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:44.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:44.969 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:44.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:46.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:46.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:46.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:46.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:46.995 [1199044928] >TRACE: clssgmAllocProc: (0x2681f10) allocated [ CSSD]2013-05-23 15:09:46.996 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:46.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681f10 - 1,2,3 [ CSSD]2013-05-23 15:09:46.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26808d0) proc(0x2681f10) pid(28306/28306) version 11:1:1:4 [ CSSD]2013-05-23 15:09:47.002 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2681f10), client(1/0x26aa3e0) [ CSSD]2013-05-23 15:09:47.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aa3e0) [ CSSD]2013-05-23 15:09:47.002 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:09:47.002 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:09:47.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b8002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:47.084 [1199044928] >TRACE: clssgmAllocProc: (0x26de670) allocated [ CSSD]2013-05-23 15:09:47.084 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:47.085 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de670 - 1,2,3 [ CSSD]2013-05-23 15:09:47.085 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26de670) pid(27480/27480) version 11:1:1:4 [ CSSD]2013-05-23 15:09:47.091 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de670), client(1/0x26deb50) [ CSSD]2013-05-23 15:09:47.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26deb50) [ CSSD]2013-05-23 15:09:47.091 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:09:47.091 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:09:47.263 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26de670), client(2/0x26ded80) [ CSSD]2013-05-23 15:09:47.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ded80) [ CSSD]2013-05-23 15:09:47.263 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:09:47.263 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 15:09:47.361 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2681f10), client(2/0x26b4010) [ CSSD]2013-05-23 15:09:47.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b4010) [ CSSD]2013-05-23 15:09:47.361 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:09:47.361 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 15:09:47.602 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26edb70), client(2/0x26b4490) [ CSSD]2013-05-23 15:09:47.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b4490) [ CSSD]2013-05-23 15:09:47.602 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:09:47.602 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 15:09:48.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:48.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:49.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:49.972 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:49.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:50.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:50.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:51.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:52.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:52.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:53.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:53.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:53.975 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:09:54.029 [1199044928] >TRACE: clssgmAllocProc: (0x26b65b0) allocated [ CSSD]2013-05-23 15:09:54.029 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:09:54.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65b0 - 1,2,3 [ CSSD]2013-05-23 15:09:54.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b4c40) proc(0x26b65b0) pid(28943) version 11:1:1:4 [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b65b0), client(1/0x26947b0) [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26b64e0, requested num -1 [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:54.036 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:54.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 15:09:54.043 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:09:54.043 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:54.043 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:54.246 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65b0 [ CSSD]2013-05-23 15:09:54.246 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65b0) con(0x26b4c40) skgpid ospid 28943 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:54.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:54.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:55.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:56.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:56.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:56.814 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:09:56.999 [1199044928] >TRACE: clssgmAllocProc: (0x26b6440) allocated [ CSSD]2013-05-23 15:09:57.000 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:09:57.000 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6440 - 1,2,3 [ CSSD]2013-05-23 15:09:57.000 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b4ad0) proc(0x26b6440) pid(29004) version 11:1:1:4 [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b6440), client(1/0x2694610) [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2694610) [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2694610 with con 0x26b6370, requested num -1 [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694780/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:09:57.017 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:57.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2694610) [ CSSD]2013-05-23 15:09:57.024 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2694610), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:09:57.024 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694a80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:09:57.024 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694a80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:09:57.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:09:57.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b9002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:57.227 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6440 [ CSSD]2013-05-23 15:09:57.227 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6440) con(0x26b4ad0) skgpid ospid 29004 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:09:58.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:09:58.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:09:58.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:09:58.978 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:09:59.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ba002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:59.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:09:59.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:09:59.003 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:09:59.003 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:09:59.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00bb002c) incarnation(174631051) [ CSSD]2013-05-23 15:09:59.010 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:09:59.010 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:09:59.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:00.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:00.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:00.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00bc002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:00.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:10:00.860 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:10:00.860 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:10:00.860 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:00.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00bd002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:00.868 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:10:00.868 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:10:01.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:02.051 [1199044928] >TRACE: clssgmAllocProc: (0x26b65b0) allocated [ CSSD]2013-05-23 15:10:02.051 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:10:02.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65b0 - 1,2,3 [ CSSD]2013-05-23 15:10:02.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b4c40) proc(0x26b65b0) pid(28304/28304) version 11:1:1:4 [ CSSD]2013-05-23 15:10:02.069 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b65b0), client(1/0x2694620) [ CSSD]2013-05-23 15:10:02.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2694620) [ CSSD]2013-05-23 15:10:02.069 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:10:02.069 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:10:02.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:02.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:03.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:03.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:03.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:04.608 [1199044928] >TRACE: clssgmAllocProc: (0x26b9650) allocated [ CSSD]2013-05-23 15:10:04.608 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:10:04.609 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9650 - 1,2,3 [ CSSD]2013-05-23 15:10:04.609 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2694c60) proc(0x26b9650) pid(29277/29277) version 11:1:1:4 [ CSSD]2013-05-23 15:10:04.627 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9650), client(1/0x26b9bd0) [ CSSD]2013-05-23 15:10:04.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9bd0) [ CSSD]2013-05-23 15:10:04.627 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:10:04.627 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:10:04.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:04.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9bd0) [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9bd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9bd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9650 [ CSSD]2013-05-23 15:10:04.899 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9650) con(0x2694c60) skgpid 29277 ospid 29277 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:05.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:06.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:06.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:06.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:07.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00be002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:07.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:08.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:08.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:08.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:08.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:09.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:09.280 [1199044928] >TRACE: clssgmAllocProc: (0x26b9650) allocated [ CSSD]2013-05-23 15:10:09.280 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:10:09.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9650 - 1,2,3 [ CSSD]2013-05-23 15:10:09.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2694c60) proc(0x26b9650) pid(29305) version 11:1:1:4 [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9650), client(1/0x26b9d20) [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9d20) [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9d20 with con 0x2696500, requested num -1 [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9e90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:10:09.288 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:09.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9d20) [ CSSD]2013-05-23 15:10:09.295 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9d20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:10:09.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba190) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:09.295 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba190) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:10:09.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9650 [ CSSD]2013-05-23 15:10:09.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9650) con(0x2694c60) skgpid ospid 29305 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:10.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:10.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:11.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:12.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:12.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:13.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:13.987 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:13.987 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:14.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00bf002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:14.262 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:10:14.262 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:10:14.262 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:10:14.262 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:14.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c0002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:14.268 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:10:14.268 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:10:14.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:14.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:15.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:16.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:16.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:16.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:17.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c1002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:17.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:17.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:17.990 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 15:10:18.037 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26916a0) skgpid 23848 ospid 23848 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:18.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:18.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:19.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:20.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:20.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:21.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:21.670 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:10:21.671 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:10:21.671 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:10:21.671 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b4600) proc(0x26e1090) pid(29444/29444) version 11:1:1:4 [ CSSD]2013-05-23 15:10:21.677 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1090), client(1/0x266f1a0) [ CSSD]2013-05-23 15:10:21.677 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:10:21.677 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:10:21.677 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:10:22.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:22.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:22.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:22.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:23.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:24.536 [1199044928] >TRACE: clssgmAllocProc: (0x2696520) allocated [ CSSD]2013-05-23 15:10:24.537 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:10:24.537 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2696520 - 1,2,3 [ CSSD]2013-05-23 15:10:24.537 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eecd0) proc(0x2696520) pid(29491) version 11:1:1:4 [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2696520), client(1/0x26b9cc0) [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9cc0) [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9cc0 with con 0x2696440, requested num -1 [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9e30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:10:24.554 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:24.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9cc0) [ CSSD]2013-05-23 15:10:24.560 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9cc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:10:24.560 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba130) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:24.561 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba130) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:10:24.763 [1199044928] >TRACE: clssgmDeadProc: proc 0x2696520 [ CSSD]2013-05-23 15:10:24.763 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2696520) con(0x26eecd0) skgpid ospid 29491 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:24.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:24.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:25.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:26.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:26.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:26.884 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:27.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c2002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:27.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:27.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:27.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:28.106 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26e1090), client(2/0x26949e0) [ CSSD]2013-05-23 15:10:28.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26949e0) [ CSSD]2013-05-23 15:10:28.106 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:10:28.106 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:10:28.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:28.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:29.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c3002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:29.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:10:29.523 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:10:29.523 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:10:29.523 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:29.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c4002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:29.529 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:10:29.529 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:10:29.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:30.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:30.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:31.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:32.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:32.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:32.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:32.999 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:33.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:34.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:34.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:35.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:36.908 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:36.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:36.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:37.002 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:37.002 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:10:37.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c5002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:37.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:39.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:39.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:39.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:39.796 [1199044928] >TRACE: clssgmAllocProc: (0x26b9980) allocated [ CSSD]2013-05-23 15:10:39.796 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:10:39.797 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9980 - 1,2,3 [ CSSD]2013-05-23 15:10:39.797 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2695020) proc(0x26b9980) pid(29657) version 11:1:1:4 [ CSSD]2013-05-23 15:10:39.803 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9980), client(1/0x26ba120) [ CSSD]2013-05-23 15:10:39.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ba120) [ CSSD]2013-05-23 15:10:39.803 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ba120 with con 0x26b98a0, requested num -1 [ CSSD]2013-05-23 15:10:39.803 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:39.803 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:10:39.804 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:10:39.804 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:39.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ba120) [ CSSD]2013-05-23 15:10:39.810 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ba120), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:10:39.810 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:39.811 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:10:40.013 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9980 [ CSSD]2013-05-23 15:10:40.013 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9980) con(0x2695020) skgpid ospid 29657 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:41.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:41.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:41.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:42.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:42.005 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:43.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:43.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:43.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:44.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c6002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:44.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:10:44.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:10:44.779 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:10:44.779 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:44.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c7002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:44.786 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:10:44.786 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:10:45.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:45.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:45.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:46.968 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:47.007 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:47.008 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:47.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:47.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:47.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c8002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:47.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:47.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2679050) [ CSSD]2013-05-23 15:10:47.917 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2679050), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:10:47.917 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2679050), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:10:47.917 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:10:47.917 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b5a0 [ CSSD]2013-05-23 15:10:47.917 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b5a0) con(0x26ee0d0) skgpid 28089 ospid 28089 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:49.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:49.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:49.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:51.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:51.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:51.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:52.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:52.011 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:53.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:53.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:53.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:54.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c9002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:54.251 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:10:54.251 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:10:54.251 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:10:54.251 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:54.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ca002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:54.259 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:10:54.259 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:10:55.046 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:10:55.047 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:10:55.047 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:10:55.047 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(29796) version 11:1:1:4 [ CSSD]2013-05-23 15:10:55.053 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:10:55.053 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:10:55.053 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x2694930, requested num -1 [ CSSD]2013-05-23 15:10:55.053 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:55.053 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:10:55.054 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:10:55.054 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:55.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:10:55.061 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:10:55.061 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:55.061 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:10:55.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:55.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:55.263 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:10:55.263 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid ospid 29796 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:55.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:57.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:10:57.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:10:57.014 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:10:57.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:57.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:57.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cb002c) incarnation(174631051) [ CSSD]2013-05-23 15:10:57.266 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:10:57.267 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:10:57.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:10:57.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(29852) version 11:1:1:4 [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x2694930, requested num -1 [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:10:57.274 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:10:57.281 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:10:57.281 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:10:57.281 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:10:57.281 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:10:57.483 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:10:57.483 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid ospid 29852 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:10:57.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:10:59.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:10:59.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:10:59.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:00.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00cc002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:00.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:00.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:00.034 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:11:00.034 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:00.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00cd002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:00.040 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:00.040 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:01.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ce002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:01.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:01.135 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:01.135 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:11:01.135 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:01.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00cf002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:01.142 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:01.142 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:01.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:01.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:01.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:02.017 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:02.017 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:03.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:03.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:03.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:05.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:05.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:05.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:07.020 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:07.020 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:07.024 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:07.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d0002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:07.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:07.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:07.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:09.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:09.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:09.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:10.296 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 15:11:10.297 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:11:10.298 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 15:11:10.298 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b680) proc(0x269b300) pid(29949) version 11:1:1:4 [ CSSD]2013-05-23 15:11:10.304 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b300), client(1/0x2678d10) [ CSSD]2013-05-23 15:11:10.304 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d10) [ CSSD]2013-05-23 15:11:10.304 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d10 with con 0x2678940, requested num -1 [ CSSD]2013-05-23 15:11:10.304 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:10.304 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:11:10.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:11:10.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:10.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d10) [ CSSD]2013-05-23 15:11:10.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:11:10.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:10.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:11:10.514 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 15:11:10.514 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x269b680) skgpid ospid 29949 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:11.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:11.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:11.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:12.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:12.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:13.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d1002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:13.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:13.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:13.020 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:11:13.020 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:13.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d2002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:13.026 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:13.026 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:13.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:11:13.162 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:11:13.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:11:13.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:11:13.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:13.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:14.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:15.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d3002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:15.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:15.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:15.294 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:11:15.294 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:15.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d4002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:15.302 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:15.302 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:15.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:15.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:15.594 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:11:15.595 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:11:15.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:11:15.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(30022/30022) version 11:1:1:4 [ CSSD]2013-05-23 15:11:15.601 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:11:15.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:15.601 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:11:15.601 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:11:15.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid 30022 ospid 30022 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:16.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:17.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:17.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:17.045 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:17.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d5002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:17.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:17.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:18.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:19.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:19.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:20.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:21.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:21.029 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:11:21.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:21.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:22.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:23.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:23.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:24.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:25.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:25.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:25.557 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:11:25.558 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:11:25.558 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:11:25.558 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(30115) version 11:1:1:4 [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x2694930, requested num -1 [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:11:25.565 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:25.572 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:25.572 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:11:25.572 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:25.572 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:11:25.774 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:11:25.774 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid ospid 30115 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:26.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:26.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:26.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:27.066 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:27.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d6002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:27.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:27.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:28.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:29.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:29.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:30.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:30.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d7002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:30.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:30.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:30.547 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:11:30.547 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:30.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d8002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:30.554 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:30.554 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:31.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:31.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:31.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:31.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:32.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:33.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:33.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:34.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:35.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:35.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:36.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:36.038 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:36.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:37.088 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:37.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d9002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:37.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:37.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:38.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:39.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:39.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:40.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:40.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:11:40.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:40.808 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 15:11:40.809 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:11:40.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 15:11:40.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edeb0) proc(0x269b300) pid(30261) version 11:1:1:4 [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b300), client(1/0x2678d10) [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d10) [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d10 with con 0x2678940, requested num -1 [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:11:40.816 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:40.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d10) [ CSSD]2013-05-23 15:11:40.823 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:11:40.823 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:40.823 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:11:41.026 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 15:11:41.026 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26edeb0) skgpid ospid 30261 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:41.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:41.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:42.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:43.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:43.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:44.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:45.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:45.044 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:45.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:45.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:45.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00da002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:45.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:11:45.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:11:45.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:11:45.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:45.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00db002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:45.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:11:45.820 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:11:46.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:47.108 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:47.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00dc002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:47.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:47.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:48.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:49.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:49.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:50.047 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:50.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:50.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:51.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:51.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:52.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:53.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:53.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:54.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:55.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:11:55.051 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:11:55.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:55.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:56.058 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:11:56.059 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:11:56.059 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:11:56.059 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(30401) version 11:1:1:4 [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x2694930, requested num -1 [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:11:56.065 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:11:56.066 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:56.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:56.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:11:56.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:56.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:11:56.274 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:11:56.275 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid ospid 30401 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:56.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:57.138 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:11:57.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00dd002c) incarnation(174631051) [ CSSD]2013-05-23 15:11:57.527 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:11:57.527 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:11:57.528 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:11:57.528 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(30456) version 11:1:1:4 [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x2694930, requested num -1 [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694c20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:11:57.535 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:11:57.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:11:57.541 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:11:57.541 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694f20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:11:57.542 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694f20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:11:57.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:57.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:11:57.744 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:11:57.744 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid ospid 30456 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:11:58.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:11:59.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:11:59.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:00.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:00.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:00.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:01.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00de002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:01.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:01.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:01.068 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:01.068 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:01.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00df002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:01.076 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:01.076 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:01.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e0002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:01.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:01.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:01.389 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:01.389 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:01.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e1002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:01.396 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:01.396 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:01.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:01.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:02.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:03.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:03.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:04.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e2002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:04.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:04.243 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:04.243 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:04.243 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:04.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e3002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:04.251 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:04.251 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:04.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:05.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:05.058 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:05.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:05.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:06.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:07.162 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:07.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e4002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:07.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:07.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:08.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:09.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:09.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:10.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:10.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:10.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:11.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:12:11.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:12:11.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:12:11.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:12:11.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e5002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:11.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:11.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:11.302 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:12:11.302 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:12:11.303 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 15:12:11.304 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:12:11.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 15:12:11.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edeb0) proc(0x269b300) pid(30626) version 11:1:1:4 [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b300), client(1/0x2678c60) [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678c60) [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678c60 with con 0x26916a0, requested num -1 [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694b50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:12:11.309 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:11.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e6002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:11.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:11.310 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:11.315 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678c60) [ CSSD]2013-05-23 15:12:11.315 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:12:11.315 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694e50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:11.315 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:12:11.357 [1199044928] >TRACE: clssgmAllocProc: (0x26b9650) allocated [ CSSD]2013-05-23 15:12:11.357 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:12:11.358 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9650 - 1,2,3 [ CSSD]2013-05-23 15:12:11.358 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26b9650) pid(30591) version 11:1:1:4 [ CSSD]2013-05-23 15:12:11.518 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 15:12:11.518 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26edeb0) skgpid ospid 30626 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:11.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:11.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:12.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:13.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:13.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:13.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9650 [ CSSD]2013-05-23 15:12:13.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9650) con(0x26916a0) skgpid ospid 30591 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:14.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:15.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:15.064 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:15.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:15.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:16.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e7002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:16.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:16.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:16.323 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:16.323 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:16.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e8002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:16.330 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:16.330 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:16.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:17.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:17.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e9002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:17.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:17.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:18.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:19.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:19.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:20.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:20.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:20.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:21.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:21.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:22.061 [1199044928] >TRACE: clssgmAllocProc: (0x26787c0) allocated [ CSSD]2013-05-23 15:12:22.062 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:12:22.063 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787c0 - 1,2,3 [ CSSD]2013-05-23 15:12:22.063 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26787c0) pid(29442/29442) version 11:1:1:4 [ CSSD]2013-05-23 15:12:22.068 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(1/0x2678d00) [ CSSD]2013-05-23 15:12:22.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:12:22.068 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:12:22.068 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:12:22.088 [1199044928] >TRACE: clssgmAllocProc: (0x26b98b0) allocated [ CSSD]2013-05-23 15:12:22.089 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:12:22.089 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b98b0 - 1,2,3 [ CSSD]2013-05-23 15:12:22.089 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b98b0) pid(30095/30095) version 11:1:1:4 [ CSSD]2013-05-23 15:12:22.094 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b98b0), client(1/0x26b9df0) [ CSSD]2013-05-23 15:12:22.094 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9df0) [ CSSD]2013-05-23 15:12:22.094 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:12:22.094 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:12:22.184 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b98b0), client(2/0x26ba280) [ CSSD]2013-05-23 15:12:22.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ba280) [ CSSD]2013-05-23 15:12:22.184 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:12:22.184 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 15:12:22.638 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26787c0), client(2/0x26ba710) [ CSSD]2013-05-23 15:12:22.638 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ba710) [ CSSD]2013-05-23 15:12:22.638 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:12:22.638 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 15:12:22.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:24.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:24.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:24.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:25.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:25.070 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:26.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:26.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:26.551 [1199044928] >TRACE: clssgmAllocProc: (0x26bf2a0) allocated [ CSSD]2013-05-23 15:12:26.552 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:12:26.552 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bf2a0 - 1,2,3 [ CSSD]2013-05-23 15:12:26.552 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26badf0) proc(0x26bf2a0) pid(31044) version 11:1:1:4 [ CSSD]2013-05-23 15:12:26.568 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26bf2a0), client(1/0x26bf8c0) [ CSSD]2013-05-23 15:12:26.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bf8c0) [ CSSD]2013-05-23 15:12:26.568 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bf8c0 with con 0x26bbbf0, requested num -1 [ CSSD]2013-05-23 15:12:26.568 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:26.568 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bfa30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:12:26.569 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:12:26.569 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:26.575 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bf8c0) [ CSSD]2013-05-23 15:12:26.575 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bf8c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:12:26.575 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bfd30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:26.575 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bfd30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:12:26.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:26.777 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bf2a0 [ CSSD]2013-05-23 15:12:26.777 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bf2a0) con(0x26badf0) skgpid ospid 31044 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:27.217 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:27.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ea002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:28.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:28.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:28.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:30.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:30.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:30.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:30.073 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:30.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:31.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00eb002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:31.592 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:31.592 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:31.592 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:31.593 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:31.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ec002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:31.599 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:31.599 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:32.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:32.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:32.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:34.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:34.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:34.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:35.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:35.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:36.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:36.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:36.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:37.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:37.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ed002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:38.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:38.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:38.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:40.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:40.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:40.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:40.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:40.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:41.811 [1199044928] >TRACE: clssgmAllocProc: (0x26bf2a0) allocated [ CSSD]2013-05-23 15:12:41.812 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:12:41.812 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bf2a0 - 1,2,3 [ CSSD]2013-05-23 15:12:41.812 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26baf00) proc(0x26bf2a0) pid(31214) version 11:1:1:4 [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26bf2a0), client(1/0x26bf990) [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bf990) [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bf990 with con 0x26bbd00, requested num -1 [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bfb00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:12:41.829 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:41.836 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bf990) [ CSSD]2013-05-23 15:12:41.836 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bf990), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:12:41.836 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bfe00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:41.836 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bfe00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:12:42.039 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bf2a0 [ CSSD]2013-05-23 15:12:42.039 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bf2a0) con(0x26baf00) skgpid ospid 31214 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:42.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:42.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:42.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:44.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:44.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:44.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:45.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:45.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:46.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:46.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:46.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ee002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:46.848 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:12:46.848 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:12:46.848 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:12:46.848 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:46.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ef002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:46.856 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:12:46.856 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:12:46.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:47.263 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:47.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f0002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:48.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c340) [ CSSD]2013-05-23 15:12:48.063 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c340), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:12:48.063 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c340), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:12:48.064 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:12:48.064 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1bf0 [ CSSD]2013-05-23 15:12:48.064 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1bf0) con(0x2698db0) skgpid 25586 ospid 25586 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:48.071 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x261c7e0) [ CSSD]2013-05-23 15:12:48.071 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x261c7e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:12:48.071 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x261c7e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:12:48.071 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 15:12:48.077 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2698a90) [ CSSD]2013-05-23 15:12:48.077 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2698a90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:12:48.077 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2698a90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:12:48.077 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:12:48.078 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdd00 [ CSSD]2013-05-23 15:12:48.078 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdd00) con(0x26a6950) skgpid 25588 ospid 25588 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:48.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:48.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:48.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:48.971 [1199044928] >TRACE: clssgmAllocProc: (0x267be70) allocated [ CSSD]2013-05-23 15:12:48.972 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:12:48.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267be70 - 1,2,3 [ CSSD]2013-05-23 15:12:48.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6930) proc(0x267be70) pid(31309/31309) version 11:1:1:4 [ CSSD]2013-05-23 15:12:48.978 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x267be70), client(1/0x261cb10) [ CSSD]2013-05-23 15:12:48.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:12:48.978 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:12:48.978 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:12:50.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:50.087 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:50.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:50.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:50.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:52.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:52.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:52.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:54.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:54.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:54.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:55.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:12:55.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:12:56.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:56.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:56.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:57.079 [1199044928] >TRACE: clssgmAllocProc: (0x2659af0) allocated [ CSSD]2013-05-23 15:12:57.080 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:12:57.080 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659af0 - 1,2,3 [ CSSD]2013-05-23 15:12:57.080 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698d10) proc(0x2659af0) pid(31365) version 11:1:1:4 [ CSSD]2013-05-23 15:12:57.086 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2659af0), client(1/0x26cddd0) [ CSSD]2013-05-23 15:12:57.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 15:12:57.086 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cddd0 with con 0x2650360, requested num -1 [ CSSD]2013-05-23 15:12:57.086 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:57.086 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba880/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:12:57.087 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:12:57.087 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:57.094 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 15:12:57.094 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cddd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:12:57.094 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650a30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:57.094 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650a30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:12:57.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:12:57.296 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659af0 [ CSSD]2013-05-23 15:12:57.296 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659af0) con(0x2698d10) skgpid ospid 31365 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:57.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f1002c) incarnation(174631051) [ CSSD]2013-05-23 15:12:57.790 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 15:12:57.791 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:12:57.791 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 15:12:57.791 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698b80) proc(0x26501e0) pid(31414) version 11:1:1:4 [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26501e0), client(1/0x26cddd0) [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cddd0 with con 0x2659af0, requested num -1 [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26508e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:12:57.798 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:12:57.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cddd0) [ CSSD]2013-05-23 15:12:57.805 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cddd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:12:57.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:12:57.805 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:12:58.007 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 15:12:58.007 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x2698b80) skgpid ospid 31414 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:58.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:12:58.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267ff70) [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267ff70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267ff70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x267fa40 [ CSSD]2013-05-23 15:12:58.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267fa40) con(0x26e4dd0) skgpid 27605 ospid 27605 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:12:59.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:12:59.102 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x267be70), client(2/0x26cddd0) [ CSSD]2013-05-23 15:12:59.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26cddd0) [ CSSD]2013-05-23 15:12:59.102 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:12:59.102 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 31 [ CSSD]2013-05-23 15:13:00.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:00.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:00.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:00.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:01.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:01.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f2002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:01.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:13:01.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:13:01.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:13:01.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:01.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f3002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:01.656 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:13:01.656 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:13:02.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f4002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:02.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:13:02.102 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:13:02.102 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:13:02.102 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:02.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f5002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:02.110 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:13:02.110 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:13:02.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:02.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:03.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:04.094 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:04.095 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:13:04.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:04.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:05.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:06.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:06.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:07.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:07.310 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:07.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f6002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:08.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:08.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:09.097 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:09.097 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:09.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:10.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:10.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:11.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:12.336 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:12.337 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:13:12.338 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:12.338 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f40) proc(0x2698b80) pid(31533) version 11:1:1:4 [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26598a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:12.344 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:12.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:12.351 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:13:12.351 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1410) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:12.351 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:12.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:12.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:12.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:12.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x2690f40) skgpid ospid 31533 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:13.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:14.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:14.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:14.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:14.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:15.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:16.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:16.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:17.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:17.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:17.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f7002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:17.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:13:17.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:13:17.362 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:13:17.362 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:17.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f8002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:17.369 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:13:17.369 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:13:17.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f9002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:18.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:18.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:19.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:19.104 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:19.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:20.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:20.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:21.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:22.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:22.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:23.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:23.107 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:13:23.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:24.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:24.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:25.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:26.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:26.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:27.354 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:27.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:27.587 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:27.588 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:13:27.589 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:27.589 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f40) proc(0x2698b80) pid(31723) version 11:1:1:4 [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26598a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:27.595 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:27.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:27.602 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:13:27.602 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1410) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:27.602 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:27.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fa002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:27.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:27.805 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x2690f40) skgpid ospid 31723 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:28.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:28.111 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:28.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:28.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:29.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:30.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:30.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:31.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:32.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fb002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:32.622 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:13:32.622 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:13:32.622 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:13:32.622 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:32.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fc002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:32.629 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:13:32.629 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:13:32.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:32.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:33.114 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:33.114 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:33.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:34.158 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:34.159 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:13:34.159 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:34.159 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f40) proc(0x2698b80) pid(31809) version 11:1:1:4 [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26598a0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:34.166 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:34.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:34.173 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:13:34.173 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1410) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:13:34.173 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26e1410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:34.280 [1199044928] >TRACE: clssgmAllocProc: (0x26e1b90) allocated [ CSSD]2013-05-23 15:13:34.281 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:13:34.282 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1b90 - 1,2,3 [ CSSD]2013-05-23 15:13:34.282 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fbd0) proc(0x26e1b90) pid(31814) version 11:1:1:4 [ CSSD]2013-05-23 15:13:34.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:13:34.300 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:13:34.303 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:13:34.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1b90 [ CSSD]2013-05-23 15:13:34.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1b90) con(0x267fbd0) skgpid ospid 31814 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:34.375 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:34.375 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x2690f40) skgpid ospid 31809 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:34.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:34.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:35.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:36.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:36.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:37.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:37.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:37.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fd002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:38.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:38.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:38.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:38.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:39.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:40.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:40.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:41.227 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:41.228 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:13:41.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:41.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2698b80) pid(31875) version 11:1:1:4 [ CSSD]2013-05-23 15:13:41.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:41.776 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:41.776 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e4ea0) skgpid ospid 31875 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:42.120 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:42.120 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:13:42.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:42.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:42.849 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:42.849 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:13:42.850 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:42.850 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2698b80) pid(32026) version 11:1:1:4 [ CSSD]2013-05-23 15:13:42.856 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:13:42.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:42.856 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:13:42.856 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:42.856 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26597e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:13:42.857 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:42.857 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:42.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:42.863 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:13:42.863 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:42.863 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:43.065 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:43.065 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e4ea0) skgpid ospid 32026 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:43.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:44.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:44.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:45.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:46.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:46.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:47.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:47.124 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:47.410 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:47.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fe002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:47.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:47.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ff002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:47.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:13:47.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:13:47.872 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:13:47.872 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:47.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0100002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:47.878 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:13:47.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:13:48.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:48.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:49.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:50.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:50.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:51.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:52.127 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:52.127 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:52.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:52.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:53.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:54.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:54.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:55.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:56.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:56.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:57.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:13:57.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:13:57.431 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:13:57.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0101002c) incarnation(174631051) [ CSSD]2013-05-23 15:13:57.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:13:58.050 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:13:58.051 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:13:58.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:13:58.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f40) proc(0x2698b80) pid(32195) version 11:1:1:4 [ CSSD]2013-05-23 15:13:58.057 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:13:58.057 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:58.057 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:13:58.058 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:58.058 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26598a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:13:58.058 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:58.058 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:58.064 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:58.064 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:13:58.064 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1410) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:58.064 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1410) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:58.099 [1199044928] >TRACE: clssgmAllocProc: (0x26e1b90) allocated [ CSSD]2013-05-23 15:13:58.100 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:13:58.100 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1b90 - 1,2,3 [ CSSD]2013-05-23 15:13:58.100 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fbd0) proc(0x26e1b90) pid(32207) version 11:1:1:4 [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1b90), client(1/0x267c440) [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x26ce610, requested num -1 [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bac70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:13:58.106 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:13:58.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:13:58.112 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:13:58.112 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2659b50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:13:58.113 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2659b50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:13:58.267 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:13:58.267 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x2690f40) skgpid ospid 32195 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:58.315 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1b90 [ CSSD]2013-05-23 15:13:58.315 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1b90) con(0x267fbd0) skgpid ospid 32207 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:13:58.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:13:58.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:13:59.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:00.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:00.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:01.133 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:01.133 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:14:01.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:01.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0102002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:01.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:14:01.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:14:01.911 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:14:01.911 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:01.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0103002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:01.918 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:14:01.919 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:14:02.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:02.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:03.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0104002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:03.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:14:03.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:14:03.120 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:14:03.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:03.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0105002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:03.127 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:14:03.127 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:14:03.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:04.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:04.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:06.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:06.137 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:06.137 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:07.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:07.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:07.458 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:07.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0106002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:08.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:09.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:09.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:10.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:11.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:11.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:11.140 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:11.140 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:12.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:13.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:13.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:13.349 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:14:13.350 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:14:13.350 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:14:13.350 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2698b80) pid(32357) version 11:1:1:4 [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26597e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:13.357 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:13.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:14:13.363 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:14:13.363 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:13.363 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:13.565 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:14:13.565 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e4ea0) skgpid ospid 32357 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:14.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:15.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:15.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:16.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:16.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:16.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:17.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:17.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:17.478 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:17.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0107002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:18.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:18.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0108002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:18.370 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:14:18.370 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:14:18.370 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:14:18.370 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:18.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0109002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:18.377 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:14:18.377 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:14:19.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:19.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:20.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:20.146 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:14:20.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:20.889 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:14:20.890 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:14:20.890 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:14:20.890 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f40) proc(0x2698b80) pid(32470) version 11:1:1:4 [ CSSD]2013-05-23 15:14:21.019 [1199044928] >TRACE: clssgmAllocProc: (0x2650440) allocated [ CSSD]2013-05-23 15:14:21.020 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:14:21.020 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650440 - 1,2,3 [ CSSD]2013-05-23 15:14:21.020 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26598a0) proc(0x2650440) pid(32480) version 11:1:1:4 [ CSSD]2013-05-23 15:14:21.038 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:14:21.040 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:14:21.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650440 [ CSSD]2013-05-23 15:14:21.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650440) con(0x26598a0) skgpid ospid 32480 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5331/0x2680040) [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5331 (0x2680040) [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x2680040 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26597e0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:21.123 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:14:21.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5331 (0x2680040) [ CSSD]2013-05-23 15:14:21.129 [1199044928] >TRACE: clssgmExitGrock: client 5331 (0x2680040), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:14:21.129 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:14:21.129 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:21.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:21.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:14:21.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:21.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x2690f40) skgpid ospid 32470 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:21.922 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:14:21.923 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:14:21.923 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:14:21.923 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2698b80) pid(32160/32160) version 11:1:1:4 [ CSSD]2013-05-23 15:14:21.939 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:14:21.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:14:21.939 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:14:21.939 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:14:22.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:23.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:23.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:24.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:25.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:25.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:25.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:25.149 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:26.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:27.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:27.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:27.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:27.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010a002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:28.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:28.604 [1199044928] >TRACE: clssgmAllocProc: (0x26ce450) allocated [ CSSD]2013-05-23 15:14:28.604 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:14:28.605 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce450 - 1,2,3 [ CSSD]2013-05-23 15:14:28.605 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1410) proc(0x26ce450) pid(32540) version 11:1:1:4 [ CSSD]2013-05-23 15:14:28.612 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ce450), client(1/0x2680040) [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680040 with con 0x26ce370, requested num -1 [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26baae0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:28.613 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:28.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:28.620 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680040), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:14:28.620 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bade0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:28.620 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bade0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:28.823 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce450 [ CSSD]2013-05-23 15:14:28.823 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce450) con(0x26e1410) skgpid ospid 32540 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:29.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:29.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:30.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:30.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:30.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:31.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:31.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:32.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:33.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:33.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:33.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010b002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:33.630 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:14:33.630 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:14:33.630 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:14:33.630 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:33.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010c002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:33.636 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:14:33.636 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:14:34.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:35.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:35.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:35.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:35.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:36.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:37.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:37.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:37.522 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:37.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010d002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:38.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:39.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:39.159 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:14:39.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:39.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:40.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:41.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:41.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:42.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:43.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:43.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:43.867 [1199044928] >TRACE: clssgmAllocProc: (0x26ce450) allocated [ CSSD]2013-05-23 15:14:43.867 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:14:43.868 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce450 - 1,2,3 [ CSSD]2013-05-23 15:14:43.868 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fc90) proc(0x26ce450) pid(32684) version 11:1:1:4 [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ce450), client(1/0x2680040) [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680040 with con 0x26ce370, requested num -1 [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26baae0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:43.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:43.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:43.882 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680040), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:14:43.882 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce1f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:43.882 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce1f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:44.085 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce450 [ CSSD]2013-05-23 15:14:44.085 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce450) con(0x267fc90) skgpid ospid 32684 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:44.162 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:44.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:44.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:45.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:45.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:46.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:47.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:47.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:47.544 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:47.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010e002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:48.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:48.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010f002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:48.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:14:48.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:14:48.888 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:14:48.888 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:48.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0110002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:48.895 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:14:48.895 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:14:49.165 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:49.166 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:49.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:49.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:50.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:51.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:51.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:52.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:53.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:53.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:54.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:54.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:14:54.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:55.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:55.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:56.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:57.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:57.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:14:57.565 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:14:57.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0111002c) incarnation(174631051) [ CSSD]2013-05-23 15:14:58.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:14:58.171 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:14:58.309 [1199044928] >TRACE: clssgmAllocProc: (0x26ce450) allocated [ CSSD]2013-05-23 15:14:58.309 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:14:58.310 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce450 - 1,2,3 [ CSSD]2013-05-23 15:14:58.310 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fc90) proc(0x26ce450) pid(352) version 11:1:1:4 [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ce450), client(1/0x2680040) [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680040 with con 0x26ce370, requested num -1 [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26baae0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:58.316 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:58.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:58.324 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680040), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:14:58.324 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce1f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:58.324 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce1f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:58.526 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce450 [ CSSD]2013-05-23 15:14:58.526 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce450) con(0x267fc90) skgpid ospid 352 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:58.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:14:59.120 [1199044928] >TRACE: clssgmAllocProc: (0x26e1ae0) allocated [ CSSD]2013-05-23 15:14:59.121 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:14:59.121 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1ae0 - 1,2,3 [ CSSD]2013-05-23 15:14:59.121 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659650) proc(0x26e1ae0) pid(372) version 11:1:1:4 [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26e1ae0), client(1/0x2680040) [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680040 with con 0x2650360, requested num -1 [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26508d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:14:59.127 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:14:59.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:14:59.134 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680040), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:14:59.134 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269d820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:14:59.134 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269d820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:14:59.336 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1ae0 [ CSSD]2013-05-23 15:14:59.336 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1ae0) con(0x2659650) skgpid ospid 372 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:14:59.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:14:59.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:00.054 [1199044928] >TRACE: clssgmAllocProc: (0x26ce450) allocated [ CSSD]2013-05-23 15:15:00.055 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:15:00.055 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce450 - 1,2,3 [ CSSD]2013-05-23 15:15:00.055 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fc90) proc(0x26ce450) pid(32158/32158) version 11:1:1:4 [ CSSD]2013-05-23 15:15:00.061 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ce450), client(1/0x2680040) [ CSSD]2013-05-23 15:15:00.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:15:00.061 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:15:00.061 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:15:00.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:01.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:01.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:02.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0112002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:02.166 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:15:02.166 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:15:02.166 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:15:02.167 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:02.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0113002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:02.173 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:15:02.173 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:15:02.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:03.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:03.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:03.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:03.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:04.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0114002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:04.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:15:04.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:15:04.145 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:15:04.145 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:04.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0115002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:04.151 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:15:04.151 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:15:04.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:05.068 [1199044928] >TRACE: clssgmAllocProc: (0x26bbc00) allocated [ CSSD]2013-05-23 15:15:05.069 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:15:05.070 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bbc00 - 1,2,3 [ CSSD]2013-05-23 15:15:05.070 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26baf20) proc(0x26bbc00) pid(461/461) version 11:1:1:4 [ CSSD]2013-05-23 15:15:05.085 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26bbc00), client(1/0x26bf890) [ CSSD]2013-05-23 15:15:05.085 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bf890) [ CSSD]2013-05-23 15:15:05.085 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:15:05.086 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bf890) [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bf890), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bf890), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bbc00 [ CSSD]2013-05-23 15:15:05.394 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bbc00) con(0x26baf20) skgpid 461 ospid 461 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:05.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:05.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:06.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:07.584 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:07.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:07.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:07.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0116002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:08.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:08.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:08.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:09.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:09.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:10.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:11.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:11.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:12.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:13.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:13.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:13.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:13.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:14.370 [1199044928] >TRACE: clssgmAllocProc: (0x26bf2a0) allocated [ CSSD]2013-05-23 15:15:14.371 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:15:14.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bf2a0 - 1,2,3 [ CSSD]2013-05-23 15:15:14.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bae10) proc(0x26bf2a0) pid(519) version 11:1:1:4 [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26bf2a0), client(1/0x26bf8e0) [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bf8e0) [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bf8e0 with con 0x26bbc10, requested num -1 [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bfa50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:15:14.377 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:14.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bf8e0) [ CSSD]2013-05-23 15:15:14.384 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bf8e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:15:14.384 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bfd50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:14.384 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bfd50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:15:14.586 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bf2a0 [ CSSD]2013-05-23 15:15:14.586 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bf2a0) con(0x26bae10) skgpid ospid 519 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:14.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:15.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:15.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:16.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:17.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:17.185 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:15:17.607 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:17.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:17.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:17.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0117002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:18.107 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ded80) [ CSSD]2013-05-23 15:15:18.107 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ded80), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:15:18.107 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ded80), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:15:18.107 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 30 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b4490) [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b4490), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b4490), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26deb50) [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26deb50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26deb50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de670 [ CSSD]2013-05-23 15:15:18.111 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de670) con(0x2679130) skgpid 27480 ospid 27480 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:18.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267fed0) [ CSSD]2013-05-23 15:15:18.114 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267fed0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:15:18.114 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267fed0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:15:18.114 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:15:18.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edb70 [ CSSD]2013-05-23 15:15:18.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edb70) con(0x26a67c0) skgpid 27482 ospid 27482 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:18.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:19.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0118002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:19.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:15:19.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:15:19.393 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:15:19.393 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:19.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0119002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:19.401 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:15:19.401 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:15:19.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:19.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:20.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:21.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:21.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:22.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:22.189 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:22.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:23.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:23.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:24.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:25.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:25.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:26.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:27.193 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:27.193 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:27.655 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:27.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:27.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:27.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011a002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:28.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:29.620 [1199044928] >TRACE: clssgmAllocProc: (0x26ce760) allocated [ CSSD]2013-05-23 15:15:29.621 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:15:29.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce760 - 1,2,3 [ CSSD]2013-05-23 15:15:29.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26ce760) pid(684) version 11:1:1:4 [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ce760), client(1/0x26b4560) [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4560 with con 0x26aa320, requested num -1 [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268fde0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:15:29.627 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:29.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:29.634 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:15:29.634 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26900e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:29.634 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26900e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:15:29.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:29.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:29.836 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce760 [ CSSD]2013-05-23 15:15:29.836 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce760) con(0x2679130) skgpid ospid 684 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:30.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:31.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:31.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:32.196 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:32.196 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:32.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:33.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:33.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:34.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011b002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:34.642 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:15:34.642 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:15:34.642 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:15:34.642 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:34.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011c002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:34.649 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:15:34.649 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:15:34.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:35.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:35.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:36.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:37.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:37.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:37.675 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:37.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011d002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:38.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:38.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:38.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:40.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:40.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:41.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:42.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:42.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:42.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:42.203 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:43.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:44.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:44.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:44.870 [1199044928] >TRACE: clssgmAllocProc: (0x26ce760) allocated [ CSSD]2013-05-23 15:15:44.871 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:15:44.872 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce760 - 1,2,3 [ CSSD]2013-05-23 15:15:44.872 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26ce760) pid(856) version 11:1:1:4 [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ce760), client(1/0x26b4560) [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4560 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268fde0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:15:44.878 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:44.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:44.885 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:15:44.885 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:44.885 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:15:45.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:45.087 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce760 [ CSSD]2013-05-23 15:15:45.087 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce760) con(0x2679130) skgpid ospid 856 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:46.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:46.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:47.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:47.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:47.206 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:47.696 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:47.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011e002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:48.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:48.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:49.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:49.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011f002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:49.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:15:49.888 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:15:49.888 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:15:49.888 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:49.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0120002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:49.894 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:15:49.894 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:15:50.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:50.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:51.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:51.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:51.209 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:15:52.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:52.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:53.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:54.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:54.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:55.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:56.212 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:15:56.213 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:15:56.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:56.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:57.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:15:57.718 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:15:58.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0121002c) incarnation(174631051) [ CSSD]2013-05-23 15:15:58.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:15:58.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:15:58.561 [1199044928] >TRACE: clssgmAllocProc: (0x26ce760) allocated [ CSSD]2013-05-23 15:15:58.562 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:15:58.563 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce760 - 1,2,3 [ CSSD]2013-05-23 15:15:58.563 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26ce760) pid(984) version 11:1:1:4 [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ce760), client(1/0x26b4560) [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4560 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268fde0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:15:58.569 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:15:58.576 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:15:58.576 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:15:58.576 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:15:58.576 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:15:58.779 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce760 [ CSSD]2013-05-23 15:15:58.779 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce760) con(0x2679130) skgpid ospid 984 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:15:59.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:00.123 [1199044928] >TRACE: clssgmAllocProc: (0x26b3e90) allocated [ CSSD]2013-05-23 15:16:00.124 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:16:00.124 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b3e90 - 1,2,3 [ CSSD]2013-05-23 15:16:00.124 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26b3e90) pid(1013) version 11:1:1:4 [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b3e90), client(1/0x26b4560) [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b4560 with con 0x267fec0, requested num -1 [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b590/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:16:00.141 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:00.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:16:00.148 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b4560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:16:00.148 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:00.148 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:16:00.350 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b3e90 [ CSSD]2013-05-23 15:16:00.350 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b3e90) con(0x2679130) skgpid ospid 1013 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:00.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:00.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:01.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:01.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:01.216 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:02.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0122002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:02.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:02.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:02.416 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:16:02.416 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:02.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0123002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:02.422 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:02.422 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:02.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:02.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:03.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:03.389 [1199044928] >TRACE: clssgmAllocProc: (0x26ce760) allocated [ CSSD]2013-05-23 15:16:03.390 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:16:03.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ce760 - 1,2,3 [ CSSD]2013-05-23 15:16:03.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2679130) proc(0x26ce760) pid(604/604) version 11:1:1:4 [ CSSD]2013-05-23 15:16:03.396 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ce760), client(1/0x26b4560) [ CSSD]2013-05-23 15:16:03.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:16:03.396 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:16:03.396 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:16:04.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:04.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:05.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0124002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:05.143 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:05.143 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:05.143 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:16:05.143 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:05.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0125002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:05.148 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:05.148 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:05.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:06.219 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:06.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:06.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:06.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:07.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:07.741 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:08.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0126002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:08.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:08.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:09.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:10.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:10.222 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:16:10.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:10.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:11.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:12.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:12.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:13.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:13.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0127002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:13.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:13.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:13.317 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:16:13.317 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:13.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0128002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:13.323 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:13.324 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:13.441 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:16:13.442 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:16:13.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:16:13.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:16:14.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:14.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:15.225 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:15.225 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:15.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:15.384 [1199044928] >TRACE: clssgmAllocProc: (0x26bb830) allocated [ CSSD]2013-05-23 15:16:15.385 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:16:15.385 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb830 - 1,2,3 [ CSSD]2013-05-23 15:16:15.385 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690120) proc(0x26bb830) pid(1170) version 11:1:1:4 [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26bb830), client(1/0x26cdc60) [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdc60 with con 0x26bb750, requested num -1 [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dd400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:16:15.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:15.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:16:15.398 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdc60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:16:15.398 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:15.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:16:15.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb830 [ CSSD]2013-05-23 15:16:15.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb830) con(0x2690120) skgpid ospid 1170 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:16.053 [1199044928] >TRACE: clssgmAllocProc: (0x26dd550) allocated [ CSSD]2013-05-23 15:16:16.054 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:16:16.055 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dd550 - 1,2,3 [ CSSD]2013-05-23 15:16:16.055 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bbb10) proc(0x26dd550) pid(1213/1213) version 11:1:1:4 [ CSSD]2013-05-23 15:16:16.061 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dd550), client(1/0x26cdc60) [ CSSD]2013-05-23 15:16:16.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:16:16.061 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:16:16.061 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cdc60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cdc60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dd550 [ CSSD]2013-05-23 15:16:16.083 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dd550) con(0x26bbb10) skgpid 1213 ospid 1213 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:16.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:16.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:17.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:17.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:18.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0129002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:18.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:18.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:19.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:20.228 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:20.228 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:20.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012a002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:20.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:20.393 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:20.393 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:16:20.393 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:20.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012b002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:20.399 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:20.399 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:20.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:20.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:20.770 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ce760), client(2/0x267fed0) [ CSSD]2013-05-23 15:16:20.770 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x267fed0) [ CSSD]2013-05-23 15:16:20.770 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:16:20.770 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 15:16:21.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2694620) [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2694620), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2694620), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2680980) [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2680980), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2680980), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 15:16:22.498 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65b0 [ CSSD]2013-05-23 15:16:22.499 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65b0) con(0x26b4c40) skgpid 28304 ospid 28304 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:22.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b4010) [ CSSD]2013-05-23 15:16:22.503 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b4010), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:16:22.503 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b4010), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:16:22.503 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2660e70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2660e70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:16:22.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x267d590) skgpid 28308 ospid 28308 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aa3e0) [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aa3e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aa3e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681f10 [ CSSD]2013-05-23 15:16:22.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681f10) con(0x26808d0) skgpid 28306 ospid 28306 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:22.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:22.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:23.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:24.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:24.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:25.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:25.232 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:25.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:26.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:26.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:27.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:27.816 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:28.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012c002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:28.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:28.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:29.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:29.235 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:16:29.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:30.644 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:16:30.644 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:16:30.645 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:16:30.645 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(1364) version 11:1:1:4 [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x26aae70) [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aae70 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2693820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:16:30.651 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:30.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:16:30.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aae70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:16:30.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:30.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:16:30.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:30.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:30.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:16:30.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid ospid 1364 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:31.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:32.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:32.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:33.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:34.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:34.238 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:34.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:34.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:35.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:35.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012d002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:35.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:35.639 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:35.639 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:16:35.639 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:35.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012e002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:35.646 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:35.646 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:36.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:36.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:37.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:37.839 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:38.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012f002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:38.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:38.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:39.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:39.241 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:39.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:40.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:40.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:41.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:42.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:42.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:43.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:44.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:44.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:44.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:44.830 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:45.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:45.894 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:16:45.895 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:16:45.896 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:16:45.896 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26cea20) pid(1505) version 11:1:1:4 [ CSSD]2013-05-23 15:16:45.902 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x26aae70) [ CSSD]2013-05-23 15:16:45.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:16:45.902 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aae70 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:16:45.902 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:45.902 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2693820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:16:45.903 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:16:45.903 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:45.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:16:45.909 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aae70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:16:45.909 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:45.909 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b4010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:16:46.112 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:16:46.112 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x267d590) skgpid ospid 1505 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:46.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:46.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:47.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:47.962 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:48.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0130002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:48.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:48.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:49.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:49.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:49.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:50.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:50.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:50.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0131002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:50.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:16:50.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:16:50.887 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:16:50.888 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:50.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0132002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:50.894 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:16:50.894 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:16:51.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:52.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:52.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:53.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:53.250 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:16:53.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:54.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:54.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:55.649 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:16:55.650 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:16:55.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:16:55.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d590) proc(0x26cea20) pid(602/602) version 11:1:1:4 [ CSSD]2013-05-23 15:16:55.666 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x26aae70) [ CSSD]2013-05-23 15:16:55.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:16:55.666 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:16:55.666 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:16:55.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:57.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:57.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:57.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:16:57.982 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:16:58.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0133002c) incarnation(174631051) [ CSSD]2013-05-23 15:16:58.253 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:16:58.253 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:16:58.826 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:16:58.827 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:16:58.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:16:58.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26a9700) pid(1638) version 11:1:1:4 [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26b40e0) [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b40e0 with con 0x26aa4a0, requested num -1 [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:16:58.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:16:58.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:16:58.840 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b40e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:16:58.840 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:16:58.841 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:16:59.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:16:59.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:16:59.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:16:59.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x261f650) skgpid ospid 1638 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:16:59.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:01.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:01.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:01.156 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:01.157 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:17:01.158 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:01.158 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26a9700) pid(1666) version 11:1:1:4 [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26b40e0) [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b40e0 with con 0x26946e0, requested num -1 [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:01.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:01.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:17:01.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b40e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:01.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:01.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:01.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:01.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x261f650) skgpid ospid 1666 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:01.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:02.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0134002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:02.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:02.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:02.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:17:02.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:02.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0135002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:02.672 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:02.672 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:03.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:03.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:03.256 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:03.256 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:03.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:05.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:05.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:05.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:06.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0136002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:06.142 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:06.142 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:06.142 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:17:06.142 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:06.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0137002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:06.148 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:06.148 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:07.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:07.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:07.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:08.004 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:08.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0138002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:08.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:08.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:09.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:09.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:09.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:09.827 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:09.828 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:17:09.828 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:09.828 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26946e0) proc(0x26a9700) pid(1773) version 11:1:1:4 [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26aa4b0) [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa4b0) [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa4b0 with con 0x2678f90, requested num -1 [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9d00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:09.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:09.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa4b0) [ CSSD]2013-05-23 15:17:09.841 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa4b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:09.841 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:09.841 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:10.044 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:10.044 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x26946e0) skgpid ospid 1773 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:11.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:11.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:11.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:17:11.533 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:17:11.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:17:11.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:17:11.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0139002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:11.612 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:11.612 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:11.612 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:17:11.612 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:17:11.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013a002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:11.619 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:11.619 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:11.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:12.129 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:12.129 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:17:12.130 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:12.130 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26946e0) proc(0x26a9700) pid(1830) version 11:1:1:4 [ CSSD]2013-05-23 15:17:12.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:12.262 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:17:13.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:13.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:13.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:14.818 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:14.818 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x26946e0) skgpid ospid 1830 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:15.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:15.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:15.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:16.408 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:16.409 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:17:16.409 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:16.409 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa4a0) proc(0x26a9700) pid(2168) version 11:1:1:4 [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26b40e0) [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b40e0 with con 0x2678f90, requested num -1 [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9d00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:16.415 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:16.422 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:17:16.422 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b40e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:16.422 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:16.422 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:16.624 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:16.624 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x26aa4a0) skgpid ospid 2168 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:17.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:17.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:17.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:17.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:17.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:18.023 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:18.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013b002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:19.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:19.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:19.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:21.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:21.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:21.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013c002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:21.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:21.388 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:21.388 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:17:21.388 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:21.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013d002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:21.395 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:21.395 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:21.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:22.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:22.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:23.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:23.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:23.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:25.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:25.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:25.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:27.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:27.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:27.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:27.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:27.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:28.053 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:28.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013e002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:29.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:29.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:29.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:31.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:31.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:31.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:31.274 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:17:31.659 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:31.660 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:17:31.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:31.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26a9700) pid(2355) version 11:1:1:4 [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26aa4b0) [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa4b0) [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa4b0 with con 0x26b40d0, requested num -1 [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:31.668 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:31.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa4b0) [ CSSD]2013-05-23 15:17:31.675 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa4b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:31.675 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:31.675 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:31.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:31.877 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x261f650) skgpid ospid 2355 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:32.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:33.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:33.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:34.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:35.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:35.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:36.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:36.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:36.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:36.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013f002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:36.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:36.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:36.638 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:17:36.638 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:36.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0140002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:36.644 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:36.644 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:37.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:37.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:38.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:38.083 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:38.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0141002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:39.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:39.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:39.321 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:39.322 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:17:39.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:39.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26a9700) pid(2443) version 11:1:1:4 [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26946f0) [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26946f0) [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26946f0 with con 0x26b40d0, requested num -1 [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9c40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:39.328 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:39.335 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26946f0) [ CSSD]2013-05-23 15:17:39.335 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26946f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:39.335 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:39.335 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:39.537 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:39.537 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x261f650) skgpid ospid 2443 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:40.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:41.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:41.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:41.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:41.280 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:42.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:43.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:43.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:44.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:45.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:45.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:46.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:46.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:46.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:46.911 [1199044928] >TRACE: clssgmAllocProc: (0x26a9700) allocated [ CSSD]2013-05-23 15:17:46.912 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:17:46.913 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9700 - 1,2,3 [ CSSD]2013-05-23 15:17:46.913 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa4a0) proc(0x26a9700) pid(2505) version 11:1:1:4 [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9700), client(1/0x26946f0) [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26946f0) [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26946f0 with con 0x2678f90, requested num -1 [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9d00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:46.919 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:46.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26946f0) [ CSSD]2013-05-23 15:17:46.925 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26946f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:46.925 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa000) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:46.925 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:47.128 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9700 [ CSSD]2013-05-23 15:17:47.128 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9700) con(0x26aa4a0) skgpid ospid 2505 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:47.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:47.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:48.114 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:48.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ba710) [ CSSD]2013-05-23 15:17:48.143 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ba710), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:17:48.143 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ba710), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:17:48.143 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 15:17:48.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26949e0) [ CSSD]2013-05-23 15:17:48.146 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26949e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:17:48.146 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26949e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:17:48.146 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 15:17:48.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:17:48.147 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:17:48.147 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:17:48.147 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:17:48.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787c0 [ CSSD]2013-05-23 15:17:48.148 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787c0) con(0x26916a0) skgpid 29442 ospid 29442 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 15:17:48.153 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26b4600) skgpid 29444 ospid 29444 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:48.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:48.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0142002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:49.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:49.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:50.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:51.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:51.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:17:51.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:51.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:51.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0143002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:51.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:17:51.884 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:17:51.884 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:17:51.884 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:51.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0144002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:51.890 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:17:51.890 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:17:52.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:53.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:53.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:54.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:55.289 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:17:55.289 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:17:55.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:55.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:56.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:57.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:57.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:17:58.135 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:17:58.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:17:58.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0145002c) incarnation(174631051) [ CSSD]2013-05-23 15:17:59.082 [1199044928] >TRACE: clssgmAllocProc: (0x26e86e0) allocated [ CSSD]2013-05-23 15:17:59.083 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:17:59.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e86e0 - 1,2,3 [ CSSD]2013-05-23 15:17:59.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26e86e0) pid(2642) version 11:1:1:4 [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e86e0), client(1/0x2678d00) [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678d00 with con 0x26916a0, requested num -1 [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678e10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:17:59.091 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:17:59.094 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0d0) allocated [ CSSD]2013-05-23 15:17:59.094 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:17:59.095 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0d0 - 1,2,3 [ CSSD]2013-05-23 15:17:59.095 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26ee0d0) pid(2638/2638) version 11:1:1:4 [ CSSD]2013-05-23 15:17:59.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:17:59.099 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678d00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:17:59.099 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c1a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:17:59.099 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c1a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:17:59.100 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ee0d0), client(1/0x26cdc60) [ CSSD]2013-05-23 15:17:59.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:17:59.100 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:17:59.100 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:17:59.301 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e86e0 [ CSSD]2013-05-23 15:17:59.301 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e86e0) con(0x261f650) skgpid ospid 2642 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:17:59.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:17:59.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:00.292 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:00.292 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:00.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:01.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:01.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:02.164 [1199044928] >TRACE: clssgmAllocProc: (0x26e86e0) allocated [ CSSD]2013-05-23 15:18:02.165 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:18:02.166 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e86e0 - 1,2,3 [ CSSD]2013-05-23 15:18:02.166 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x26e86e0) pid(2670) version 11:1:1:4 [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e86e0), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x26916a0, requested num -1 [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678e10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:02.172 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:02.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:02.180 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:18:02.180 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268fc60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:02.180 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268fc60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:02.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:02.383 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e86e0 [ CSSD]2013-05-23 15:18:02.383 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e86e0) con(0x261f650) skgpid ospid 2670 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:02.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0146002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:02.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:18:02.931 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:18:02.932 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:18:02.932 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:02.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0147002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:02.938 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:18:02.938 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:18:03.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:03.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:04.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:05.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:05.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:05.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:05.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:05.676 [1199044928] >TRACE: clssgmAllocProc: (0x26e86e0) allocated [ CSSD]2013-05-23 15:18:05.676 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:05.677 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e86e0 - 1,2,3 [ CSSD]2013-05-23 15:18:05.677 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26e86e0) pid(2564/2564) version 11:1:1:4 [ CSSD]2013-05-23 15:18:05.694 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e86e0), client(1/0x2678d00) [ CSSD]2013-05-23 15:18:05.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:18:05.694 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:18:05.694 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:18:06.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:07.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0148002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:07.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:18:07.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:18:07.139 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:18:07.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:07.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0149002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:07.146 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:18:07.146 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:18:07.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:07.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:08.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:08.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014a002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:08.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:09.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:09.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:10.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:10.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:10.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:11.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:11.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:12.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:13.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:13.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:14.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:14.302 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:18:14.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:15.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:15.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:16.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:17.416 [1199044928] >TRACE: clssgmAllocProc: (0x26a9c80) allocated [ CSSD]2013-05-23 15:18:17.417 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:18:17.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9c80 - 1,2,3 [ CSSD]2013-05-23 15:18:17.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b3b70) proc(0x26a9c80) pid(2807) version 11:1:1:4 [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9c80), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x26aa0f0, requested num -1 [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269aab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:17.435 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:17.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:17.443 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:18:17.443 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269adb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:17.443 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269adb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:17.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:17.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:17.645 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9c80 [ CSSD]2013-05-23 15:18:17.645 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9c80) con(0x26b3b70) skgpid ospid 2807 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:18.175 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:18.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014b002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:18.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:19.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:19.305 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:19.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:19.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:20.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:21.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:21.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:22.294 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e86e0), client(2/0x266f1a0) [ CSSD]2013-05-23 15:18:22.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x266f1a0) [ CSSD]2013-05-23 15:18:22.294 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:18:22.294 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 15:18:22.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014c002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:22.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:18:22.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:18:22.386 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:18:22.386 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:22.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014d002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:22.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:18:22.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:18:22.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:23.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:23.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:24.309 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:24.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:24.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:25.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:25.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:26.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:27.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:27.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:28.195 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:28.243 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 15:18:28.243 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:28.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 15:18:28.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678f00) proc(0x269a790) pid(2926/2926) version 11:1:1:4 [ CSSD]2013-05-23 15:18:28.260 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x26eece0) [ CSSD]2013-05-23 15:18:28.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:18:28.260 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:18:28.260 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:18:28.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:18:28.313 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eece0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:18:28.313 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eece0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:18:28.313 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:18:28.314 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 15:18:28.314 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x2678f00) skgpid 2926 ospid 2926 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:28.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014e002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:28.509 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 15:18:28.510 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:28.510 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 15:18:28.510 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b3c60) proc(0x269a790) pid(2931/2931) version 11:1:1:4 [ CSSD]2013-05-23 15:18:28.526 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x26b40e0) [ CSSD]2013-05-23 15:18:28.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:18:28.526 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:18:28.526 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b40e0) [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b40e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b40e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 15:18:28.577 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x26b3c60) skgpid 2931 ospid 2931 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:28.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:29.312 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:29.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:29.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:29.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:30.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:31.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:31.764 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:32.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:32.679 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 15:18:32.680 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:18:32.680 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 15:18:32.680 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2694550) proc(0x269a790) pid(2967) version 11:1:1:4 [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee2d0 with con 0x26aa0a0, requested num -1 [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269af90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:32.686 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:32.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:32.694 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee2d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:18:32.694 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:32.694 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:32.896 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 15:18:32.896 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x2694550) skgpid ospid 2967 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:33.314 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:33.315 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:18:33.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:33.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:34.460 [1199044928] >TRACE: clssgmAllocProc: (0x26949f0) allocated [ CSSD]2013-05-23 15:18:34.461 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:34.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26949f0 - 1,2,3 [ CSSD]2013-05-23 15:18:34.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678f00) proc(0x26949f0) pid(3023) version 11:1:1:4 [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26949f0), client(1/0x26eece0) [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26eece0 with con 0x2694920, requested num -1 [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269aec0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:34.469 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:34.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:18:34.476 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eece0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:18:34.476 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b1c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:18:34.476 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x269b1c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:34.585 [1199044928] >TRACE: clssgmAllocProc: (0x26bbcb0) allocated [ CSSD]2013-05-23 15:18:34.586 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:34.586 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bbcb0 - 1,2,3 [ CSSD]2013-05-23 15:18:34.586 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269aee0) proc(0x26bbcb0) pid(3028) version 11:1:1:4 [ CSSD]2013-05-23 15:18:34.601 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:18:34.603 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:18:34.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:18:34.606 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bbcb0 [ CSSD]2013-05-23 15:18:34.606 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bbcb0) con(0x269aee0) skgpid ospid 3028 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:34.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x26949f0 [ CSSD]2013-05-23 15:18:34.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26949f0) con(0x2678f00) skgpid ospid 3023 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:34.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:35.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:35.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:36.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:37.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014f002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:37.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:18:37.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:18:37.632 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:18:37.633 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:37.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0150002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:37.638 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:18:37.638 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:18:37.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:37.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:38.215 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:38.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:38.318 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:38.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0151002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:38.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:39.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:39.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:40.733 [1199044928] >TRACE: clssgmAllocProc: (0x26949f0) allocated [ CSSD]2013-05-23 15:18:40.734 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:40.735 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26949f0 - 1,2,3 [ CSSD]2013-05-23 15:18:40.735 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678f00) proc(0x26949f0) pid(3109) version 11:1:1:4 [ CSSD]2013-05-23 15:18:40.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:41.303 [1199044928] >TRACE: clssgmDeadProc: proc 0x26949f0 [ CSSD]2013-05-23 15:18:41.303 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26949f0) con(0x2678f00) skgpid ospid 3109 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:41.835 [1199044928] >TRACE: clssgmAllocProc: (0x26a9ea0) allocated [ CSSD]2013-05-23 15:18:41.836 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:41.836 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9ea0 - 1,2,3 [ CSSD]2013-05-23 15:18:41.836 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678e10) proc(0x26a9ea0) pid(2562/2562) version 11:1:1:4 [ CSSD]2013-05-23 15:18:41.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:41.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:41.852 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9ea0), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:18:41.852 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:18:41.852 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:18:41.852 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:18:42.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:43.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:43.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:43.760 [1199044928] >TRACE: clssgmAllocProc: (0x26bbcb0) allocated [ CSSD]2013-05-23 15:18:43.761 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:43.762 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bbcb0 - 1,2,3 [ CSSD]2013-05-23 15:18:43.762 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a6f0) proc(0x26bbcb0) pid(2560/2560) version 11:1:1:4 [ CSSD]2013-05-23 15:18:43.768 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26bbcb0), client(1/0x26eece0) [ CSSD]2013-05-23 15:18:43.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:18:43.768 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:18:43.768 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:18:43.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:43.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:44.503 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9ea0), client(2/0x26b40e0) [ CSSD]2013-05-23 15:18:44.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b40e0) [ CSSD]2013-05-23 15:18:44.503 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:18:44.503 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 15:18:44.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:45.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:45.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:46.578 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26bbcb0), client(2/0x2681c20) [ CSSD]2013-05-23 15:18:46.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2681c20) [ CSSD]2013-05-23 15:18:46.578 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:18:46.578 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:18:46.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:47.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:47.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:47.932 [1199044928] >TRACE: clssgmAllocProc: (0x26dcab0) allocated [ CSSD]2013-05-23 15:18:47.933 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:18:47.933 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dcab0 - 1,2,3 [ CSSD]2013-05-23 15:18:47.933 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681d90) proc(0x26dcab0) pid(3305) version 11:1:1:4 [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dcab0), client(1/0x26dd230) [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dd230) [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dd230 with con 0x26dc9d0, requested num -1 [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dd3a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:47.939 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:47.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dd230) [ CSSD]2013-05-23 15:18:47.946 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dd230), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:18:47.946 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:47.946 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:48.148 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dcab0 [ CSSD]2013-05-23 15:18:48.148 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dcab0) con(0x2681d90) skgpid ospid 3305 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:48.245 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:48.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:48.325 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:48.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0152002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:48.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:49.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:49.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:50.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:51.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:51.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:52.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:52.327 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:18:52.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ba280) [ CSSD]2013-05-23 15:18:52.547 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ba280), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:18:52.547 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ba280), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:18:52.547 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9df0) [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9df0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9df0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b98b0 [ CSSD]2013-05-23 15:18:52.551 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b98b0) con(0x269b490) skgpid 30095 ospid 30095 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:52.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:52.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0153002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:52.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:18:52.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:18:52.887 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:18:52.887 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:52.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0154002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:52.896 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:18:52.896 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:18:53.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:53.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:54.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:55.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:55.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:56.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:57.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:18:57.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:18:57.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:57.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:18:58.266 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:18:58.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0155002c) incarnation(174631051) [ CSSD]2013-05-23 15:18:58.925 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:18:59.342 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 15:18:59.343 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:18:59.343 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 15:18:59.343 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b9bd0) pid(3438) version 11:1:1:4 [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b9bd0), client(1/0x26b96d0) [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b96d0) [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b96d0 with con 0x26ba340, requested num -1 [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695f40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:18:59.350 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:18:59.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b96d0) [ CSSD]2013-05-23 15:18:59.358 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b96d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:18:59.358 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2696240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:18:59.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2696240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:18:59.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 15:18:59.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x269b490) skgpid ospid 3438 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:18:59.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:18:59.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:00.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:01.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:01.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:02.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:02.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:02.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:03.184 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 15:19:03.185 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:19:03.185 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 15:19:03.185 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b9bd0) pid(3479) version 11:1:1:4 [ CSSD]2013-05-23 15:19:03.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0156002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:03.187 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:19:03.187 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:19:03.187 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:19:03.187 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b9bd0), client(1/0x26edf50) [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26edf50) [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26edf50 with con 0x26ba340, requested num -1 [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695f40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:03.191 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:03.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0157002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:03.194 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:19:03.194 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:19:03.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26edf50) [ CSSD]2013-05-23 15:19:03.198 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26edf50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:19:03.198 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:03.199 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:03.401 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 15:19:03.401 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x269b490) skgpid ospid 3479 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:03.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:03.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:04.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:05.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:05.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:06.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:07.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:07.337 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:07.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:07.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:08.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0158002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:08.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:19:08.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:19:08.134 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:19:08.134 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:08.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0159002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:08.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:19:08.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:19:08.286 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:08.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015a002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:09.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:09.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:09.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:11.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:11.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:11.340 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:19:11.677 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 15:19:11.678 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:19:11.679 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 15:19:11.679 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26edf50) proc(0x26b9bd0) pid(3387/3387) version 11:1:1:4 [ CSSD]2013-05-23 15:19:11.683 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b9bd0), client(1/0x26b9550) [ CSSD]2013-05-23 15:19:11.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9550) [ CSSD]2013-05-23 15:19:11.683 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:19:11.683 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:19:12.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:12.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:13.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:14.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:14.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:15.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:16.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:16.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:16.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:16.344 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:17.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:18.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:18.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:18.316 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:18.434 [1199044928] >TRACE: clssgmAllocProc: (0x26b6500) allocated [ CSSD]2013-05-23 15:19:18.435 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:19:18.436 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6500 - 1,2,3 [ CSSD]2013-05-23 15:19:18.436 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6500) pid(3639) version 11:1:1:4 [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6500), client(1/0x26b94b0) [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b94b0 with con 0x26b6420, requested num -1 [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcdd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:18.442 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:18.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:18.449 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b94b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:19:18.449 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd0d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:18.449 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd0d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:18.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015b002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:18.651 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6500 [ CSSD]2013-05-23 15:19:18.651 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6500) con(0x269b490) skgpid ospid 3639 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:19.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:20.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:20.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:21.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:21.205 [1199044928] >TRACE: clssgmAllocProc: (0x26b65d0) allocated [ CSSD]2013-05-23 15:19:21.206 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:19:21.207 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65d0 - 1,2,3 [ CSSD]2013-05-23 15:19:21.207 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26b65d0) pid(3702) version 11:1:1:4 [ CSSD]2013-05-23 15:19:21.325 [1199044928] >TRACE: clssgmAllocProc: (0x26be110) allocated [ CSSD]2013-05-23 15:19:21.325 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:19:21.326 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26be110 - 1,2,3 [ CSSD]2013-05-23 15:19:21.326 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696620) proc(0x26be110) pid(3712) version 11:1:1:4 [ CSSD]2013-05-23 15:19:21.342 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:19:21.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:19:21.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:21.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:21.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x26be110 [ CSSD]2013-05-23 15:19:21.347 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26be110) con(0x2696620) skgpid ospid 3712 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:21.429 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5332/0x26b94b0) [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5332 (0x26b94b0) [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26b94b0 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26dcd00/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:21.430 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:19:21.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5332 (0x26b94b0) [ CSSD]2013-05-23 15:19:21.436 [1199044928] >TRACE: clssgmExitGrock: client 5332 (0x26b94b0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:19:21.436 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd000) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:19:21.437 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26dd000) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:21.438 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65d0 [ CSSD]2013-05-23 15:19:21.438 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65d0) con(0x2696320) skgpid ospid 3702 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:22.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:22.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:23.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:23.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015c002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:23.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:19:23.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:19:23.391 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:19:23.391 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:23.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015d002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:23.397 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:19:23.397 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:19:24.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:24.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:25.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:26.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:26.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:26.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:26.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:27.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:28.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:28.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:28.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:28.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015e002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:29.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:30.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:30.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:30.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:30.353 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:19:31.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:32.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:32.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:33.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:33.692 [1199044928] >TRACE: clssgmAllocProc: (0x26b65d0) allocated [ CSSD]2013-05-23 15:19:33.692 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:19:33.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65d0 - 1,2,3 [ CSSD]2013-05-23 15:19:33.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26b65d0) pid(3854) version 11:1:1:4 [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b65d0), client(1/0x26b94b0) [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b94b0 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dce80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:33.699 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:33.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:33.707 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b94b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:19:33.707 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:33.707 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:33.909 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65d0 [ CSSD]2013-05-23 15:19:33.909 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65d0) con(0x2696320) skgpid ospid 3854 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:34.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:34.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:35.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:35.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:35.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:36.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:36.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:37.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:38.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:38.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:38.357 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:38.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015f002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:38.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0160002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:38.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:19:38.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:19:38.637 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:19:38.637 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:38.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0161002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:38.643 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:19:38.643 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:19:39.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:40.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:40.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:40.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:40.359 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:41.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:42.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:42.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:43.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:44.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:44.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:45.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:45.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:45.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:46.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:46.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:47.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:48.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:48.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:48.378 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:48.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0162002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:48.953 [1199044928] >TRACE: clssgmAllocProc: (0x26b6500) allocated [ CSSD]2013-05-23 15:19:48.954 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:19:48.954 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6500 - 1,2,3 [ CSSD]2013-05-23 15:19:48.954 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6500) pid(4000) version 11:1:1:4 [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6500), client(1/0x26b94b0) [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b94b0 with con 0x26b6420, requested num -1 [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcdd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:48.971 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:48.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:48.979 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b94b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:19:48.979 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd0d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:48.979 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd0d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:49.181 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6500 [ CSSD]2013-05-23 15:19:49.181 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6500) con(0x269b490) skgpid ospid 4000 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:19:49.365 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:49.365 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:19:49.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:50.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:50.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:51.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:52.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:52.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:53.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:53.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0163002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:53.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:19:53.883 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:19:53.883 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:19:53.884 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:53.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0164002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:53.890 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:19:53.891 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:19:54.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:54.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:54.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:54.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:55.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:56.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:56.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:57.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:58.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:19:58.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:19:58.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:19:58.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0165002c) incarnation(174631051) [ CSSD]2013-05-23 15:19:59.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:19:59.372 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:19:59.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:19:59.606 [1199044928] >TRACE: clssgmAllocProc: (0x26b65d0) allocated [ CSSD]2013-05-23 15:19:59.607 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:19:59.607 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65d0 - 1,2,3 [ CSSD]2013-05-23 15:19:59.607 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26b65d0) pid(4122) version 11:1:1:4 [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b65d0), client(1/0x26b94b0) [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b94b0 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dce80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:19:59.614 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:19:59.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b94b0) [ CSSD]2013-05-23 15:19:59.624 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b94b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:19:59.624 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:19:59.624 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:19:59.827 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65d0 [ CSSD]2013-05-23 15:19:59.827 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65d0) con(0x2696320) skgpid ospid 4122 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:00.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:00.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:00.967 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26b9bd0), client(2/0x26b9490) [ CSSD]2013-05-23 15:20:00.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b9490) [ CSSD]2013-05-23 15:20:00.967 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:20:00.967 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:20:01.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:02.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:02.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:03.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0166002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:03.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:03.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:03.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:03.441 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:03.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0167002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:03.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:03.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:03.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:04.220 [1199044928] >TRACE: clssgmAllocProc: (0x26dcb80) allocated [ CSSD]2013-05-23 15:20:04.221 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:20:04.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dcb80 - 1,2,3 [ CSSD]2013-05-23 15:20:04.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b4600) proc(0x26dcb80) pid(4365) version 11:1:1:4 [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dcb80), client(1/0x26dd1d0) [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dd1d0) [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dd1d0 with con 0x26dcaa0, requested num -1 [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dd340/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:20:04.229 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:04.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dd1d0) [ CSSD]2013-05-23 15:20:04.236 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dd1d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:20:04.236 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd640) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:04.236 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd640) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:20:04.375 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:04.376 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:04.438 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dcb80 [ CSSD]2013-05-23 15:20:04.438 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dcb80) con(0x26b4600) skgpid ospid 4365 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:04.562 [1199044928] >TRACE: clssgmAllocProc: (0x26dd600) allocated [ CSSD]2013-05-23 15:20:04.562 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:20:04.563 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dd600 - 1,2,3 [ CSSD]2013-05-23 15:20:04.563 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc920) proc(0x26dd600) pid(4408/4408) version 11:1:1:4 [ CSSD]2013-05-23 15:20:04.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:04.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:04.580 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dd600), client(1/0x26dda50) [ CSSD]2013-05-23 15:20:04.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26dda50) [ CSSD]2013-05-23 15:20:04.580 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:20:04.580 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26dda50) [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26dda50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26dda50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dd600 [ CSSD]2013-05-23 15:20:04.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dd600) con(0x26dc920) skgpid 4408 ospid 4408 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:05.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:06.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:06.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:07.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:08.378 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:08.378 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:20:08.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:08.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:08.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:08.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0168002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:09.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0169002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:09.138 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:09.138 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:09.138 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:09.138 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:09.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016a002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:09.143 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:09.143 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:09.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:10.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:10.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:11.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:12.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:12.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:13.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:13.382 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:13.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:14.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:14.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:15.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:16.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:16.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:17.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:18.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26cddd0) [ CSSD]2013-05-23 15:20:18.181 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26cddd0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:20:18.181 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26cddd0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:20:18.181 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x267be70 [ CSSD]2013-05-23 15:20:18.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267be70) con(0x26a6930) skgpid 31309 ospid 31309 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:18.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:18.385 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:18.698 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:18.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:18.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:18.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016b002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:19.473 [1199044928] >TRACE: clssgmAllocProc: (0x26cd9b0) allocated [ CSSD]2013-05-23 15:20:19.474 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:20:19.474 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd9b0 - 1,2,3 [ CSSD]2013-05-23 15:20:19.474 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26cd9b0) pid(4509) version 11:1:1:4 [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cd9b0), client(1/0x261cb10) [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x26cddc0, requested num -1 [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695f40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:20:19.482 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:19.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:19.490 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:20:19.490 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2696240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:19.490 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2696240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:20:19.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd9b0 [ CSSD]2013-05-23 15:20:19.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd9b0) con(0x266f0d0) skgpid ospid 4509 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:19.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:20.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:20.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:21.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:22.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:22.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:23.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:23.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:23.759 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:24.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016c002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:24.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:24.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:24.384 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:24.384 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:24.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016d002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:24.390 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:24.390 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:24.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:24.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:25.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:26.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:26.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:27.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:27.392 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:20:27.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:28.718 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:28.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:28.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:28.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016e002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:29.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:30.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:30.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:31.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:32.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:32.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:32.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:32.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:33.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:34.726 [1199044928] >TRACE: clssgmAllocProc: (0x26cd9b0) allocated [ CSSD]2013-05-23 15:20:34.727 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:20:34.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd9b0 - 1,2,3 [ CSSD]2013-05-23 15:20:34.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9790) proc(0x26cd9b0) pid(4662) version 11:1:1:4 [ CSSD]2013-05-23 15:20:34.733 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cd9b0), client(1/0x261cb10) [ CSSD]2013-05-23 15:20:34.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:34.733 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x26ba630, requested num -1 [ CSSD]2013-05-23 15:20:34.733 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:34.733 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2696190/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:20:34.734 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:20:34.734 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:34.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:34.741 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:20:34.741 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba4b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:34.741 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba4b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:20:34.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:34.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:34.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd9b0 [ CSSD]2013-05-23 15:20:34.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd9b0) con(0x26b9790) skgpid ospid 4662 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:35.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:36.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:36.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:37.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:37.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:37.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:38.738 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:38.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016f002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:39.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:39.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:39.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0170002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:39.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:39.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:39.631 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:39.631 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:39.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0171002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:39.638 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:39.638 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:39.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:41.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:41.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:41.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:42.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:42.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:43.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:43.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:44.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:45.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:45.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:46.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:46.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:46.405 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:20:47.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:47.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:47.294 [1199044928] >TRACE: clssgmAllocProc: (0x26cd9b0) allocated [ CSSD]2013-05-23 15:20:47.294 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:20:47.295 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cd9b0 - 1,2,3 [ CSSD]2013-05-23 15:20:47.295 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26cd9b0) pid(3385/3385) version 11:1:1:4 [ CSSD]2013-05-23 15:20:47.301 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26cd9b0), client(1/0x261cb10) [ CSSD]2013-05-23 15:20:47.301 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:20:47.301 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:20:47.301 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:20:48.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:48.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:48.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0172002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:49.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:49.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:49.977 [1199044928] >TRACE: clssgmAllocProc: (0x26b6500) allocated [ CSSD]2013-05-23 15:20:49.978 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:20:49.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6500 - 1,2,3 [ CSSD]2013-05-23 15:20:49.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696280) proc(0x26b6500) pid(4805) version 11:1:1:4 [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6500), client(1/0x26dcdd0) [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dcdd0) [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dcdd0 with con 0x26b6420, requested num -1 [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcf40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:20:49.984 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:49.990 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dcdd0) [ CSSD]2013-05-23 15:20:49.990 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dcdd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:20:49.990 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:49.990 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:20:50.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:50.193 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6500 [ CSSD]2013-05-23 15:20:50.193 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6500) con(0x2696280) skgpid ospid 4805 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:20:51.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:51.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:51.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:51.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:52.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:53.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:53.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:54.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:54.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0173002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:54.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:54.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:54.588 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:54.588 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:54.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0174002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:54.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:54.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:54.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0175002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:54.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:20:54.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:20:54.886 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:20:54.886 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:54.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0176002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:54.893 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:20:54.893 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:20:55.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:55.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:56.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:56.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:20:56.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:20:57.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:57.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:58.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:20:58.780 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:20:58.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0177002c) incarnation(174631051) [ CSSD]2013-05-23 15:20:59.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:20:59.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:20:59.867 [1199044928] >TRACE: clssgmAllocProc: (0x26b6500) allocated [ CSSD]2013-05-23 15:20:59.868 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:20:59.869 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6500 - 1,2,3 [ CSSD]2013-05-23 15:20:59.869 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696280) proc(0x26b6500) pid(4920) version 11:1:1:4 [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b6500), client(1/0x26dcdd0) [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dcdd0) [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dcdd0 with con 0x26b6420, requested num -1 [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcf40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:20:59.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:20:59.883 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dcdd0) [ CSSD]2013-05-23 15:20:59.883 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dcdd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:20:59.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:20:59.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:21:00.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6500 [ CSSD]2013-05-23 15:21:00.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6500) con(0x2696280) skgpid ospid 4920 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:00.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:01.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:01.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:01.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:01.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:02.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:03.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:03.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:03.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0178002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:03.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:03.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:03.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:21:03.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:03.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0179002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:03.699 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:03.699 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:04.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:05.230 [1199044928] >TRACE: clssgmAllocProc: (0x26dc920) allocated [ CSSD]2013-05-23 15:21:05.231 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:21:05.231 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dc920 - 1,2,3 [ CSSD]2013-05-23 15:21:05.231 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26dc920) pid(4967) version 11:1:1:4 [ CSSD]2013-05-23 15:21:05.247 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dc920), client(1/0x26b6680) [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b6680) [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b6680 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcf70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:21:05.248 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:05.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b6680) [ CSSD]2013-05-23 15:21:05.256 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b6680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:21:05.256 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:05.256 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:21:05.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:05.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:05.417 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:05.417 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:21:05.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dc920 [ CSSD]2013-05-23 15:21:05.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dc920) con(0x2696320) skgpid ospid 4967 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:06.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:07.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:07.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:08.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:08.800 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:09.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017a002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:09.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:09.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:10.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017b002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:10.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:10.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:10.151 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:21:10.151 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:10.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017c002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:10.159 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:10.159 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:10.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:10.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:10.421 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:11.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:11.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:12.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:13.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:13.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:13.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017d002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:13.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:13.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:13.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:21:13.611 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:13.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017e002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:13.618 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:13.618 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:13.747 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:21:13.748 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:21:13.750 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:21:13.750 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:21:14.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:15.424 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:15.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:15.540 [1199044928] >TRACE: clssgmAllocProc: (0x26dc920) allocated [ CSSD]2013-05-23 15:21:15.541 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:21:15.541 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dc920 - 1,2,3 [ CSSD]2013-05-23 15:21:15.541 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26dc920) pid(5348/5348) version 11:1:1:4 [ CSSD]2013-05-23 15:21:15.557 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dc920), client(1/0x26b65c0) [ CSSD]2013-05-23 15:21:15.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b65c0) [ CSSD]2013-05-23 15:21:15.557 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:21:15.557 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 15:21:15.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:15.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b65c0) [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b65c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b65c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dc920 [ CSSD]2013-05-23 15:21:15.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dc920) con(0x2696320) skgpid 5348 ospid 5348 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:16.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:17.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:17.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:18.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:18.820 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:19.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017f002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:19.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:19.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:20.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:20.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:20.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:20.492 [1199044928] >TRACE: clssgmAllocProc: (0x26b65d0) allocated [ CSSD]2013-05-23 15:21:20.493 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:21:20.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b65d0 - 1,2,3 [ CSSD]2013-05-23 15:21:20.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x26b65d0) pid(5383) version 11:1:1:4 [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b65d0), client(1/0x26dce30) [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dce30) [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dce30 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcfa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:21:20.500 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:20.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dce30) [ CSSD]2013-05-23 15:21:20.508 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dce30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:21:20.508 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:20.508 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:21:20.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b65d0 [ CSSD]2013-05-23 15:21:20.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b65d0) con(0x2696320) skgpid ospid 5383 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:21.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:21.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:22.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:22.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:22.587 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c440), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:21:22.587 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c440), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:21:22.587 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:21:22.588 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:21:22.588 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e4ea0) skgpid 32160 ospid 32160 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2680040) [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2680040), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2680040), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce450 [ CSSD]2013-05-23 15:21:22.590 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce450) con(0x267fc90) skgpid 32158 ospid 32158 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:23.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:23.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:24.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:24.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:24.431 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:21:25.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0180002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:25.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:25.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:25.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:21:25.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:25.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0181002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:25.407 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:25.407 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:25.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:25.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:26.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:27.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:27.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:28.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:28.841 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:29.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0182002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:29.435 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:29.435 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:29.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:29.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:30.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:31.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:31.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:32.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:33.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:33.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:34.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:34.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:34.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:35.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:35.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:35.744 [1199044928] >TRACE: clssgmAllocProc: (0x2698930) allocated [ CSSD]2013-05-23 15:21:35.745 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:21:35.746 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698930 - 1,2,3 [ CSSD]2013-05-23 15:21:35.746 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2698930) pid(5550) version 11:1:1:4 [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2698930), client(1/0x267c440) [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x2698dd0, requested num -1 [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bcd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:21:35.752 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:35.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:35.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:21:35.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26594c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:35.758 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26594c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:21:35.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698930 [ CSSD]2013-05-23 15:21:35.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698930) con(0x26e4ea0) skgpid ospid 5550 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:36.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:37.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:37.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:38.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:38.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:39.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0183002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:39.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:39.441 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:39.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:39.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:40.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:40.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0184002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:40.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:40.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:40.648 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:21:40.648 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:40.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0185002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:40.655 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:40.655 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:41.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:41.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:42.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:43.444 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:43.444 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:21:43.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:43.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:44.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:45.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:45.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:46.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:47.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:47.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:48.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:48.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:48.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:48.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:49.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0186002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:49.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:49.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:50.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:50.994 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:21:50.995 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:21:50.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:21:50.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x2698b80) pid(5716) version 11:1:1:4 [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c440 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261bcd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:21:51.002 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:51.009 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:51.009 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c440), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:21:51.009 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26594c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:21:51.009 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26594c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:21:51.211 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:21:51.211 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e1280) skgpid ospid 5716 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:21:51.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:51.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:52.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:53.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:53.451 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:53.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:53.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:54.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:55.852 [1199044928] >TRACE: clssgmAllocProc: (0x2698b80) allocated [ CSSD]2013-05-23 15:21:55.853 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:21:55.854 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698b80 - 1,2,3 [ CSSD]2013-05-23 15:21:55.854 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x2698b80) pid(5450/5450) version 11:1:1:4 [ CSSD]2013-05-23 15:21:55.870 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2698b80), client(1/0x267c440) [ CSSD]2013-05-23 15:21:55.870 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:21:55.870 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:21:55.870 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:21:55.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0187002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:55.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:21:55.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:21:55.906 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:21:55.907 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:21:55.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0188002c) incarnation(174631051) [ CSSD]2013-05-23 15:21:55.913 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:21:55.913 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:21:55.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:55.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:56.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:58.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:21:58.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:21:58.454 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:21:58.454 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:21:58.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:21:58.923 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:21:59.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0189002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:00.038 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2698b80), client(2/0x2680040) [ CSSD]2013-05-23 15:22:00.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2680040) [ CSSD]2013-05-23 15:22:00.038 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:22:00.038 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:22:00.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:00.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:00.125 [1199044928] >TRACE: clssgmAllocProc: (0x2696540) allocated [ CSSD]2013-05-23 15:22:00.126 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:22:00.127 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2696540 - 1,2,3 [ CSSD]2013-05-23 15:22:00.127 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2696540) pid(5828) version 11:1:1:4 [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2696540), client(1/0x26e19c0) [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e19c0 with con 0x267bda0, requested num -1 [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:22:00.133 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:00.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:00.141 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e19c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:22:00.141 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:00.141 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:22:00.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x2696540 [ CSSD]2013-05-23 15:22:00.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2696540) con(0x26e4ea0) skgpid ospid 5828 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:00.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:02.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:02.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:02.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:02.457 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:22:02.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:03.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018a002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:03.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:03.946 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:03.947 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:03.947 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:03.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018b002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:03.953 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:03.953 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:04.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:04.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:04.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018c002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:04.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:04.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:04.594 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:04.595 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:04.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018d002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:04.602 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:04.602 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:04.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:06.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:06.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:06.247 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:22:06.248 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:22:06.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:22:06.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2659ac0) pid(5897) version 11:1:1:4 [ CSSD]2013-05-23 15:22:06.255 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2659ac0), client(1/0x26e19c0) [ CSSD]2013-05-23 15:22:06.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:06.255 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e19c0 with con 0x267bda0, requested num -1 [ CSSD]2013-05-23 15:22:06.255 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:06.255 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:22:06.256 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:22:06.256 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:06.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:06.262 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e19c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:22:06.262 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:06.263 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:22:06.465 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:22:06.465 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e4ea0) skgpid ospid 5897 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:06.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:07.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:07.460 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:08.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:08.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:08.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:08.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:09.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018e002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:10.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:10.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:10.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:11.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018f002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:11.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:11.154 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:11.154 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:11.154 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:11.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0190002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:11.161 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:11.161 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:11.521 [1199044928] >TRACE: clssgmAllocProc: (0x2696540) allocated [ CSSD]2013-05-23 15:22:11.522 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:22:11.522 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2696540 - 1,2,3 [ CSSD]2013-05-23 15:22:11.522 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2696540) pid(6026) version 11:1:1:4 [ CSSD]2013-05-23 15:22:11.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:22:11.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:22:11.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:22:11.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:22:11.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0191002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:11.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:11.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:11.928 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:22:11.928 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:22:11.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0192002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:11.935 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:11.935 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:12.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:12.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:12.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:12.463 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:12.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:14.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x2696540 [ CSSD]2013-05-23 15:22:14.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2696540) con(0x26e4ea0) skgpid ospid 6026 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:14.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:14.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:14.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:16.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:16.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:16.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:17.466 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:17.466 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:18.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:18.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:18.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:18.970 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:19.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0193002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:20.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:20.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:20.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:21.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:21.469 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:22:21.498 [1199044928] >TRACE: clssgmAllocProc: (0x267be70) allocated [ CSSD]2013-05-23 15:22:21.499 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:22:21.500 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267be70 - 1,2,3 [ CSSD]2013-05-23 15:22:21.500 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2696320) proc(0x267be70) pid(6431) version 11:1:1:4 [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x267be70), client(1/0x26e1900) [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1900) [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1900 with con 0x2696620, requested num -1 [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:22:21.505 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:21.512 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1900) [ CSSD]2013-05-23 15:22:21.512 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1900), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:22:21.512 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1a70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:21.512 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1a70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:22:21.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x267be70 [ CSSD]2013-05-23 15:22:21.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267be70) con(0x2696320) skgpid ospid 6431 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:22.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:22.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:22.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:24.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:24.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:24.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:26.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:26.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:26.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0194002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:26.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:26.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:26.405 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:26.405 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:26.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0195002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:26.412 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:26.412 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:26.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:26.473 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:26.861 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:28.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:28.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:28.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:29.007 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:29.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0196002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:30.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:30.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:30.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:31.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:31.476 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:32.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:32.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:32.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:34.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:34.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:35.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:36.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:36.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:36.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:36.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:36.748 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:22:36.749 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:22:36.750 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:22:36.750 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x2659ac0) pid(6603) version 11:1:1:4 [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2659ac0), client(1/0x26e19c0) [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e19c0 with con 0x267bda0, requested num -1 [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b4600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:22:36.756 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:36.763 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e19c0) [ CSSD]2013-05-23 15:22:36.763 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e19c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:22:36.763 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:36.763 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:22:36.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:22:36.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26e4ea0) skgpid ospid 6603 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:37.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:38.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:38.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:39.028 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:39.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:39.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0197002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:40.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:40.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:40.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:40.483 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:22:41.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:41.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0198002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:41.674 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:41.674 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:41.674 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:41.674 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:41.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0199002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:41.680 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:41.680 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:42.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:42.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:43.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:44.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:44.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:45.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:45.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:45.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:46.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:46.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:47.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:48.227 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x267fed0) [ CSSD]2013-05-23 15:22:48.227 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x267fed0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:22:48.227 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x267fed0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:22:48.227 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b4560) [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b4560), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b4560), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ce760 [ CSSD]2013-05-23 15:22:48.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ce760) con(0x2679130) skgpid 604 ospid 604 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aae70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aae70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:22:48.239 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x267d590) skgpid 602 ospid 602 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:48.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:48.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:49.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:49.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:49.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019a002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:50.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:50.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:50.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:50.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:51.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:51.993 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:22:51.994 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:22:51.995 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:22:51.995 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(6767) version 11:1:1:4 [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cea20), client(1/0x26e4ea0) [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e4ea0 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:22:52.012 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:52.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 15:22:52.019 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e4ea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:22:52.019 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:22:52.019 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:22:52.222 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:22:52.222 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid ospid 6767 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:52.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:52.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:53.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:54.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:54.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:55.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:55.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:55.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:22:56.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:56.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:56.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019b002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:56.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:22:56.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:22:56.922 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:22:56.922 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:22:56.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019c002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:56.929 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:22:56.929 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:22:57.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:58.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:22:58.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:22:59.094 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cdc60) [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cdc60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cdc60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0d0 [ CSSD]2013-05-23 15:22:59.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0d0) con(0x26ee500) skgpid 2638 ospid 2638 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:22:59.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:22:59.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019d002c) incarnation(174631051) [ CSSD]2013-05-23 15:22:59.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:22:59.495 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:23:00.385 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:23:00.386 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:00.387 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:23:00.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x26cea20) pid(6872) version 11:1:1:4 [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x26a67c0) [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a67c0 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:00.393 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:00.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 15:23:00.402 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a67c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:23:00.402 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:00.402 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:00.604 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:23:00.604 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x26e4ea0) skgpid ospid 6872 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:00.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:00.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:01.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:02.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:02.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:03.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:04.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019e002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:04.200 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:23:04.200 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:23:04.200 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:23:04.200 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:04.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019f002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:04.206 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:23:04.206 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:23:04.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:04.498 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:04.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:04.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:05.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:06.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:06.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:07.257 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:23:07.258 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:23:07.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:23:07.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x26e1090) pid(6924) version 11:1:1:4 [ CSSD]2013-05-23 15:23:07.264 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1090), client(1/0x26a67c0) [ CSSD]2013-05-23 15:23:07.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 15:23:07.264 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a67c0 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 15:23:07.264 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:07.264 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:23:07.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:07.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:07.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a67c0) [ CSSD]2013-05-23 15:23:07.272 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a67c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:23:07.272 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:07.272 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:07.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:07.474 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 15:23:07.474 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26e4ea0) skgpid ospid 6924 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:08.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:08.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:09.118 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:09.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a0002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:09.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:09.502 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:09.502 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:10.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:10.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:11.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:12.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a1002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:12.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:23:12.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:23:12.176 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:23:12.176 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:12.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a2002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:12.182 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:23:12.182 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:23:12.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:12.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:13.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:14.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:14.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:14.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:14.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:15.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:16.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:16.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:17.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:18.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:18.508 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:23:18.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:18.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:19.138 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:19.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a3002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:19.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:20.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:20.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:21.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:22.508 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:23:22.508 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:23:22.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:23:22.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26cea20) pid(7081) version 11:1:1:4 [ CSSD]2013-05-23 15:23:22.515 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x26ee500) [ CSSD]2013-05-23 15:23:22.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 15:23:22.515 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee500 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:23:22.515 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:22.515 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:23:22.516 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:22.516 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:22.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 15:23:22.523 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee500), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:23:22.523 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:22.523 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:22.725 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:23:22.725 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x2660e70) skgpid ospid 7081 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:22.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:22.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:23.511 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:23.511 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:23.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:24.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:24.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:25.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:26.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:26.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:27.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a4002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:27.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:23:27.423 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:23:27.423 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:23:27.423 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:27.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a5002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:27.430 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:23:27.430 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:23:27.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:28.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:28.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:28.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:28.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:29.160 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:29.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a6002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:29.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:30.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:30.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:31.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:32.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:32.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:33.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:33.517 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:33.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:34.758 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:23:34.759 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:34.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:23:34.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(7207) version 11:1:1:4 [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1090), client(1/0x26e4ea0) [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26e4ea0 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:34.766 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:34.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 15:23:34.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e4ea0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:23:34.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:23:34.774 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:34.883 [1199044928] >TRACE: clssgmAllocProc: (0x261bf20) allocated [ CSSD]2013-05-23 15:23:34.884 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:34.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bf20 - 1,2,3 [ CSSD]2013-05-23 15:23:34.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x261bf20) pid(7212) version 11:1:1:4 [ CSSD]2013-05-23 15:23:34.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:23:34.903 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:23:34.905 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:23:34.907 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bf20 [ CSSD]2013-05-23 15:23:34.907 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bf20) con(0x26a67c0) skgpid ospid 7212 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:34.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:34.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:34.976 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 15:23:34.976 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid ospid 7207 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:35.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:36.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:36.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:37.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:37.520 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:23:37.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:37.770 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:23:37.771 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:23:37.771 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:23:37.771 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26cea20) pid(7236) version 11:1:1:4 [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x2660e70) [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x26e4ea0, requested num -1 [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:37.777 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:37.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:23:37.784 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:23:37.784 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:37.785 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:37.987 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:23:37.987 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x26ee500) skgpid ospid 7236 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:39.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:39.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:39.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:39.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a7002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:39.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:41.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:41.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:41.245 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:23:41.246 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:41.246 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:23:41.246 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(7314) version 11:1:1:4 [ CSSD]2013-05-23 15:23:41.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:41.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 15:23:41.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid ospid 7314 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:42.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:42.523 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:42.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a8002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:42.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:23:42.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:23:42.673 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:23:42.673 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:42.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a9002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:42.681 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:23:42.681 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:23:43.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:43.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:43.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:45.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:45.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:45.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:47.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:47.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:47.526 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:47.526 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:47.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:49.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:49.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:49.204 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:49.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01aa002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:49.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:51.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:51.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:51.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:52.530 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:52.530 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:23:53.031 [1199044928] >TRACE: clssgmAllocProc: (0x26cea20) allocated [ CSSD]2013-05-23 15:23:53.032 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:23:53.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cea20 - 1,2,3 [ CSSD]2013-05-23 15:23:53.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26cea20) pid(7566) version 11:1:1:4 [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26cea20), client(1/0x2660e70) [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26800e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:23:53.039 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:53.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 15:23:53.045 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:23:53.045 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26803e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:23:53.045 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26803e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:23:53.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:53.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:53.248 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cea20 [ CSSD]2013-05-23 15:23:53.248 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cea20) con(0x26ee500) skgpid ospid 7566 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:23:53.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:54.747 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 15:23:54.748 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:54.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 15:23:54.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(7564/7564) version 11:1:1:4 [ CSSD]2013-05-23 15:23:54.765 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1090), client(1/0x26e4ea0) [ CSSD]2013-05-23 15:23:54.765 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 15:23:54.765 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:23:54.765 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:23:55.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:55.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:55.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:56.532 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:23:56.533 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:23:57.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:57.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:57.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:23:57.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ab002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:57.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:23:57.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:23:57.924 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:23:57.924 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:23:57.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ac002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:57.931 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:23:57.931 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:23:59.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:23:59.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:23:59.226 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:23:59.372 [1199044928] >TRACE: clssgmAllocProc: (0x26eeb30) allocated [ CSSD]2013-05-23 15:23:59.372 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:23:59.373 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eeb30 - 1,2,3 [ CSSD]2013-05-23 15:23:59.373 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26eeb30) pid(7526/7526) version 11:1:1:4 [ CSSD]2013-05-23 15:23:59.389 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26eeb30), client(1/0x26b3f60) [ CSSD]2013-05-23 15:23:59.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b3f60) [ CSSD]2013-05-23 15:23:59.389 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:23:59.389 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:23:59.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ad002c) incarnation(174631051) [ CSSD]2013-05-23 15:23:59.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:00.652 [1199044928] >TRACE: clssgmAllocProc: (0x26aab50) allocated [ CSSD]2013-05-23 15:24:00.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:24:00.654 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab50 - 1,2,3 [ CSSD]2013-05-23 15:24:00.654 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee000) proc(0x26aab50) pid(7659) version 11:1:1:4 [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aab50), client(1/0x26e1c80) [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1c80 with con 0x2696570, requested num -1 [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269dcc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:00.671 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:00.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:24:00.678 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1c80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:24:00.678 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269dfc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:00.678 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269dfc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:00.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab50 [ CSSD]2013-05-23 15:24:00.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab50) con(0x26ee000) skgpid ospid 7659 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:01.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:01.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:01.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:01.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:01.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:03.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:03.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:03.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:04.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ae002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:04.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:24:04.463 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:24:04.463 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:24:04.463 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:04.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01af002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:04.471 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:24:04.471 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:24:05.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:05.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:05.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:06.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:06.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:07.231 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1090), client(2/0x261bd80) [ CSSD]2013-05-23 15:24:07.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x261bd80) [ CSSD]2013-05-23 15:24:07.231 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:24:07.231 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 15:24:07.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:07.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:07.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:08.283 [1199044928] >TRACE: clssgmAllocProc: (0x26aad30) allocated [ CSSD]2013-05-23 15:24:08.284 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:24:08.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad30 - 1,2,3 [ CSSD]2013-05-23 15:24:08.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee1b0) proc(0x26aad30) pid(7719) version 11:1:1:4 [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aad30), client(1/0x26e1c80) [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1c80 with con 0x26aae60, requested num -1 [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269e060/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:08.290 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:08.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:24:08.295 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1c80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:24:08.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269d820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:08.296 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269d820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:08.498 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad30 [ CSSD]2013-05-23 15:24:08.498 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad30) con(0x26ee1b0) skgpid ospid 7719 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:09.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:09.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:09.264 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:24:09.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b0002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:09.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:11.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:11.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:11.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:11.543 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:11.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:13.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b1002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:13.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:24:13.175 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:24:13.175 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:24:13.175 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:13.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b2002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:13.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:24:13.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:24:13.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:13.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:13.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:14.936 [1199044928] >TRACE: clssgmAllocProc: (0x26aad30) allocated [ CSSD]2013-05-23 15:24:14.937 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:24:14.937 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad30 - 1,2,3 [ CSSD]2013-05-23 15:24:14.937 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee1b0) proc(0x26aad30) pid(7562/7562) version 11:1:1:4 [ CSSD]2013-05-23 15:24:14.954 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aad30), client(1/0x26e1c80) [ CSSD]2013-05-23 15:24:14.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:24:14.954 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:24:14.954 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:24:15.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:15.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:15.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:15.547 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:24:15.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:17.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:17.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:17.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:19.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:24:19.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:19.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:19.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b3002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:19.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:20.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:20.549 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:21.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:21.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:21.521 [1199044928] >TRACE: clssgmAllocProc: (0x2678810) allocated [ CSSD]2013-05-23 15:24:21.522 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:24:21.523 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678810 - 1,2,3 [ CSSD]2013-05-23 15:24:21.523 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dcb0) proc(0x2678810) pid(7858) version 11:1:1:4 [ CSSD]2013-05-23 15:24:21.654 [1199044928] >TRACE: clssgmAllocProc: (0x26b6500) allocated [ CSSD]2013-05-23 15:24:21.655 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:24:21.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6500 - 1,2,3 [ CSSD]2013-05-23 15:24:21.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dd60) proc(0x26b6500) pid(7868) version 11:1:1:4 [ CSSD]2013-05-23 15:24:21.671 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:24:21.673 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:24:21.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6500 [ CSSD]2013-05-23 15:24:21.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6500) con(0x269dd60) skgpid ospid 7868 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5333/0x2678940) [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5333 (0x2678940) [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x2678940 with con 0x269dd60, requested num -1 [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x267be70/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:21.755 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:24:21.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5333 (0x2678940) [ CSSD]2013-05-23 15:24:21.761 [1199044928] >TRACE: clssgmExitGrock: client 5333 (0x2678940), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:24:21.761 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b4240) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:24:21.761 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26b4240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:21.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678810 [ CSSD]2013-05-23 15:24:21.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678810) con(0x269dcb0) skgpid ospid 7858 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:22.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:23.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:23.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:23.539 [1199044928] >TRACE: clssgmAllocProc: (0x2678810) allocated [ CSSD]2013-05-23 15:24:23.540 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:24:23.540 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678810 - 1,2,3 [ CSSD]2013-05-23 15:24:23.540 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dcb0) proc(0x2678810) pid(7896) version 11:1:1:4 [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2678810), client(1/0x2678940) [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678940) [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678940 with con 0x269dd60, requested num -1 [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b43d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:23.557 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:23.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678940) [ CSSD]2013-05-23 15:24:23.565 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678940), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:24:23.565 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267bc20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:23.565 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267bc20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:23.767 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678810 [ CSSD]2013-05-23 15:24:23.767 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678810) con(0x269dcb0) skgpid ospid 7896 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:24.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:25.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:25.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:25.551 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:25.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:26.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:27.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:27.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:28.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:28.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b4002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:28.426 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:24:28.426 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:24:28.426 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:24:28.426 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:28.433 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b5002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:28.433 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:24:28.433 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:24:29.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:29.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b3f60) [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b3f60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b3f60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eeb30 [ CSSD]2013-05-23 15:24:29.483 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eeb30) con(0x26a67c0) skgpid 7526 ospid 7526 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:29.719 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:24:29.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b6002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:30.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:30.554 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:30.554 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:31.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:31.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:31.585 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aad30), client(2/0x26cdbf0) [ CSSD]2013-05-23 15:24:31.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26cdbf0) [ CSSD]2013-05-23 15:24:31.585 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:24:31.585 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 15:24:32.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:33.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:33.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:34.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:35.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:35.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:35.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:35.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:36.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:37.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:37.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:38.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:38.800 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:24:38.800 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:24:38.801 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:24:38.801 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2659ac0) pid(8043) version 11:1:1:4 [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2659ac0), client(1/0x269e380) [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269e380 with con 0x26aa330, requested num -1 [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677eb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:38.818 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:38.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:24:38.824 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269e380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:24:38.824 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26781b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:38.824 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26781b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:39.027 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:24:39.027 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x261bfd0) skgpid ospid 8043 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:39.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:39.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:39.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:24:39.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b7002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:40.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:40.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:40.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:41.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:41.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:42.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:43.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:43.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:43.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b8002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:43.675 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:24:43.675 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:24:43.675 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:24:43.675 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:43.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b9002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:43.684 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:24:43.684 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:24:44.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:44.560 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:44.561 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:24:45.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:45.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:46.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:47.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:47.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:48.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:49.563 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:49.563 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:49.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:49.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:49.775 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:24:49.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ba002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:50.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:51.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:51.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:52.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:53.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:53.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:54.070 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:24:54.071 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:24:54.072 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:24:54.072 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eebf0) proc(0x2659ac0) pid(8205) version 11:1:1:4 [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2659ac0), client(1/0x269e380) [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269e380 with con 0x26aa330, requested num -1 [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677eb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:24:54.077 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:54.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:24:54.084 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269e380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:24:54.084 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26781b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:24:54.084 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26781b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:24:54.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:24:54.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26eebf0) skgpid ospid 8205 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:24:54.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:54.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:54.566 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:55.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:55.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:56.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:57.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:57.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:58.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:24:58.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01bb002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:58.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:24:58.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:24:58.937 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:24:58.937 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:24:58.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01bc002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:58.944 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:24:58.944 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:24:59.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:24:59.568 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:24:59.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:24:59.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:24:59.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bd002c) incarnation(174631051) [ CSSD]2013-05-23 15:24:59.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:00.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:00.929 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:00.930 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:00.931 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:00.931 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2659ac0) pid(8322) version 11:1:1:4 [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2659ac0), client(1/0x269e380) [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269e380 with con 0x26aa330, requested num -1 [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677eb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:25:00.937 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:00.944 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:25:00.944 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269e380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:25:00.944 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26781b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:00.944 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26781b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:25:01.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:25:01.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x261bfd0) skgpid ospid 8322 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:01.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:01.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:02.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:03.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:03.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:04.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:04.570 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:04.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:04.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01be002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:04.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:25:04.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:25:04.727 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:25:04.727 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:04.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01bf002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:04.734 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:25:04.734 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:25:05.055 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:05.056 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:05.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:05.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26eebf0) proc(0x2659ac0) pid(8363/8363) version 11:1:1:4 [ CSSD]2013-05-23 15:25:05.073 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2659ac0), client(1/0x269e200) [ CSSD]2013-05-23 15:25:05.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269e200) [ CSSD]2013-05-23 15:25:05.073 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:05.073 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269e200) [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269e200), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269e200), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:25:05.351 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26eebf0) skgpid 8363 ospid 8363 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:05.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:05.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:06.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:07.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:07.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:08.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:09.320 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:09.320 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:25:09.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:09.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2659ac0) pid(8389) version 11:1:1:4 [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2659ac0), client(1/0x269e380) [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269e380 with con 0x26aa330, requested num -1 [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677eb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:25:09.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:09.343 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269e380) [ CSSD]2013-05-23 15:25:09.343 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269e380), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:25:09.343 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26781b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:09.343 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26781b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:25:09.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:25:09.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x261bfd0) skgpid ospid 8389 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:09.573 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:09.573 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:09.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:09.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:09.922 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:09.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c0002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:10.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:11.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:11.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:12.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:13.575 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:13.575 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:25:13.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:13.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:14.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c1002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:14.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:25:14.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:25:14.186 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:25:14.187 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:14.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c2002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:14.194 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:25:14.194 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:25:14.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:15.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:15.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:16.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:17.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:17.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:18.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x266f1a0) [ CSSD]2013-05-23 15:25:18.266 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x266f1a0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:25:18.266 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x266f1a0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.266 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 15:25:18.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b40e0) [ CSSD]2013-05-23 15:25:18.273 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b40e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:25:18.273 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b40e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.273 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9ea0 [ CSSD]2013-05-23 15:25:18.275 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9ea0) con(0x2678e10) skgpid 2562 ospid 2562 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e86e0 [ CSSD]2013-05-23 15:25:18.276 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e86e0) con(0x26916a0) skgpid 2564 ospid 2564 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:18.278 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2681c20) [ CSSD]2013-05-23 15:25:18.278 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2681c20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:25:18.278 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2681c20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.278 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eece0) [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eece0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eece0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bbcb0 [ CSSD]2013-05-23 15:25:18.286 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bbcb0) con(0x269a6f0) skgpid 2560 ospid 2560 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:18.577 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:18.578 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:18.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:19.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:19.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:19.949 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:19.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c3002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:20.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:21.560 [1199044928] >TRACE: clssgmAllocProc: (0x261bf20) allocated [ CSSD]2013-05-23 15:25:21.560 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:21.561 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bf20 - 1,2,3 [ CSSD]2013-05-23 15:25:21.561 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba3f0) proc(0x261bf20) pid(8501/8501) version 11:1:1:4 [ CSSD]2013-05-23 15:25:21.577 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261bf20), client(1/0x26ee2d0) [ CSSD]2013-05-23 15:25:21.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:25:21.577 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:21.577 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:25:21.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:21.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:22.000 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:22.001 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:22.001 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:22.001 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x2659ac0) pid(8534/8534) version 11:1:1:4 [ CSSD]2013-05-23 15:25:22.006 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2659ac0), client(1/0x266f1a0) [ CSSD]2013-05-23 15:25:22.006 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:25:22.006 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:22.006 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:25:22.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:23.580 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:23.580 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:23.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:23.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:25:24.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26916a0) skgpid 8534 ospid 8534 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:24.581 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:24.582 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:25:24.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:24.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x2659ac0) pid(8567) version 11:1:1:4 [ CSSD]2013-05-23 15:25:24.589 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2659ac0), client(1/0x266f1a0) [ CSSD]2013-05-23 15:25:24.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:25:24.589 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:25:24.589 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:24.589 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269acc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:25:24.590 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:25:24.590 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:24.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:25:24.596 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:25:24.596 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269afc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:24.597 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269afc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:25:24.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:24.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:25:24.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26916a0) skgpid ospid 8567 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:25.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:25.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:26.197 [1199044928] >TRACE: clssgmAllocProc: (0x2659ac0) allocated [ CSSD]2013-05-23 15:25:26.198 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:26.199 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2659ac0 - 1,2,3 [ CSSD]2013-05-23 15:25:26.199 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x2659ac0) pid(8499/8499) version 11:1:1:4 [ CSSD]2013-05-23 15:25:26.215 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2659ac0), client(1/0x266f1a0) [ CSSD]2013-05-23 15:25:26.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:25:26.215 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:26.215 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:25:26.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:27.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:27.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:28.315 [1199044928] >TRACE: clssgmAllocProc: (0x26909b0) allocated [ CSSD]2013-05-23 15:25:28.316 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:28.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26909b0 - 1,2,3 [ CSSD]2013-05-23 15:25:28.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b010) proc(0x26909b0) pid(7560/7560) version 11:1:1:4 [ CSSD]2013-05-23 15:25:28.322 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26909b0), client(1/0x2678d00) [ CSSD]2013-05-23 15:25:28.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:25:28.322 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:28.322 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:25:28.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:28.582 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:28.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:29.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c4002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:29.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:25:29.439 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:25:29.439 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:25:29.439 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:29.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c5002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:29.447 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:25:29.447 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:25:29.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:29.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:29.972 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:29.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c6002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:30.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:31.292 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261bf20), client(2/0x2679070) [ CSSD]2013-05-23 15:25:31.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2679070) [ CSSD]2013-05-23 15:25:31.292 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:25:31.292 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 15:25:31.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:31.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:32.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:33.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:33.585 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:33.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:33.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:34.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:36.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:36.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:36.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:38.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:38.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:38.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:38.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:38.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:39.834 [1199044928] >TRACE: clssgmAllocProc: (0x26edd90) allocated [ CSSD]2013-05-23 15:25:39.835 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:25:39.836 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edd90 - 1,2,3 [ CSSD]2013-05-23 15:25:39.836 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678870) proc(0x26edd90) pid(8736) version 11:1:1:4 [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edd90), client(1/0x26eed10) [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x26a9fc0, requested num -1 [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bac80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:25:39.842 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:39.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:25:39.849 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:25:39.849 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baf80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:39.849 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baf80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:25:39.995 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:40.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c7002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:40.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edd90 [ CSSD]2013-05-23 15:25:40.052 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edd90) con(0x2678870) skgpid ospid 8736 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:40.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:40.060 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:40.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:40.900 [1199044928] >TRACE: clssgmAllocProc: (0x26eddf0) allocated [ CSSD]2013-05-23 15:25:40.901 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:25:40.901 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eddf0 - 1,2,3 [ CSSD]2013-05-23 15:25:40.901 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678870) proc(0x26eddf0) pid(7558/7558) version 11:1:1:4 [ CSSD]2013-05-23 15:25:40.906 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26eddf0), client(1/0x26eed10) [ CSSD]2013-05-23 15:25:40.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:25:40.906 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:25:40.906 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:25:42.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:42.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:42.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:42.589 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:25:42.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:44.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:44.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:44.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c8002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:44.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:25:44.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:25:44.689 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:25:44.689 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:44.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c9002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:44.697 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:25:44.697 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:25:44.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:46.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:46.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:46.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:47.591 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:47.591 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:48.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:48.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:48.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:50.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:25:50.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ca002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:50.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:50.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:50.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:52.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:52.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:52.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:52.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:52.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:54.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:54.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:54.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:55.092 [1199044928] >TRACE: clssgmAllocProc: (0x2681720) allocated [ CSSD]2013-05-23 15:25:55.093 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:25:55.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681720 - 1,2,3 [ CSSD]2013-05-23 15:25:55.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb080) proc(0x2681720) pid(8956) version 11:1:1:4 [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681720), client(1/0x26dccf0) [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dccf0) [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dccf0 with con 0x2681650, requested num -1 [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dce60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:25:55.100 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:55.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dccf0) [ CSSD]2013-05-23 15:25:55.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dccf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:25:55.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd160) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:25:55.107 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd160) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:25:55.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681720 [ CSSD]2013-05-23 15:25:55.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681720) con(0x26bb080) skgpid ospid 8956 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:25:56.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:56.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:56.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:57.596 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:25:57.596 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:25:58.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:25:58.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:25:58.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:25:59.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cb002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:59.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:25:59.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:25:59.940 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:25:59.940 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:25:59.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01cc002c) incarnation(174631051) [ CSSD]2013-05-23 15:25:59.947 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:25:59.947 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:00.043 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:00.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cd002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:00.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:00.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:00.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:01.181 [1199044928] >TRACE: clssgmAllocProc: (0x2681720) allocated [ CSSD]2013-05-23 15:26:01.182 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:26:01.183 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681720 - 1,2,3 [ CSSD]2013-05-23 15:26:01.183 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb080) proc(0x2681720) pid(9061) version 11:1:1:4 [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681720), client(1/0x26dccf0) [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dccf0) [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dccf0 with con 0x2681650, requested num -1 [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dce60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:26:01.189 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:01.196 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dccf0) [ CSSD]2013-05-23 15:26:01.196 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dccf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:26:01.196 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd160) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:01.196 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd160) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:26:01.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681720 [ CSSD]2013-05-23 15:26:01.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681720) con(0x26bb080) skgpid ospid 9061 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:02.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:02.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:02.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:02.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:02.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:04.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:04.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:04.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ce002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:04.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:26:04.980 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:26:04.980 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:26:04.980 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:04.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01cf002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:04.986 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:26:04.986 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:05.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:06.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:06.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:07.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:07.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:07.601 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:08.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:08.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:09.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:10.068 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:10.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d0002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:10.352 [1199044928] >TRACE: clssgmAllocProc: (0x26bbbf0) allocated [ CSSD]2013-05-23 15:26:10.353 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:26:10.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bbbf0 - 1,2,3 [ CSSD]2013-05-23 15:26:10.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdb0) proc(0x26bbbf0) pid(9129) version 11:1:1:4 [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26bbbf0), client(1/0x26dcc30) [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dcc30) [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dcc30 with con 0x26bbd20, requested num -1 [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcda0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:26:10.360 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:10.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:10.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:10.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dcc30) [ CSSD]2013-05-23 15:26:10.367 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dcc30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:26:10.367 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dd0a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:10.367 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dd0a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:26:10.569 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bbbf0 [ CSSD]2013-05-23 15:26:10.569 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bbbf0) con(0x267bdb0) skgpid ospid 9129 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:11.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:11.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:11.603 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:26:12.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:12.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:13.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:13.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d1002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:13.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:26:13.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:26:13.899 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:26:13.899 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:13.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d2002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:13.906 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:26:13.906 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:14.035 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:26:14.036 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:26:14.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:26:14.038 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:26:14.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:14.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:15.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:15.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d3002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:15.196 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:26:15.196 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:26:15.196 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:26:15.196 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:15.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d4002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:15.204 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:26:15.204 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:16.044 [1199044928] >TRACE: clssgmAllocProc: (0x26814d0) allocated [ CSSD]2013-05-23 15:26:16.045 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:26:16.045 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26814d0 - 1,2,3 [ CSSD]2013-05-23 15:26:16.045 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdb0) proc(0x26814d0) pid(9202/9202) version 11:1:1:4 [ CSSD]2013-05-23 15:26:16.051 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26814d0), client(1/0x26bbd10) [ CSSD]2013-05-23 15:26:16.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bbd10) [ CSSD]2013-05-23 15:26:16.051 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:26:16.051 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bbd10) [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bbd10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bbd10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmDeadProc: proc 0x26814d0 [ CSSD]2013-05-23 15:26:16.070 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26814d0) con(0x267bdb0) skgpid 9202 ospid 9202 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:16.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:16.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:16.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:16.606 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:17.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:18.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:18.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:19.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:20.090 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:20.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d5002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:20.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:20.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:21.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:21.608 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:21.608 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:22.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:22.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cd9b0 [ CSSD]2013-05-23 15:26:22.647 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cd9b0) con(0x266f0d0) skgpid 3385 ospid 3385 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:22.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b9490) [ CSSD]2013-05-23 15:26:22.655 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b9490), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:26:22.655 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b9490), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:26:22.655 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9550) [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9550), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9550), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 15:26:22.665 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x26edf50) skgpid 3387 ospid 3387 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:23.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:24.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:24.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:25.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:25.612 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:26:25.613 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:26:25.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:26:25.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6a30) pid(9302) version 11:1:1:4 [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267bdb0, requested num -1 [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:26:25.619 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:25.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:25.626 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:26:25.626 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:25.626 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:26:25.829 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:26:25.829 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x269b490) skgpid ospid 9302 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:26.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:26.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:26.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:26.611 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:27.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:28.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:28.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:29.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:30.111 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:30.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d6002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:30.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d7002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:30.448 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:26:30.448 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:26:30.448 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:26:30.448 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:30.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d8002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:30.457 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:26:30.457 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:30.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:30.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:31.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:31.613 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:31.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:32.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:32.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:33.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:34.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:34.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:35.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:36.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:36.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:36.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:36.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:37.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:38.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:38.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:39.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:40.138 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:40.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:40.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:40.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:40.618 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:26:40.863 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:26:40.863 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:26:40.864 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:26:40.864 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6a30) pid(9443) version 11:1:1:4 [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x266f0d0, requested num -1 [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:26:40.881 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:40.888 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:40.888 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:26:40.888 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:40.889 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:26:41.091 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:26:41.091 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x269b490) skgpid ospid 9443 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:41.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:41.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d9002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:42.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:42.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:43.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:44.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:44.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:45.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:45.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:45.621 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:45.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01da002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:45.700 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:26:45.700 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:26:45.700 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:26:45.700 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:45.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01db002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:45.707 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:26:45.707 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:26:46.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:46.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:47.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:48.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:48.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:49.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:50.159 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:26:50.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:50.623 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:50.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:50.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:51.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:51.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01dc002c) incarnation(174631051) [ CSSD]2013-05-23 15:26:52.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:52.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:53.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:54.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:54.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:55.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:55.626 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:26:55.626 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:26:56.124 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:26:56.125 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:26:56.126 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:26:56.126 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6a30) pid(9601) version 11:1:1:4 [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267bdb0, requested num -1 [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:26:56.132 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:26:56.139 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:26:56.139 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:26:56.139 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:26:56.139 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:26:56.342 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:26:56.342 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x269b490) skgpid ospid 9601 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:26:56.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:56.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:57.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:26:58.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:26:58.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:26:59.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:00.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:00.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:00.628 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:00.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:00.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:00.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01dd002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:00.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:00.950 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:00.950 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:27:00.950 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:00.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01de002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:00.957 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:00.957 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:01.445 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:01.446 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:27:01.447 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:01.447 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(9683) version 11:1:1:4 [ CSSD]2013-05-23 15:27:01.454 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:01.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:01.454 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267bdb0, requested num -1 [ CSSD]2013-05-23 15:27:01.454 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:01.454 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:01.455 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:01.455 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:01.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:01.461 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:01.461 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:01.461 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:01.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:01.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:01.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 9683 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:02.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01df002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:02.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:02.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:03.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:04.630 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:04.631 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:27:04.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:04.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:05.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e0002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:05.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:05.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:05.241 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:27:05.241 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:05.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e1002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:05.249 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:05.249 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:05.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:06.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:06.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:07.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:08.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:08.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:09.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:09.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:09.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:10.167 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:10.168 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:27:10.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:10.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(9775) version 11:1:1:4 [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:10.175 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:10.182 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:10.182 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:10.182 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:10.182 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:10.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:10.384 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:10.384 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 9775 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:10.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:10.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:11.376 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:11.377 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:27:11.377 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:11.377 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26b6a30) pid(9807) version 11:1:1:4 [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x266f0d0, requested num -1 [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:11.383 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:11.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:11.390 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:11.390 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:11.390 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:11.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:11.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:11.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x269b490) skgpid ospid 9807 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:11.980 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:11.981 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:27:11.982 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:11.982 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(9864) version 11:1:1:4 [ CSSD]2013-05-23 15:27:12.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e2002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:12.180 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:27:12.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:27:12.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:27:12.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:27:12.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e3002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:12.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:12.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:12.248 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:27:12.248 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:27:12.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e4002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:12.255 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:12.255 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:12.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:12.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:13.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:14.635 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:14.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:14.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:14.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 9864 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:14.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:14.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:15.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:16.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e5002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:16.207 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:16.207 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:16.207 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:27:16.207 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:16.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e6002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:16.214 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:16.214 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:16.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:16.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:17.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:18.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:18.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:19.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:19.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:19.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:20.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:20.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:20.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:21.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:22.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e7002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:22.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:22.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:23.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:24.641 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:24.641 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:24.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:24.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:25.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:26.625 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:26.626 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:27:26.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:26.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdb0) proc(0x26b6a30) pid(10303) version 11:1:1:4 [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x266f0d0, requested num -1 [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:26.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:26.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:26.650 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:26.650 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:26.650 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:26.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:26.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x267bdb0) skgpid ospid 10303 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:27.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:27.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:27.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:29.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:29.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:29.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:29.643 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:29.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:30.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:31.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:31.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:31.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e8002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:31.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:31.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:31.464 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:27:31.464 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:31.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e9002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:31.473 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:31.473 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:31.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:32.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ea002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:33.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:33.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:33.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:34.646 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:34.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:35.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:35.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:35.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:37.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:37.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:37.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:39.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:39.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:39.648 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:39.648 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:39.665 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:39.665 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:27:39.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:39.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(10475) version 11:1:1:4 [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267bdb0, requested num -1 [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:39.682 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:39.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:39.689 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:39.689 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:39.689 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:39.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:39.891 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:39.891 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 10475 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:40.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:41.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:41.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:41.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:41.893 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:41.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:27:41.895 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:41.895 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(10517) version 11:1:1:4 [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681d90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:41.911 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:41.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:41.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:41.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:41.919 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:42.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:27:42.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 10517 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:42.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01eb002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:43.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:43.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:43.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:44.651 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:44.651 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:45.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:45.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:45.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:46.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ec002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:46.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:27:46.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:27:46.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:27:46.715 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:46.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ed002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:46.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:27:46.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:27:47.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:47.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:47.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:49.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:49.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:49.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:49.653 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:49.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:50.183 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:27:50.184 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:27:50.185 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:27:50.185 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(10599/10599) version 11:1:1:4 [ CSSD]2013-05-23 15:27:50.190 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26b6a30), client(1/0x261cb10) [ CSSD]2013-05-23 15:27:50.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:27:50.190 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:27:50.190 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:27:50.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:27:51.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:51.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:51.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:52.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ee002c) incarnation(174631051) [ CSSD]2013-05-23 15:27:53.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:53.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:53.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:54.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:54.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:55.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:55.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:55.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:57.153 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:27:57.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:27:57.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:27:57.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26bb940) pid(10661) version 11:1:1:4 [ CSSD]2013-05-23 15:27:57.160 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26cdb40) [ CSSD]2013-05-23 15:27:57.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdb40) [ CSSD]2013-05-23 15:27:57.160 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdb40 with con 0x26ba660, requested num -1 [ CSSD]2013-05-23 15:27:57.160 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:57.160 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:27:57.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:27:57.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:27:57.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdb40) [ CSSD]2013-05-23 15:27:57.167 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdb40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:27:57.167 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:27:57.167 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:27:57.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:57.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:57.369 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:27:57.369 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cddc0) skgpid ospid 10661 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:27:57.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:27:59.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:27:59.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:27:59.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:27:59.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:27:59.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:00.316 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:01.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:01.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:01.702 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:01.703 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:28:01.704 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:01.704 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26bb940) pid(10748) version 11:1:1:4 [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26ba660) [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ba660 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:01.720 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:01.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:01.727 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ba660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:28:01.727 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:01.727 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:01.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:01.930 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:01.930 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cddc0) skgpid ospid 10748 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:01.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ef002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:01.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:28:01.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:28:01.965 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:28:01.965 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:01.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f0002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:01.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:28:01.972 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:28:02.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f1002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:03.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:03.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:03.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:03.661 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:28:03.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:05.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:05.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:05.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f2002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:05.504 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:28:05.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:28:05.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:28:05.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:05.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f3002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:05.511 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:28:05.511 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:28:05.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:07.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:07.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:07.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:08.663 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:08.663 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:09.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:09.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:09.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:10.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:11.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:11.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:12.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:12.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f4002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:12.402 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:12.403 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:28:12.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:12.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdb40) proc(0x26bb940) pid(10828) version 11:1:1:4 [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26ba660) [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ba660 with con 0x26cddc0, requested num -1 [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:12.409 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:12.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:12.415 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ba660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:28:12.415 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:12.415 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:12.618 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:12.618 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cdb40) skgpid ospid 10828 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:13.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:13.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:13.666 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:13.666 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:14.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:15.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:15.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:16.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:17.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f5002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:17.223 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:28:17.223 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:28:17.223 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:28:17.223 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:17.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f6002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:17.230 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:28:17.230 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:28:17.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:17.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:18.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:18.669 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:18.669 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:19.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:19.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:20.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:20.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:21.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:21.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:22.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:22.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f7002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:23.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:23.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:23.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:23.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:24.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:25.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:25.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:26.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:27.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:27.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:27.661 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:27.661 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:28:27.662 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:27.662 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26bb940) pid(11014) version 11:1:1:4 [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26ba660) [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ba660 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:27.667 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:27.673 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:27.673 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ba660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:28:27.673 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:27.673 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:27.673 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:27.674 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:28:27.875 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:27.875 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cddc0) skgpid ospid 11014 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:28.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:29.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:29.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:30.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:30.383 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:31.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:31.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:32.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:32.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f8002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:32.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f9002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:32.473 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:28:32.473 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:28:32.473 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:28:32.473 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:32.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fa002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:32.480 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:28:32.480 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:28:32.676 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:32.676 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:33.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:33.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:34.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:35.047 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:35.048 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:28:35.049 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:35.049 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26bb940) pid(11100) version 11:1:1:4 [ CSSD]2013-05-23 15:28:35.055 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26cddc0) [ CSSD]2013-05-23 15:28:35.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:28:35.055 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26cddc0 with con 0x26ba660, requested num -1 [ CSSD]2013-05-23 15:28:35.055 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:28:35.055 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:28:35.056 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:35.056 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:35.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:28:35.062 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cddc0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:28:35.062 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:28:35.062 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:35.169 [1199044928] >TRACE: clssgmAllocProc: (0x2695d00) allocated [ CSSD]2013-05-23 15:28:35.170 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:28:35.171 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2695d00 - 1,2,3 [ CSSD]2013-05-23 15:28:35.171 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba660) proc(0x2695d00) pid(11106) version 11:1:1:4 [ CSSD]2013-05-23 15:28:35.196 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:28:35.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:28:35.200 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:28:35.201 [1199044928] >TRACE: clssgmDeadProc: proc 0x2695d00 [ CSSD]2013-05-23 15:28:35.201 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2695d00) con(0x26ba660) skgpid ospid 11106 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:35.265 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:35.265 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x269b490) skgpid ospid 11100 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:35.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:35.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:36.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:37.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:37.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:37.679 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:37.679 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:38.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:39.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:39.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:40.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:40.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:40.738 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:40.739 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:28:40.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:40.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26bb940) pid(11165) version 11:1:1:4 [ CSSD]2013-05-23 15:28:41.330 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:41.330 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cddc0) skgpid ospid 11165 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:41.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:41.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:42.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:42.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fb002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:42.682 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:42.682 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:42.907 [1199044928] >TRACE: clssgmAllocProc: (0x26bb940) allocated [ CSSD]2013-05-23 15:28:42.908 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:28:42.909 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb940 - 1,2,3 [ CSSD]2013-05-23 15:28:42.909 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26bb940) pid(11330) version 11:1:1:4 [ CSSD]2013-05-23 15:28:42.914 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb940), client(1/0x26ba660) [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ba660 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:42.915 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:42.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ba660) [ CSSD]2013-05-23 15:28:42.922 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ba660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:28:42.922 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:42.922 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:43.125 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb940 [ CSSD]2013-05-23 15:28:43.125 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb940) con(0x26cddc0) skgpid ospid 11330 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:43.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:43.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:44.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:45.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:45.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:46.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:47.684 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:47.685 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:47.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:47.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:47.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fc002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:47.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:28:47.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:28:47.724 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:28:47.724 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:47.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fd002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:47.731 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:28:47.731 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:28:48.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:49.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:49.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:50.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:50.433 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:28:51.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:51.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:52.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fe002c) incarnation(174631051) [ CSSD]2013-05-23 15:28:52.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:52.680 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2680040) [ CSSD]2013-05-23 15:28:52.680 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2680040), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:28:52.680 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2680040), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:28:52.680 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 15:28:52.687 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:52.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:28:52.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c440) [ CSSD]2013-05-23 15:28:52.690 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c440), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:28:52.690 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c440), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:28:52.690 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:28:52.690 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698b80 [ CSSD]2013-05-23 15:28:52.691 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698b80) con(0x26e1280) skgpid 5450 ospid 5450 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:53.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:53.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:54.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:55.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:55.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:56.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:56.689 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:28:56.690 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:28:57.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:57.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:28:58.158 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:28:58.158 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:28:58.159 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:28:58.159 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26ba4b0) pid(11476) version 11:1:1:4 [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba4b0), client(1/0x26e1280) [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1280) [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1280 with con 0x26cdb40, requested num -1 [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26789f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:28:58.176 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:28:58.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1280) [ CSSD]2013-05-23 15:28:58.183 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1280), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:28:58.183 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261b9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:28:58.183 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261b9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:28:58.385 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:28:58.385 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x269b490) skgpid ospid 11476 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:28:58.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:28:59.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:28:59.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:00.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:00.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:01.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:01.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:01.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:01.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:01.969 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:29:01.970 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:29:01.971 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:29:01.971 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26ba4b0) pid(11557) version 11:1:1:4 [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba4b0), client(1/0x26e1280) [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1280) [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1280 with con 0x26cdb40, requested num -1 [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26789f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:01.977 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:01.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1280) [ CSSD]2013-05-23 15:29:01.984 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1280), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:29:01.984 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261b9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:01.984 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261b9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:02.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:29:02.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x269b490) skgpid ospid 11557 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:02.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ff002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:02.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:02.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0200002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:02.983 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:29:02.983 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:29:02.983 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:29:02.983 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:02.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0201002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:02.989 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:29:02.989 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:29:03.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:03.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:04.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:05.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0202002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:05.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:29:05.763 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:29:05.763 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:29:05.763 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:05.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0203002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:05.771 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:29:05.771 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:29:05.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:05.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:06.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:06.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:06.695 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:07.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:07.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:08.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:09.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:09.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:10.477 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:10.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:11.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:11.698 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:11.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:11.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:12.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0204002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:12.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:13.420 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:29:13.421 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:29:13.422 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:29:13.422 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26ba4b0) pid(11647) version 11:1:1:4 [ CSSD]2013-05-23 15:29:13.428 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba4b0), client(1/0x26cdb40) [ CSSD]2013-05-23 15:29:13.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdb40) [ CSSD]2013-05-23 15:29:13.428 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdb40 with con 0x26e1280, requested num -1 [ CSSD]2013-05-23 15:29:13.428 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:13.428 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26789f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:29:13.429 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:13.429 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:13.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdb40) [ CSSD]2013-05-23 15:29:13.436 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdb40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:29:13.436 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261b9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:13.436 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261b9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:13.638 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:29:13.638 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x26cddc0) skgpid ospid 11647 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:13.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:13.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:14.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:15.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:15.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:16.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:16.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:16.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:17.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:17.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:18.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0205002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:18.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:29:18.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:29:18.234 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:29:18.235 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:18.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0206002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:18.242 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:29:18.242 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:29:18.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:20.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:20.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:20.498 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:20.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:20.702 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:20.702 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:29:21.834 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:29:21.835 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:29:21.835 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:29:21.835 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26ba4b0) pid(11750) version 11:1:1:4 [ CSSD]2013-05-23 15:29:21.961 [1199044928] >TRACE: clssgmAllocProc: (0x267c3b0) allocated [ CSSD]2013-05-23 15:29:21.962 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:29:21.962 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c3b0 - 1,2,3 [ CSSD]2013-05-23 15:29:21.962 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x267c3b0) pid(11776) version 11:1:1:4 [ CSSD]2013-05-23 15:29:21.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:29:21.982 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:29:21.985 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c3b0 [ CSSD]2013-05-23 15:29:21.985 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c3b0) con(0x26e1280) skgpid ospid 11776 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:22.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:22.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5334/0x26e1280) [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5334 (0x26e1280) [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26e1280 with con 0x269b490, requested num -1 [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x267c1d0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:22.062 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:29:22.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5334 (0x26e1280) [ CSSD]2013-05-23 15:29:22.070 [1199044928] >TRACE: clssgmExitGrock: client 5334 (0x26e1280), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:29:22.070 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2698d20) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:29:22.071 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2698d20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:22.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:29:22.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x26cddc0) skgpid ospid 11750 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:22.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0207002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:22.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:24.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:24.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:24.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:25.705 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:25.705 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:26.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:26.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:26.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:28.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:28.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:28.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:28.675 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:29:28.675 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:29:28.676 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:29:28.676 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26ba4b0) pid(11834) version 11:1:1:4 [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba4b0), client(1/0x26cddc0) [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cddc0 with con 0x26e1280, requested num -1 [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267c1d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:28.682 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:28.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:29:28.689 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cddc0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:29:28.689 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261b9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:28.689 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261b9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:28.892 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:29:28.892 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x269b490) skgpid ospid 11834 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:30.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:30.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:30.521 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:30.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:30.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:30.707 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:32.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:32.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:32.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0208002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:32.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:33.026 [1199044928] >TRACE: clssgmAllocProc: (0x26ba4b0) allocated [ CSSD]2013-05-23 15:29:33.027 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:29:33.027 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba4b0 - 1,2,3 [ CSSD]2013-05-23 15:29:33.027 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdb40) proc(0x26ba4b0) pid(10716/10716) version 11:1:1:4 [ CSSD]2013-05-23 15:29:33.044 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba4b0), client(1/0x26cddc0) [ CSSD]2013-05-23 15:29:33.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:29:33.044 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:29:33.044 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:29:33.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0209002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:33.484 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:29:33.484 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:29:33.484 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:29:33.484 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:33.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020a002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:33.491 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:29:33.491 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:29:34.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:34.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:34.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:35.709 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:35.710 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:36.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:36.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:36.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:38.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:38.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:38.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:40.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:40.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:40.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:40.712 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:40.712 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:40.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:42.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:42.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:42.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020b002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:42.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:43.925 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:29:43.926 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:29:43.926 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:29:43.926 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(11982) version 11:1:1:4 [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:43.933 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:43.940 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:29:43.940 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:29:43.940 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:43.940 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:44.143 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:29:44.143 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 11982 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:44.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:44.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:44.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:45.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:45.715 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:46.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:46.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:46.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:48.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:48.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:48.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020c002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:48.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:29:48.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:29:48.734 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:29:48.734 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:48.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020d002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:48.740 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:29:48.740 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:29:48.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:49.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:49.716 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:29:50.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:50.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:50.572 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:29:50.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:52.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:52.329 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:52.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020e002c) incarnation(174631051) [ CSSD]2013-05-23 15:29:52.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:54.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:54.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:54.719 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:54.719 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:29:54.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:56.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:56.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:56.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:58.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:29:58.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:29:58.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:29:59.186 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:29:59.187 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:29:59.188 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:29:59.188 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12121) version 11:1:1:4 [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:29:59.194 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:29:59.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:29:59.201 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:29:59.201 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:29:59.201 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:29:59.403 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:29:59.403 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12121 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:29:59.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:29:59.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:00.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:00.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:00.597 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:00.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:02.236 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:30:02.237 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:30:02.238 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:30:02.238 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12341) version 11:1:1:4 [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:30:02.254 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:02.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:02.261 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:30:02.261 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:02.261 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:30:02.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:02.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:02.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:30:02.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12341 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:30:02.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020f002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:02.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:03.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0210002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:03.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:03.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:03.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:03.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:03.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0211002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:03.999 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:03.999 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:04.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:04.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:04.667 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:30:04.668 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:30:04.668 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:30:04.668 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26bb440) pid(12393/12393) version 11:1:1:4 [ CSSD]2013-05-23 15:30:04.684 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bb820) [ CSSD]2013-05-23 15:30:04.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bb820) [ CSSD]2013-05-23 15:30:04.684 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:30:04.684 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:30:04.724 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:04.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:04.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bb820) [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bb820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bb820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:30:04.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x269b490) skgpid 12393 ospid 12393 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:30:06.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0212002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:06.022 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:06.022 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:06.022 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:06.022 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:06.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0213002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:06.029 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:06.029 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:06.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:06.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:06.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:08.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:08.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:09.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:09.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:09.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:10.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:10.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:10.618 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:11.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:12.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:12.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:12.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0214002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:13.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:14.437 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:30:14.438 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:30:14.438 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:30:14.438 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12457) version 11:1:1:4 [ CSSD]2013-05-23 15:30:14.454 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:30:14.454 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:14.454 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:30:14.454 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:14.454 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:30:14.455 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:30:14.455 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:14.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:14.461 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:30:14.461 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:14.462 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:30:14.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:14.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:14.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:30:14.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12457 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:30:14.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:14.730 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:15.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:16.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:16.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:17.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:18.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:18.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:19.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:19.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0215002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:19.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:19.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:19.241 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:19.241 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:19.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0216002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:19.248 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:19.248 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:19.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:19.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:20.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:20.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:20.644 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:21.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:22.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0217002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:22.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:22.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:23.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:24.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:24.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:24.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:24.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:25.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:26.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:26.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:27.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:28.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:28.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:29.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:29.697 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:30:29.697 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:30:29.698 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:30:29.698 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12614) version 11:1:1:4 [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:30:29.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:29.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:30:29.710 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:30:29.710 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:29.710 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:30:29.738 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:29.738 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:29.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:30:29.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12614 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:30:30.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:30.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:30.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:31.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:32.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0218002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:32.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:32.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:33.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:34.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0219002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:34.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:34.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:34.491 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:34.491 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:34.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021a002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:34.498 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:34.498 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:34.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:34.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:34.741 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:34.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:35.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:36.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:36.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:37.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:38.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:38.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:39.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:39.743 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:39.743 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:40.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:40.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:40.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:41.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:42.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021b002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:42.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:42.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:43.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:44.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:44.746 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:44.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:44.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:44.945 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:30:44.946 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:30:44.947 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:30:44.947 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26bb440) pid(12784) version 11:1:1:4 [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bb9a0) [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb9a0) [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb9a0 with con 0x2678c50, requested num -1 [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:30:44.963 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:44.969 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb9a0) [ CSSD]2013-05-23 15:30:44.970 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb9a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:30:44.970 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbb10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:30:44.970 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbb10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:30:45.172 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:30:45.172 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x269b490) skgpid ospid 12784 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:30:45.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:46.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:46.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:47.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:48.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:48.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:49.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:49.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021c002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:49.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:49.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:49.741 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:49.742 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:49.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:49.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:49.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021d002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:49.750 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:49.750 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:50.707 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:30:50.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:50.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:51.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:52.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021e002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:52.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:52.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:53.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:54.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:54.751 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:30:54.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:54.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:54.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021f002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:54.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:30:54.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:30:54.932 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:30:54.932 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:30:54.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0220002c) incarnation(174631051) [ CSSD]2013-05-23 15:30:54.939 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:30:54.939 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:30:55.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:56.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:56.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:57.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:58.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:30:58.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:30:59.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:30:59.754 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:30:59.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:00.216 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:31:00.216 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:31:00.217 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:31:00.217 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12924) version 11:1:1:4 [ CSSD]2013-05-23 15:31:00.222 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:31:00.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:31:00.222 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:31:00.222 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:00.222 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:31:00.223 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:31:00.223 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:00.229 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:31:00.229 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:31:00.229 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:00.229 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:31:00.431 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:31:00.431 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12924 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:00.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:00.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:00.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:01.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:02.504 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:31:02.505 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:31:02.505 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:31:02.505 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26bb440) pid(12999) version 11:1:1:4 [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bba70) [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bba70 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:31:02.511 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:02.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bba70) [ CSSD]2013-05-23 15:31:02.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bba70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:31:02.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:02.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:31:02.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0221002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:02.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:31:02.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x2678c50) skgpid ospid 12999 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:03.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:03.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:03.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:04.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:04.756 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:05.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0222002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:05.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:05.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:05.000 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:31:05.000 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:05.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0223002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:05.007 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:05.007 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:05.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:05.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:05.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:06.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0224002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:06.279 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:06.279 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:06.279 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:31:06.279 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:06.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0225002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:06.285 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:06.285 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:07.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:07.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:07.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:09.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:09.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:09.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:09.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:09.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:10.755 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:11.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:11.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:11.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:12.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0226002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:13.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:13.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:13.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:14.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0227002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:14.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:14.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:14.198 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:31:14.198 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:14.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0228002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:14.205 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:14.205 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:14.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:31:14.334 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:31:14.335 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:31:14.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:31:14.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:14.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:15.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:15.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:15.464 [1199044928] >TRACE: clssgmAllocProc: (0x26bb440) allocated [ CSSD]2013-05-23 15:31:15.465 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:31:15.465 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb440 - 1,2,3 [ CSSD]2013-05-23 15:31:15.465 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b490) proc(0x26bb440) pid(13126) version 11:1:1:4 [ CSSD]2013-05-23 15:31:15.471 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb440), client(1/0x26bb9a0) [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb9a0) [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb9a0 with con 0x2678c50, requested num -1 [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:31:15.472 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:15.479 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb9a0) [ CSSD]2013-05-23 15:31:15.479 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb9a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:31:15.479 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbb10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:15.479 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbb10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:31:15.574 [1199044928] >TRACE: clssgmAllocProc: (0x26817b0) allocated [ CSSD]2013-05-23 15:31:15.575 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:31:15.575 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26817b0 - 1,2,3 [ CSSD]2013-05-23 15:31:15.575 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678c50) proc(0x26817b0) pid(13165/13165) version 11:1:1:4 [ CSSD]2013-05-23 15:31:15.591 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26817b0), client(1/0x26815c0) [ CSSD]2013-05-23 15:31:15.591 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26815c0) [ CSSD]2013-05-23 15:31:15.591 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:31:15.591 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:31:15.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26815c0) [ CSSD]2013-05-23 15:31:15.609 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26815c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:31:15.609 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26815c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:31:15.609 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:31:15.610 [1199044928] >TRACE: clssgmDeadProc: proc 0x26817b0 [ CSSD]2013-05-23 15:31:15.610 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26817b0) con(0x2678c50) skgpid 13165 ospid 13165 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:15.682 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb440 [ CSSD]2013-05-23 15:31:15.682 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb440) con(0x269b490) skgpid ospid 13126 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:15.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:17.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:17.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:17.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:19.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:19.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:19.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:19.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:19.764 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:20.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0229002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:20.247 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:20.247 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:20.247 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:31:20.247 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:20.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022a002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:20.254 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:20.254 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:20.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:21.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:21.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:21.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678d00) [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678d00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x26909b0 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26909b0) con(0x269b010) skgpid 7560 ospid 7560 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26cdbf0) [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26cdbf0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:31:22.710 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26cdbf0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:31:22.711 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e1c80) [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e1c80), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e1c80), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad30 [ CSSD]2013-05-23 15:31:22.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad30) con(0x26ee1b0) skgpid 7562 ospid 7562 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eed10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eed10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eddf0 [ CSSD]2013-05-23 15:31:22.719 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eddf0) con(0x2678870) skgpid 7558 ospid 7558 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:22.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022b002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:23.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:23.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:23.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:24.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:24.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:25.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:25.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:25.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:27.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:27.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:27.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:29.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:29.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:29.769 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:29.769 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:29.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:30.715 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:31:30.716 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:31:30.716 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:31:30.716 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(13350) version 11:1:1:4 [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26eed10) [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:31:30.722 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:30.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:31:30.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:31:30.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:30.728 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:31:30.804 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:30.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:31:30.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 13350 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:31.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:31.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:31.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:32.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022c002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:33.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:33.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:33.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:33.772 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:31:33.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:35.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:35.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:35.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022d002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:35.506 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:35.506 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:35.506 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:31:35.507 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:35.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022e002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:35.514 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:35.514 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:35.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:37.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:37.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:37.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:38.774 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:38.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:39.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:39.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:39.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:40.826 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:41.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:41.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:41.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:42.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022f002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:43.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:43.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:43.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:43.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:44.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:45.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:45.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:45.971 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0d0) allocated [ CSSD]2013-05-23 15:31:45.972 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:31:45.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0d0 - 1,2,3 [ CSSD]2013-05-23 15:31:45.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26ee0d0) pid(13492) version 11:1:1:4 [ CSSD]2013-05-23 15:31:45.988 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ee0d0), client(1/0x26eed10) [ CSSD]2013-05-23 15:31:45.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:31:45.988 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:31:45.988 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:45.988 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:31:45.989 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:31:45.989 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:45.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:31:45.995 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:31:45.995 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2698d00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:31:45.995 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2698d00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:31:46.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:46.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0d0 [ CSSD]2013-05-23 15:31:46.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0d0) con(0x26a67c0) skgpid ospid 13492 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:31:47.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:47.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:48.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:48.779 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:48.779 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:49.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:49.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:50.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:50.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0230002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:50.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:31:50.756 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:31:50.756 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:31:50.756 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:31:50.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0231002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:50.763 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:31:50.763 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:31:50.852 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:31:51.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:51.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:52.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:52.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0232002c) incarnation(174631051) [ CSSD]2013-05-23 15:31:53.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:53.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:53.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:53.782 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:54.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:55.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:55.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:56.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:57.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:57.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:31:58.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:31:58.784 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:31:58.785 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:31:59.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:31:59.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:00.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:00.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:01.230 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:01.231 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:32:01.232 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:01.232 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(13644) version 11:1:1:4 [ CSSD]2013-05-23 15:32:01.237 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26eed10) [ CSSD]2013-05-23 15:32:01.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:32:01.237 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:32:01.238 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:01.238 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:32:01.238 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:32:01.238 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:01.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:32:01.244 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:32:01.244 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:01.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:32:01.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:01.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 13644 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:01.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:01.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:02.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:02.760 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:02.761 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:32:02.762 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:02.762 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(13703) version 11:1:1:4 [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26eed10) [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eed10 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:32:02.768 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:02.775 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eed10) [ CSSD]2013-05-23 15:32:02.775 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eed10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:32:02.775 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:02.775 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:32:02.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:02.787 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:32:02.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0233002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:02.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:02.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 13703 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:03.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:03.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:04.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:04.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0234002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:04.949 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:04.949 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:04.949 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:04.949 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:04.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0235002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:04.957 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:04.957 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:05.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:05.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:06.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0236002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:06.009 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:06.009 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:06.009 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:06.010 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:06.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0237002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:06.017 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:06.017 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:06.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:06.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0238002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:06.540 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:06.540 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:06.540 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:06.540 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:06.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0239002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:06.548 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:06.548 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:07.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:07.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:07.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:07.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:08.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:09.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:09.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:10.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:10.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:11.386 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:11.387 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:32:11.387 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:11.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(13800) version 11:1:1:4 [ CSSD]2013-05-23 15:32:11.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:11.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:12.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:12.498 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:32:12.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:32:12.500 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:32:12.500 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:32:12.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023a002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:12.663 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:12.663 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:12.663 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:32:12.663 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:32:12.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023b002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:12.670 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:12.670 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:12.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:12.792 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:12.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023c002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:13.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:13.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:13.839 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:13.839 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 13800 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:14.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:15.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:15.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:16.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:16.480 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:16.481 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:32:16.481 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:16.481 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(14135) version 11:1:1:4 [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26cdbf0) [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdbf0 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:32:16.487 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:16.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:16.494 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdbf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:32:16.494 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:16.494 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:32:16.696 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:16.696 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 14135 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:17.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:17.795 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:17.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:17.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:18.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:19.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:19.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:20.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:20.918 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:21.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023d002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:21.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:21.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:21.261 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:21.261 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:21.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023e002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:21.268 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:21.268 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:21.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:21.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:22.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:22.797 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:22.797 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:22.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023f002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:23.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:23.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:24.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:25.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:25.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:26.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:27.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:27.800 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:27.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:27.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:28.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:29.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:29.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:30.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:30.941 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:31.738 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:31.739 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:32:31.739 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:31.739 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(14319) version 11:1:1:4 [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26cdbf0) [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdbf0 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:32:31.745 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:31.751 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:31.751 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdbf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:32:31.751 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:31.751 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:32:31.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:31.802 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:32:31.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:31.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:31.954 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:31.954 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 14319 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:32.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:32.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0240002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:33.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:33.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:34.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:35.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:35.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:36.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:36.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0241002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:36.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:36.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:36.511 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:36.511 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:36.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0242002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:36.518 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:36.518 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:36.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:36.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:38.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:38.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:38.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:40.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:40.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:40.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:40.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:41.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:41.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:42.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:42.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:42.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:42.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0243002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:44.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:44.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:44.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:46.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:46.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:46.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:46.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:46.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:46.990 [1199044928] >TRACE: clssgmAllocProc: (0x26787b0) allocated [ CSSD]2013-05-23 15:32:46.991 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:32:46.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26787b0 - 1,2,3 [ CSSD]2013-05-23 15:32:46.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2682170) proc(0x26787b0) pid(14465) version 11:1:1:4 [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26787b0), client(1/0x26cdbf0) [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdbf0 with con 0x267fbc0, requested num -1 [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:32:47.008 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:47.014 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdbf0) [ CSSD]2013-05-23 15:32:47.014 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdbf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:32:47.014 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:32:47.014 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:32:47.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x26787b0 [ CSSD]2013-05-23 15:32:47.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26787b0) con(0x2682170) skgpid ospid 14465 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:48.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:48.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2679070) [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2679070), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2679070), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x2659ac0 [ CSSD]2013-05-23 15:32:48.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2659ac0) con(0x26916a0) skgpid 8499 ospid 8499 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:48.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee2d0) [ CSSD]2013-05-23 15:32:48.408 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:32:48.408 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee2d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:32:48.409 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 15:32:48.409 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bf20 [ CSSD]2013-05-23 15:32:48.409 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bf20) con(0x26ba3f0) skgpid 8501 ospid 8501 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:48.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:50.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:50.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:50.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:50.983 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:32:51.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0244002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:51.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:32:51.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:32:51.771 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:32:51.772 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:32:51.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0245002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:51.779 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:32:51.779 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:32:51.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:51.813 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:32:52.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:52.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:52.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:53.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0246002c) incarnation(174631051) [ CSSD]2013-05-23 15:32:54.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:54.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:54.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:55.814 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:32:55.815 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:32:56.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:56.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:56.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:58.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:32:58.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:32:58.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:32:59.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cddc0) [ CSSD]2013-05-23 15:32:59.650 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cddc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:32:59.650 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cddc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:32:59.650 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 15:32:59.650 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba4b0 [ CSSD]2013-05-23 15:32:59.651 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba4b0) con(0x26cdb40) skgpid 10716 ospid 10716 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:32:59.699 [1199044928] >TRACE: clssgmAllocProc: (0x26cdb40) allocated [ CSSD]2013-05-23 15:32:59.699 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:32:59.700 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdb40 - 1,2,3 [ CSSD]2013-05-23 15:32:59.700 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26cdb40) pid(14604/14604) version 11:1:1:4 [ CSSD]2013-05-23 15:32:59.716 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x26cdb40), client(1/0x26ef180) [ CSSD]2013-05-23 15:32:59.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:32:59.716 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:32:59.716 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 15:33:00.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:00.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:00.566 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:00.817 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:00.818 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:01.006 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:02.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:02.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:02.249 [1199044928] >TRACE: clssgmAllocProc: (0x2698d60) allocated [ CSSD]2013-05-23 15:33:02.249 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:33:02.250 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d60 - 1,2,3 [ CSSD]2013-05-23 15:33:02.250 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x2698d60) pid(14629) version 11:1:1:4 [ CSSD]2013-05-23 15:33:02.255 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x2698d60), client(1/0x266f1a0) [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:02.256 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:02.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:33:02.262 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:33:02.262 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fd40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:02.262 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fd40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:02.465 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d60 [ CSSD]2013-05-23 15:33:02.465 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d60) con(0x26916a0) skgpid ospid 14629 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:02.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:03.017 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 15:33:03.018 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:03.018 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 15:33:03.018 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x261b8e0) pid(14670) version 11:1:1:4 [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x261b8e0), client(1/0x26e87b0) [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e87b0 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267fa40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:03.024 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:03.031 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:33:03.031 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e87b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:33:03.031 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fd40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:03.032 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fd40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:03.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0247002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:03.234 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 15:33:03.234 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x26916a0) skgpid ospid 14670 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:04.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:04.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:04.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:05.820 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:05.820 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:06.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:06.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:06.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:06.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0248002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:06.799 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:33:06.799 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:33:06.799 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:33:06.799 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:06.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0249002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:06.808 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:33:06.808 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:33:07.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024a002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:07.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:33:07.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:33:07.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:33:07.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:07.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024b002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:07.033 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:33:07.033 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:33:08.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:08.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:08.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:10.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:10.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:10.304 [1199044928] >TRACE: clssgmAllocProc: (0x2698d60) allocated [ CSSD]2013-05-23 15:33:10.305 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:10.305 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d60 - 1,2,3 [ CSSD]2013-05-23 15:33:10.305 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x2698d60) pid(14530/14530) version 11:1:1:4 [ CSSD]2013-05-23 15:33:10.321 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x2698d60), client(1/0x261bfb0) [ CSSD]2013-05-23 15:33:10.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:33:10.321 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:33:10.321 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 15:33:10.359 [1199044928] >TRACE: clssgmAllocProc: (0x26e8d20) allocated [ CSSD]2013-05-23 15:33:10.360 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:10.360 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8d20 - 1,2,3 [ CSSD]2013-05-23 15:33:10.360 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fd80) proc(0x26e8d20) pid(14528/14528) version 11:1:1:4 [ CSSD]2013-05-23 15:33:10.376 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26e8d20), client(1/0x266f1a0) [ CSSD]2013-05-23 15:33:10.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:33:10.376 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:33:10.376 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:33:10.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:10.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:10.823 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:11.026 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:12.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:12.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:12.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:13.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024c002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:14.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:14.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:14.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:15.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:15.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:16.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:16.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:16.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:17.507 [1199044928] >TRACE: clssgmAllocProc: (0x2677de0) allocated [ CSSD]2013-05-23 15:33:17.507 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:33:17.508 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2677de0 - 1,2,3 [ CSSD]2013-05-23 15:33:17.508 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c500) proc(0x2677de0) pid(14773) version 11:1:1:4 [ CSSD]2013-05-23 15:33:17.524 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2677de0), client(1/0x268be20) [ CSSD]2013-05-23 15:33:17.524 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:17.524 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be20 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 15:33:17.524 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:17.524 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678460/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:33:17.525 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:17.525 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:17.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:17.532 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:33:17.532 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:17.532 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:17.735 [1199044928] >TRACE: clssgmDeadProc: proc 0x2677de0 [ CSSD]2013-05-23 15:33:17.735 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2677de0) con(0x267c500) skgpid ospid 14773 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:18.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:18.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:18.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:19.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:19.828 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:33:20.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:20.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:20.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:21.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:22.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024d002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:22.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:33:22.275 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:33:22.275 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:33:22.275 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:22.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024e002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:22.282 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:33:22.282 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:33:22.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:22.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:22.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:23.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024f002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:24.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:24.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:24.830 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:24.831 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:24.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:26.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:26.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:26.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:28.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:28.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:28.766 [1199044928] >TRACE: clssgmAllocProc: (0x2690910) allocated [ CSSD]2013-05-23 15:33:28.766 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:28.767 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690910 - 1,2,3 [ CSSD]2013-05-23 15:33:28.767 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c220) proc(0x2690910) pid(14892/14892) version 11:1:1:4 [ CSSD]2013-05-23 15:33:28.773 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2690910), client(1/0x268be20) [ CSSD]2013-05-23 15:33:28.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:28.773 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:33:28.773 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268be20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268be20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690910 [ CSSD]2013-05-23 15:33:28.810 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690910) con(0x267c220) skgpid 14892 ospid 14892 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:28.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:29.039 [1199044928] >TRACE: clssgmAllocProc: (0x2677de0) allocated [ CSSD]2013-05-23 15:33:29.040 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:29.040 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2677de0 - 1,2,3 [ CSSD]2013-05-23 15:33:29.040 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267c500) proc(0x2677de0) pid(14895/14895) version 11:1:1:4 [ CSSD]2013-05-23 15:33:29.046 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2677de0), client(1/0x268be20) [ CSSD]2013-05-23 15:33:29.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:29.046 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:33:29.046 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268be20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268be20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmDeadProc: proc 0x2677de0 [ CSSD]2013-05-23 15:33:29.096 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2677de0) con(0x267c500) skgpid 14895 ospid 14895 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef180), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef180), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdb40 [ CSSD]2013-05-23 15:33:29.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdb40) con(0x26a67c0) skgpid 14604 ospid 14604 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:29.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:29.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:30.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:30.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:30.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:31.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:32.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:32.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:32.777 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:33:32.778 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:33:32.778 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:33:32.778 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x261be20) pid(14931) version 11:1:1:4 [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x261be20), client(1/0x26ef180) [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef180 with con 0x26cddc0, requested num -1 [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:32.795 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:32.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:32.802 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:33:32.802 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26cdb40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:32.802 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26cdb40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:32.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:33.004 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:33:33.004 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26a67c0) skgpid ospid 14931 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:33.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0250002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:34.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:34.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:34.836 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:34.836 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:34.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:35.346 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:33:35.347 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:35.347 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:33:35.347 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x261be20) pid(14991) version 11:1:1:4 [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x261be20), client(1/0x26ef180) [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26ef180 with con 0x2690f90, requested num -1 [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269d820/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:35.364 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:35.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:35.370 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:33:35.370 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269db20) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:33:35.370 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x269db20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:35.477 [1199044928] >TRACE: clssgmAllocProc: (0x26908e0) allocated [ CSSD]2013-05-23 15:33:35.478 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:35.478 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26908e0 - 1,2,3 [ CSSD]2013-05-23 15:33:35.478 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bfe0) proc(0x26908e0) pid(15000) version 11:1:1:4 [ CSSD]2013-05-23 15:33:35.493 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:33:35.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:33:35.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:33:35.499 [1199044928] >TRACE: clssgmDeadProc: proc 0x26908e0 [ CSSD]2013-05-23 15:33:35.499 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26908e0) con(0x267bfe0) skgpid ospid 15000 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:35.573 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:33:35.573 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26cddc0) skgpid ospid 14991 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:36.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:36.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:36.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:37.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0251002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:37.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:33:37.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:33:37.547 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:33:37.547 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:37.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0252002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:37.556 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:33:37.556 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:33:38.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:38.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:38.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:39.838 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:39.838 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:40.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:40.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:40.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:41.105 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:41.259 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:33:41.259 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:41.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:33:41.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x261be20) pid(15059) version 11:1:1:4 [ CSSD]2013-05-23 15:33:41.755 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:33:41.755 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26a67c0) skgpid ospid 15059 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:42.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:42.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:42.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:43.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0253002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:44.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:44.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:44.841 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:44.841 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:44.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:46.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:46.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:46.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:48.035 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:33:48.036 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:33:48.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:33:48.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x261be20) pid(15273) version 11:1:1:4 [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x261be20), client(1/0x26ef180) [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef180 with con 0x2690f90, requested num -1 [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269d820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:33:48.042 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:48.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:48.049 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:33:48.049 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269db20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:33:48.049 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269db20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:33:48.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:33:48.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26cddc0) skgpid ospid 15273 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:33:48.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:48.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:48.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:48.843 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:33:48.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:50.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:50.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:50.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:51.128 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:33:52.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0254002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:52.810 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:33:52.810 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:33:52.810 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:33:52.811 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:33:52.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0255002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:52.819 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:33:52.819 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:33:52.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:52.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:52.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:53.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0256002c) incarnation(174631051) [ CSSD]2013-05-23 15:33:53.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:53.846 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:54.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:54.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:55.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:56.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:56.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:57.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:58.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:33:58.849 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:33:58.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:33:58.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:33:59.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:33:59.761 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:33:59.762 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:33:59.762 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:33:59.762 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x261be20) pid(15327/15327) version 11:1:1:4 [ CSSD]2013-05-23 15:33:59.779 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x261be20), client(1/0x26ef180) [ CSSD]2013-05-23 15:33:59.779 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:33:59.779 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:33:59.779 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:34:00.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:00.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:01.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:01.147 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:02.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:02.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:03.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:03.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0257002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:03.274 [1199044928] >TRACE: clssgmAllocProc: (0x26908b0) allocated [ CSSD]2013-05-23 15:34:03.275 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:34:03.276 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26908b0 - 1,2,3 [ CSSD]2013-05-23 15:34:03.276 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x26908b0) pid(15442) version 11:1:1:4 [ CSSD]2013-05-23 15:34:03.281 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26908b0), client(1/0x268be20) [ CSSD]2013-05-23 15:34:03.281 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:34:03.281 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be20 with con 0x2690800, requested num -1 [ CSSD]2013-05-23 15:34:03.281 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:03.281 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678330/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:34:03.282 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:03.282 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:03.287 [1199044928] >TRACE: clssgmAllocProc: (0x26bb6d0) allocated [ CSSD]2013-05-23 15:34:03.288 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:34:03.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:34:03.288 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:34:03.288 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678630) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:03.288 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678630) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:03.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb6d0 - 1,2,3 [ CSSD]2013-05-23 15:34:03.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690750) proc(0x26bb6d0) pid(15445) version 11:1:1:4 [ CSSD]2013-05-23 15:34:03.293 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26bb6d0), client(1/0x26e87b0) [ CSSD]2013-05-23 15:34:03.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:34:03.293 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e87b0 with con 0x2690800, requested num -1 [ CSSD]2013-05-23 15:34:03.293 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:03.293 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26781c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:34:03.294 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:03.294 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:03.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:34:03.300 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e87b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:34:03.300 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26784c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:03.300 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26784c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:03.491 [1199044928] >TRACE: clssgmDeadProc: proc 0x26908b0 [ CSSD]2013-05-23 15:34:03.491 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26908b0) con(0x26a67c0) skgpid ospid 15442 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:03.503 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb6d0 [ CSSD]2013-05-23 15:34:03.503 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb6d0) con(0x2690750) skgpid ospid 15445 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:03.851 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:03.851 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:04.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:04.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:05.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:06.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:06.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:07.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0258002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:07.051 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:34:07.051 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:34:07.051 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:34:07.051 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:07.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0259002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:07.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:34:07.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:34:07.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:08.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025a002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:08.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:34:08.073 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:34:08.073 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:34:08.073 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:08.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025b002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:08.081 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:34:08.081 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:34:08.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:08.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:08.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:08.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:09.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:10.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:10.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:11.172 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:11.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:13.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:13.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:13.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025c002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:13.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:13.856 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:13.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:15.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:15.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:15.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:17.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:17.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:17.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:18.547 [1199044928] >TRACE: clssgmAllocProc: (0x2677de0) allocated [ CSSD]2013-05-23 15:34:18.548 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:34:18.548 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2677de0 - 1,2,3 [ CSSD]2013-05-23 15:34:18.548 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269db60) proc(0x2677de0) pid(15602) version 11:1:1:4 [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2677de0), client(1/0x268be20) [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268be20 with con 0x2690910, requested num -1 [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678550/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:18.555 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:18.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:34:18.562 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268be20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:34:18.562 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678850) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:18.562 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678850) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:18.765 [1199044928] >TRACE: clssgmDeadProc: proc 0x2677de0 [ CSSD]2013-05-23 15:34:18.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2677de0) con(0x269db60) skgpid ospid 15602 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:18.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:18.859 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:19.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:19.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:19.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:21.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:21.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:21.194 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:21.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:22.149 [1199044928] >TRACE: clssgmAllocProc: (0x2677de0) allocated [ CSSD]2013-05-23 15:34:22.150 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:34:22.151 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2677de0 - 1,2,3 [ CSSD]2013-05-23 15:34:22.151 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269db60) proc(0x2677de0) pid(15674) version 11:1:1:4 [ CSSD]2013-05-23 15:34:22.270 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ab0) allocated [ CSSD]2013-05-23 15:34:22.271 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:34:22.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ab0 - 1,2,3 [ CSSD]2013-05-23 15:34:22.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26784b0) proc(0x26b9ab0) pid(15685) version 11:1:1:4 [ CSSD]2013-05-23 15:34:22.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:34:22.290 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:34:22.293 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ab0 [ CSSD]2013-05-23 15:34:22.293 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ab0) con(0x26784b0) skgpid ospid 15685 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5335/0x268be20) [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5335 (0x268be20) [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x268be20 with con 0x26b9f00, requested num -1 [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x2678300/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:22.372 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:34:22.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5335 (0x268be20) [ CSSD]2013-05-23 15:34:22.379 [1199044928] >TRACE: clssgmExitGrock: client 5335 (0x268be20), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:34:22.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678600) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:34:22.379 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2678600) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:22.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x2677de0 [ CSSD]2013-05-23 15:34:22.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2677de0) con(0x269db60) skgpid ospid 15674 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:23.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:23.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:23.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025d002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:23.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025e002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:23.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:34:23.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:34:23.323 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:34:23.323 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:23.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025f002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:23.330 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:34:23.330 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:34:23.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:23.862 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:23.862 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:25.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:25.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:25.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:27.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:27.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:27.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:27.712 [1199044928] >TRACE: clssgmAllocProc: (0x2677de0) allocated [ CSSD]2013-05-23 15:34:27.713 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:34:27.714 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2677de0 - 1,2,3 [ CSSD]2013-05-23 15:34:27.714 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269db60) proc(0x2677de0) pid(15358/15358) version 11:1:1:4 [ CSSD]2013-05-23 15:34:27.729 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2677de0), client(1/0x267c0b0) [ CSSD]2013-05-23 15:34:27.729 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 15:34:27.729 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:34:27.729 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:34:28.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:28.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:29.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:29.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:29.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef180), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef180), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:34:29.846 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26cddc0) skgpid 15327 ospid 15327 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:31.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:31.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:31.221 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:31.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:33.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:33.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:33.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0260002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:33.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:33.804 [1199044928] >TRACE: clssgmAllocProc: (0x2690ec0) allocated [ CSSD]2013-05-23 15:34:33.805 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:34:33.806 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690ec0 - 1,2,3 [ CSSD]2013-05-23 15:34:33.806 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x2690ec0) pid(15803) version 11:1:1:4 [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2690ec0), client(1/0x26ef180) [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef180 with con 0x267bff0, requested num -1 [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26784a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:33.812 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:33.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:34:33.819 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:34:33.819 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26787a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:33.819 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26787a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:33.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:33.868 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:34.021 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690ec0 [ CSSD]2013-05-23 15:34:34.021 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690ec0) con(0x26cddc0) skgpid ospid 15803 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:35.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:35.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:35.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:37.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:37.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:37.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:37.870 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:37.870 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:34:38.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0261002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:38.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:34:38.583 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:34:38.583 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:34:38.583 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:38.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0262002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:38.590 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:34:38.590 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:34:39.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:39.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:39.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:41.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:41.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:41.245 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:41.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:42.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:42.873 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:43.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:43.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:43.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0263002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:43.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:45.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:45.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:45.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:47.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:47.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:47.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:47.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:47.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:49.056 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 15:34:49.056 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:34:49.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 15:34:49.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a67c0) proc(0x261be20) pid(15941) version 11:1:1:4 [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261be20), client(1/0x26ef180) [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef180 with con 0x267bff0, requested num -1 [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678600/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:34:49.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:49.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:34:49.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:34:49.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:34:49.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:34:49.274 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 15:34:49.274 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26a67c0) skgpid ospid 15941 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:34:49.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:49.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:49.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:51.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:34:51.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:51.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:51.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:52.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:52.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:53.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0264002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:53.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:53.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:53.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:53.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0265002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:53.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:34:53.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:34:53.844 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:34:53.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:34:53.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0266002c) incarnation(174631051) [ CSSD]2013-05-23 15:34:53.851 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:34:53.851 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:34:55.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:55.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:55.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:57.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:57.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:57.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:34:57.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:34:57.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:34:59.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:34:59.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:34:59.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:01.287 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:01.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:01.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:01.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:01.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:01.885 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:35:03.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0267002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:03.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:03.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:03.528 [1199044928] >TRACE: clssgmAllocProc: (0x2690ec0) allocated [ CSSD]2013-05-23 15:35:03.529 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:35:03.530 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2690ec0 - 1,2,3 [ CSSD]2013-05-23 15:35:03.530 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x2690ec0) pid(16094) version 11:1:1:4 [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2690ec0), client(1/0x26ef180) [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef180 with con 0x26a67c0, requested num -1 [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26783d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:35:03.547 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:03.555 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef180) [ CSSD]2013-05-23 15:35:03.555 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef180), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:35:03.555 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26786d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:03.555 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26786d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:35:03.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:03.757 [1199044928] >TRACE: clssgmDeadProc: proc 0x2690ec0 [ CSSD]2013-05-23 15:35:03.757 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2690ec0) con(0x26cddc0) skgpid ospid 16094 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:04.311 [1199044928] >TRACE: clssgmAllocProc: (0x267bf20) allocated [ CSSD]2013-05-23 15:35:04.312 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:35:04.312 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267bf20 - 1,2,3 [ CSSD]2013-05-23 15:35:04.312 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x267bf20) pid(16112) version 11:1:1:4 [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x267bf20), client(1/0x26e87b0) [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e87b0 with con 0x261bef0, requested num -1 [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678b30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:35:04.318 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:04.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:35:04.324 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e87b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:35:04.324 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678600) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:04.325 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678600) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:35:04.527 [1199044928] >TRACE: clssgmDeadProc: proc 0x267bf20 [ CSSD]2013-05-23 15:35:04.527 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267bf20) con(0x26cddc0) skgpid ospid 16112 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:05.145 [1199044928] >TRACE: clssgmAllocProc: (0x26ef0c0) allocated [ CSSD]2013-05-23 15:35:05.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:35:05.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ef0c0 - 1,2,3 [ CSSD]2013-05-23 15:35:05.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cddc0) proc(0x26ef0c0) pid(16161/16161) version 11:1:1:4 [ CSSD]2013-05-23 15:35:05.163 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ef0c0), client(1/0x26e87b0) [ CSSD]2013-05-23 15:35:05.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:35:05.163 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:35:05.163 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:35:05.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 15:35:05.442 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e87b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:35:05.442 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e87b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:35:05.442 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:35:05.443 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ef0c0 [ CSSD]2013-05-23 15:35:05.443 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ef0c0) con(0x26cddc0) skgpid 16161 ospid 16161 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:05.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:05.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:05.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:06.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:06.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:07.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0268002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:07.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:35:07.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:35:07.302 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:35:07.302 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:07.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0269002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:07.309 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:35:07.309 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:35:07.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:07.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:07.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:09.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026a002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:09.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:35:09.092 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:35:09.092 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:35:09.092 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:09.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026b002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:09.099 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:35:09.099 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:35:09.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:09.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:09.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:11.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:11.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:11.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:11.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:11.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:11.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:13.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026c002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:13.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:13.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:13.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:15.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:15.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:15.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:16.893 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:16.893 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:17.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:17.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:17.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:18.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 15:35:18.431 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:35:18.431 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261cb10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:35:18.431 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:35:18.432 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:35:18.432 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid 10599 ospid 10599 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:18.964 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 15:35:18.964 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:35:18.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 15:35:18.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267bdb0) proc(0x26b6a30) pid(16244/16244) version 11:1:1:4 [ CSSD]2013-05-23 15:35:18.971 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26b6a30), client(1/0x268be20) [ CSSD]2013-05-23 15:35:18.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:35:18.971 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:35:18.971 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:35:19.560 [1199044928] >TRACE: clssgmAllocProc: (0x2678f50) allocated [ CSSD]2013-05-23 15:35:19.561 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:35:19.562 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f50 - 1,2,3 [ CSSD]2013-05-23 15:35:19.562 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x2678f50) pid(16252) version 11:1:1:4 [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678f50), client(1/0x2678260) [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678260) [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678260 with con 0x268c760, requested num -1 [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26cda00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:35:19.568 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:19.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678260) [ CSSD]2013-05-23 15:35:19.574 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678260), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:35:19.574 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678e10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:19.574 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678e10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:35:19.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:19.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:19.776 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f50 [ CSSD]2013-05-23 15:35:19.776 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f50) con(0x26e87a0) skgpid ospid 16252 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:19.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:21.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:21.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:21.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:21.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:21.895 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:21.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:23.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026d002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:23.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:23.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:23.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:24.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026e002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:24.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:35:24.362 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:35:24.362 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:35:24.363 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:24.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026f002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:24.370 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:35:24.370 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:35:25.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:25.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:25.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:25.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:25.898 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:35:26.049 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2677de0), client(2/0x2678250) [ CSSD]2013-05-23 15:35:26.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2678250) [ CSSD]2013-05-23 15:35:26.049 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:35:26.049 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 15:35:27.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:27.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:27.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:29.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:29.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:29.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:30.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:30.900 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:31.352 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:31.630 [1199044928] >TRACE: clssgmAllocProc: (0x2678f50) allocated [ CSSD]2013-05-23 15:35:31.631 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:35:31.631 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f50 - 1,2,3 [ CSSD]2013-05-23 15:35:31.632 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x2678f50) pid(16390/16390) version 11:1:1:4 [ CSSD]2013-05-23 15:35:31.648 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678f50), client(1/0x26ef0b0) [ CSSD]2013-05-23 15:35:31.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:35:31.648 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:35:31.648 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:35:31.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:31.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:31.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:33.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0270002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:33.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:33.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:33.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:34.811 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:35:34.812 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:35:34.812 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:35:34.812 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ea0) proc(0x26b9e60) pid(16412) version 11:1:1:4 [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:35:34.818 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:34.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:35:34.825 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:35:34.825 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:34.825 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:35:35.028 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:35:35.028 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x2678ea0) skgpid ospid 16412 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:35.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:35.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:35.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:35.903 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:35.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:37.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:37.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:37.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:39.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0271002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:39.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:35:39.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:35:39.613 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:35:39.613 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:39.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0272002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:39.620 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:35:39.620 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:35:39.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:39.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:39.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:40.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:40.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:41.380 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:41.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:41.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:42.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:43.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0273002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:43.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:43.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:44.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:45.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:45.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:45.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:45.908 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:46.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:47.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:47.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:48.106 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:49.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:49.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:50.061 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:35:50.061 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:35:50.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:35:50.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(16554) version 11:1:1:4 [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x2678ea0, requested num -1 [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:35:50.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:50.074 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:35:50.074 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:35:50.074 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:35:50.074 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:35:50.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:50.277 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:35:50.277 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 16554 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:35:50.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:50.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:51.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:35:51.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:51.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:52.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:53.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0274002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:53.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:53.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:54.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:54.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0275002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:54.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:35:54.862 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:35:54.862 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:35:54.862 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:35:54.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0276002c) incarnation(174631051) [ CSSD]2013-05-23 15:35:54.870 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:35:54.870 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:35:55.913 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:35:55.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:35:55.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:55.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:56.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:57.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:57.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:35:58.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:35:59.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:35:59.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:00.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:00.916 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:00.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:02.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:02.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:02.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:03.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:03.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0277002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:03.803 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:03.804 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:36:03.804 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:03.804 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(16693) version 11:1:1:4 [ CSSD]2013-05-23 15:36:03.821 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:03.821 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:03.821 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x2678ea0, requested num -1 [ CSSD]2013-05-23 15:36:03.822 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:03.822 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:36:03.822 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:36:03.822 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:03.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:03.830 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:36:03.830 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:03.830 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:36:04.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:04.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 16693 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:04.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:04.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:04.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:05.316 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:05.316 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:36:05.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:05.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(16710) version 11:1:1:4 [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:36:05.323 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:05.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:05.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:36:05.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:05.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:36:05.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:05.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 16710 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:05.919 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:05.919 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:06.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:06.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:06.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:07.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0278002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:07.562 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:07.562 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:07.562 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:36:07.563 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:07.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0279002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:07.570 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:07.570 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:08.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:08.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:08.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:10.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:10.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:10.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027a002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:10.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:10.113 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:10.113 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:36:10.113 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:10.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027b002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:10.120 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:10.120 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:10.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:10.921 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:10.922 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:12.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:12.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:12.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:13.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:13.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027c002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:14.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:14.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:14.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:14.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027d002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:14.503 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:14.503 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:14.503 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:36:14.503 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:14.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027e002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:14.510 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:14.510 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:14.640 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:36:14.640 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:36:14.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:36:14.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:36:15.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:15.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:16.064 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:16.065 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:36:16.065 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:16.065 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ea0) proc(0x26b9e60) pid(16821/16821) version 11:1:1:4 [ CSSD]2013-05-23 15:36:16.071 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:16.071 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:16.071 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:36:16.071 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261ca30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261ca30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:16.089 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x2678ea0) skgpid 16821 ospid 16821 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:16.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:16.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:16.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:18.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:18.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:18.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:19.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:19.927 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:36:20.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:20.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:20.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:20.574 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:20.575 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:36:20.576 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:20.576 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ea0) proc(0x26b9e60) pid(16858) version 11:1:1:4 [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:36:20.582 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:20.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:20.589 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:36:20.589 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:20.589 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:36:20.791 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:20.791 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x2678ea0) skgpid ospid 16858 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:22.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:22.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:22.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:23.364 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:23.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027f002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:24.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:24.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:24.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:24.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:24.929 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:25.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0280002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:25.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:25.374 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:25.374 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:36:25.374 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:25.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0281002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:25.381 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:25.381 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:26.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:26.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:26.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:28.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:28.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:28.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:29.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:29.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:30.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:30.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:30.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:32.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:32.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:32.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:33.384 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:33.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0282002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:34.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:34.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:34.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:34.934 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:34.934 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:35.824 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:35.824 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:36:35.825 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:35.825 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17016) version 11:1:1:4 [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:36:35.831 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:35.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:35.838 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:36:35.838 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:35.839 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:36:36.042 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:36.042 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17016 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:36.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:36.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:36.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:38.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:38.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:38.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:39.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:39.937 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:40.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:40.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:40.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:40.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0283002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:40.626 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:40.626 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:40.626 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:36:40.626 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:40.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0284002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:40.633 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:40.633 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:42.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:42.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:42.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:43.405 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:43.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0285002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:43.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:43.939 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:36:44.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:44.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:44.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:46.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:46.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:46.533 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:48.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:48.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:48.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:48.942 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:48.942 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:50.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:50.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:50.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:51.077 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:36:51.078 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:36:51.079 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:36:51.079 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17178) version 11:1:1:4 [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:36:51.096 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:51.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:36:51.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:36:51.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:36:51.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:36:51.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:36:51.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17178 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:36:52.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:52.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:52.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:53.425 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:36:53.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0286002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:53.944 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:53.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:36:54.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:54.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:54.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:55.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0287002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:55.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:36:55.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:36:55.885 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:36:55.885 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:36:55.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0288002c) incarnation(174631051) [ CSSD]2013-05-23 15:36:55.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:36:55.892 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:36:56.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:56.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:56.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:58.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:36:58.504 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:36:58.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:36:58.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:36:58.947 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:00.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:00.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:00.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:02.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:02.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:02.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:03.465 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:03.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0289002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:03.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:03.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:04.081 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:04.082 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:37:04.082 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:04.082 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17329) version 11:1:1:4 [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x2678ea0, requested num -1 [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:04.089 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:04.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:04.096 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:04.096 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:04.096 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:04.299 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:04.299 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17329 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:04.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:04.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:04.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:06.352 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:06.353 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:37:06.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:06.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17354) version 11:1:1:4 [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:06.371 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:06.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:06.379 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:06.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:06.379 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:06.582 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:06.582 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17354 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:06.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:06.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:06.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:07.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028a002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:07.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:07.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:07.825 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:37:07.825 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:07.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028b002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:07.833 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:07.833 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:08.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:08.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:08.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:08.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:08.953 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:10.506 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:10.507 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:37:10.507 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:10.507 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17437) version 11:1:1:4 [ CSSD]2013-05-23 15:37:10.513 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:10.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:10.513 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:37:10.513 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:10.513 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:10.514 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:10.514 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:10.520 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:10.520 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:10.520 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:10.520 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:10.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:10.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:10.723 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:10.723 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17437 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:10.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:11.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028c002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:11.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:11.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:11.145 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:37:11.145 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:11.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028d002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:11.153 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:11.153 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:11.934 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:11.935 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:37:11.935 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:11.935 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(17475) version 11:1:1:4 [ CSSD]2013-05-23 15:37:12.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:12.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:12.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:12.895 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:37:12.896 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:37:12.897 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:37:12.898 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:37:12.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028e002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:12.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:12.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:12.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:37:12.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:37:12.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028f002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:12.978 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:12.979 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:13.487 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:13.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0290002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:13.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:13.955 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:14.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:14.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 17475 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:14.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:14.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:14.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:16.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:16.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:16.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:18.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:18.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:18.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:18.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:18.958 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:20.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:20.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:20.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:21.616 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:21.617 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:37:21.617 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:21.617 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ea0) proc(0x26b9e60) pid(17839) version 11:1:1:4 [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:21.624 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:21.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:21.631 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:21.631 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:21.631 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:21.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:21.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x2678ea0) skgpid ospid 17839 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:22.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:22.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:22.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:23.506 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:23.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0291002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:23.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:23.961 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:24.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:24.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:24.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:26.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0292002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:26.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:26.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:26.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:37:26.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:26.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0293002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:26.407 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:26.407 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:26.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:26.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:26.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:28.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:28.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:28.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:28.963 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:28.963 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:30.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:30.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:30.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:32.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:32.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:32.899 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:33.536 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:33.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0294002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:33.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:33.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:34.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:34.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:34.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:36.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:36.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:36.876 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:36.877 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:37:36.877 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:36.877 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26b9e60) pid(18006) version 11:1:1:4 [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x2678ea0, requested num -1 [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:36.884 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:36.890 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:36.890 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:36.890 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:36.890 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:36.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:37.093 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:37.093 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x26e87a0) skgpid ospid 18006 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:37.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:37.968 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:37:38.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:38.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:38.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:40.016 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e60) allocated [ CSSD]2013-05-23 15:37:40.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:37:40.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e60 - 1,2,3 [ CSSD]2013-05-23 15:37:40.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ea0) proc(0x26b9e60) pid(18069) version 11:1:1:4 [ CSSD]2013-05-23 15:37:40.033 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e60), client(1/0x261ca30) [ CSSD]2013-05-23 15:37:40.033 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:40.033 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca30 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:37:40.033 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:40.033 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:40.034 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:40.034 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:40.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca30) [ CSSD]2013-05-23 15:37:40.041 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:40.041 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:40.041 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:40.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e60 [ CSSD]2013-05-23 15:37:40.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e60) con(0x2678ea0) skgpid ospid 18069 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:40.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:40.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:40.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:41.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0295002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:41.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:41.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:41.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:37:41.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:41.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0296002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:41.658 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:41.658 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:42.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:42.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:42.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:42.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:42.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:43.577 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:43.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0297002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:44.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:44.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:45.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f50 [ CSSD]2013-05-23 15:37:45.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f50) con(0x26a6970) skgpid 16390 ospid 16390 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:46.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:46.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:47.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:47.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:47.974 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:48.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:48.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:49.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:51.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:51.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:51.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:52.127 [1199044928] >TRACE: clssgmAllocProc: (0x2678f50) allocated [ CSSD]2013-05-23 15:37:52.127 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:37:52.128 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f50 - 1,2,3 [ CSSD]2013-05-23 15:37:52.128 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x2678f50) pid(18165) version 11:1:1:4 [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678f50), client(1/0x26ef0b0) [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ef0b0 with con 0x2678ea0, requested num -1 [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b8dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:37:52.134 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:52.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:37:52.140 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ef0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:37:52.140 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b90d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:37:52.141 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b90d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:37:52.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f50 [ CSSD]2013-05-23 15:37:52.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f50) con(0x26a6970) skgpid ospid 18165 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:37:52.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:52.976 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:53.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:53.083 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:53.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:53.606 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:37:53.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0298002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:55.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:55.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:55.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:56.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0299002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:56.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:37:56.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:37:56.901 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:37:56.901 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:37:56.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029a002c) incarnation(174631051) [ CSSD]2013-05-23 15:37:56.908 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:37:56.908 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:37:57.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:57.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:57.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:37:57.979 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:37:57.979 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:37:59.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:37:59.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:37:59.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:01.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:01.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:01.224 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:01.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:01.981 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:38:03.159 [1199044928] >TRACE: clssgmAllocProc: (0x2678f50) allocated [ CSSD]2013-05-23 15:38:03.160 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:03.161 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f50 - 1,2,3 [ CSSD]2013-05-23 15:38:03.161 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6970) proc(0x2678f50) pid(18142/18142) version 11:1:1:4 [ CSSD]2013-05-23 15:38:03.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:03.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:03.177 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x2678f50), client(1/0x26ef0b0) [ CSSD]2013-05-23 15:38:03.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:38:03.177 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:38:03.177 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:38:03.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:03.627 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:03.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029b002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:04.335 [1199044928] >TRACE: clssgmAllocProc: (0x26b9e40) allocated [ CSSD]2013-05-23 15:38:04.336 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:04.337 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9e40 - 1,2,3 [ CSSD]2013-05-23 15:38:04.337 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b91c0) proc(0x26b9e40) pid(18300) version 11:1:1:4 [ CSSD]2013-05-23 15:38:04.353 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9e40), client(1/0x261c970) [ CSSD]2013-05-23 15:38:04.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c970) [ CSSD]2013-05-23 15:38:04.353 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c970 with con 0x26ede40, requested num -1 [ CSSD]2013-05-23 15:38:04.353 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:04.353 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:38:04.354 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:04.354 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:04.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c970) [ CSSD]2013-05-23 15:38:04.361 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c970), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:38:04.361 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:04.361 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:04.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9e40 [ CSSD]2013-05-23 15:38:04.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9e40) con(0x26b91c0) skgpid ospid 18300 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:05.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:05.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:05.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:06.724 [1199044928] >TRACE: clssgmAllocProc: (0x26b9f10) allocated [ CSSD]2013-05-23 15:38:06.725 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:06.725 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9f10 - 1,2,3 [ CSSD]2013-05-23 15:38:06.725 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9290) proc(0x26b9f10) pid(16917/16917) version 11:1:1:4 [ CSSD]2013-05-23 15:38:06.731 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9f10), client(1/0x261cb90) [ CSSD]2013-05-23 15:38:06.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 15:38:06.731 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:38:06.731 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:38:06.983 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:06.984 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:07.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:07.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:07.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:07.263 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9f10), client(2/0x261c970) [ CSSD]2013-05-23 15:38:07.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x261c970) [ CSSD]2013-05-23 15:38:07.263 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:38:07.263 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 15:38:07.376 [1199044928] >TRACE: clssgmAllocProc: (0x26bb820) allocated [ CSSD]2013-05-23 15:38:07.376 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:38:07.377 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb820 - 1,2,3 [ CSSD]2013-05-23 15:38:07.377 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb820) pid(18327) version 11:1:1:4 [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb820), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678eb0 with con 0x26bb760, requested num -1 [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a90c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:07.383 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:07.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:07.390 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678eb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:38:07.390 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a93c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:07.390 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a93c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:07.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb820 [ CSSD]2013-05-23 15:38:07.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb820) con(0x269a460) skgpid ospid 18327 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:08.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029c002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:08.081 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:38:08.081 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:38:08.081 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:38:08.081 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:08.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029d002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:08.088 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:38:08.088 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:38:09.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:09.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:09.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:11.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:11.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:11.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:11.986 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:11.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:12.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029e002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:12.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:38:12.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:38:12.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:38:12.150 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:12.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029f002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:12.157 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:38:12.157 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:38:13.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:13.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:13.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:13.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:13.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a0002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:15.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:15.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:15.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:16.989 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:16.989 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:17.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:17.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:17.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:19.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:19.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:19.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:21.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:21.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:21.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:21.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:21.992 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:22.625 [1199044928] >TRACE: clssgmAllocProc: (0x26bb820) allocated [ CSSD]2013-05-23 15:38:22.625 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:38:22.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb820 - 1,2,3 [ CSSD]2013-05-23 15:38:22.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb820) pid(18464) version 11:1:1:4 [ CSSD]2013-05-23 15:38:22.642 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb820), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:22.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:22.642 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678eb0 with con 0x26bb760, requested num -1 [ CSSD]2013-05-23 15:38:22.642 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:22.642 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a90c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:38:22.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:22.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:22.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:22.649 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678eb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:38:22.649 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a93c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:22.649 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a93c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:22.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb820 [ CSSD]2013-05-23 15:38:22.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb820) con(0x269a460) skgpid ospid 18464 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:23.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:23.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:23.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:23.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:23.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a1002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:25.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:25.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:25.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:26.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:26.995 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:27.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:27.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:27.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a2002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:27.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:38:27.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:38:27.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:38:27.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:27.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a3002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:27.406 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:38:27.406 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:38:27.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:29.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:29.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:29.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:31.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:31.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:31.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:31.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:31.997 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:33.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:33.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:33.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:33.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:33.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a4002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:35.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:35.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:35.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:35.654 [1199044928] >TRACE: clssgmAllocProc: (0x26bb820) allocated [ CSSD]2013-05-23 15:38:35.655 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:35.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb820 - 1,2,3 [ CSSD]2013-05-23 15:38:35.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb820) pid(18621) version 11:1:1:4 [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb820), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2678eb0 with con 0x26bb760, requested num -1 [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a90c0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:35.663 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:35.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:35.670 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678eb0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:38:35.670 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a93c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:38:35.670 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26a93c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:35.776 [1199044928] >TRACE: clssgmAllocProc: (0x26808c0) allocated [ CSSD]2013-05-23 15:38:35.777 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:35.777 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26808c0 - 1,2,3 [ CSSD]2013-05-23 15:38:35.777 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bbcc0) proc(0x26808c0) pid(18626) version 11:1:1:4 [ CSSD]2013-05-23 15:38:35.793 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:38:35.796 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:38:35.798 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:38:35.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x26808c0 [ CSSD]2013-05-23 15:38:35.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26808c0) con(0x26bbcc0) skgpid ospid 18626 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:35.872 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb820 [ CSSD]2013-05-23 15:38:35.872 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb820) con(0x269a460) skgpid ospid 18621 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:37.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:37.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:37.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:37.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:37.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:37.895 [1199044928] >TRACE: clssgmAllocProc: (0x26bb820) allocated [ CSSD]2013-05-23 15:38:37.896 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:38:37.896 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb820 - 1,2,3 [ CSSD]2013-05-23 15:38:37.896 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb820) pid(18645) version 11:1:1:4 [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb820), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678eb0 with con 0x26bb760, requested num -1 [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a90c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:37.903 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:37.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:37.910 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678eb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:38:37.910 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a93c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:37.910 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a93c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:38.113 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb820 [ CSSD]2013-05-23 15:38:38.113 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb820) con(0x269a460) skgpid ospid 18645 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:39.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:39.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:39.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:40.345 [1199044928] >TRACE: clssgmAllocProc: (0x26bb820) allocated [ CSSD]2013-05-23 15:38:40.346 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:40.346 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb820 - 1,2,3 [ CSSD]2013-05-23 15:38:40.346 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb820) pid(18703/18703) version 11:1:1:4 [ CSSD]2013-05-23 15:38:40.364 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb820), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:40.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:40.364 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:38:40.364 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb820 [ CSSD]2013-05-23 15:38:40.378 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb820) con(0x269a460) skgpid 18703 ospid 18703 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:40.522 [1199044928] >TRACE: clssgmAllocProc: (0x26bb5e0) allocated [ CSSD]2013-05-23 15:38:40.523 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:40.523 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb5e0 - 1,2,3 [ CSSD]2013-05-23 15:38:40.523 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26bb5e0) pid(18753/18753) version 11:1:1:4 [ CSSD]2013-05-23 15:38:40.527 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb5e0), client(1/0x2678eb0) [ CSSD]2013-05-23 15:38:40.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:38:40.527 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:38:40.527 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:38:40.700 [1199044928] >TRACE: clssgmAllocProc: (0x26808c0) allocated [ CSSD]2013-05-23 15:38:40.701 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:38:40.701 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26808c0 - 1,2,3 [ CSSD]2013-05-23 15:38:40.701 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9440) proc(0x26808c0) pid(18719) version 11:1:1:4 [ CSSD]2013-05-23 15:38:41.317 [1199044928] >TRACE: clssgmDeadProc: proc 0x26808c0 [ CSSD]2013-05-23 15:38:41.317 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26808c0) con(0x26a9440) skgpid ospid 18719 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:41.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:41.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:41.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:42.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:42.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:42.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a5002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:42.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:38:42.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:38:42.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:38:42.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:42.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a6002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:42.658 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:38:42.658 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:38:43.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:43.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:43.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:43.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:43.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a7002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:45.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:45.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:45.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:47.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:47.005 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:47.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:47.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:47.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:49.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:49.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:49.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:51.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:51.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:51.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:52.008 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:52.008 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:38:53.145 [1199044928] >TRACE: clssgmAllocProc: (0x26aadb0) allocated [ CSSD]2013-05-23 15:38:53.146 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:38:53.147 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aadb0 - 1,2,3 [ CSSD]2013-05-23 15:38:53.147 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9440) proc(0x26aadb0) pid(18961) version 11:1:1:4 [ CSSD]2013-05-23 15:38:53.152 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aadb0), client(1/0x2680f20) [ CSSD]2013-05-23 15:38:53.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680f20) [ CSSD]2013-05-23 15:38:53.152 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680f20 with con 0x26aace0, requested num -1 [ CSSD]2013-05-23 15:38:53.152 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:53.152 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:38:53.153 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:38:53.153 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:53.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680f20) [ CSSD]2013-05-23 15:38:53.159 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:38:53.159 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:38:53.160 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:38:53.362 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aadb0 [ CSSD]2013-05-23 15:38:53.362 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aadb0) con(0x26a9440) skgpid ospid 18961 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:38:53.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:53.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:53.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:53.738 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:38:53.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a8002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:55.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:55.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:55.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:56.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:38:56.010 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:38:57.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:57.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:57.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:38:57.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a9002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:57.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:38:57.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:38:57.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:38:57.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:38:57.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02aa002c) incarnation(174631051) [ CSSD]2013-05-23 15:38:57.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:38:57.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:38:59.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:38:59.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:38:59.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:01.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:01.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:01.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:01.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:01.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:03.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:03.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:03.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:03.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:04.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ab002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:04.604 [1199044928] >TRACE: clssgmAllocProc: (0x26aaca0) allocated [ CSSD]2013-05-23 15:39:04.605 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:39:04.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaca0 - 1,2,3 [ CSSD]2013-05-23 15:39:04.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cae0) proc(0x26aaca0) pid(19089) version 11:1:1:4 [ CSSD]2013-05-23 15:39:04.622 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aaca0), client(1/0x2680d60) [ CSSD]2013-05-23 15:39:04.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:04.622 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680d60 with con 0x26aabd0, requested num -1 [ CSSD]2013-05-23 15:39:04.622 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:04.622 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:39:04.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:04.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:04.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:04.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:39:04.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26811d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:04.630 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26811d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:04.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaca0 [ CSSD]2013-05-23 15:39:04.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaca0) con(0x261cae0) skgpid ospid 19089 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:05.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:05.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:05.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:06.016 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:06.016 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:07.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:07.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:07.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:08.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ac002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:08.359 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:39:08.359 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:39:08.359 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:39:08.359 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:08.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ad002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:08.366 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:39:08.366 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:39:08.395 [1199044928] >TRACE: clssgmAllocProc: (0x26aaca0) allocated [ CSSD]2013-05-23 15:39:08.396 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:39:08.396 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaca0 - 1,2,3 [ CSSD]2013-05-23 15:39:08.396 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cae0) proc(0x26aaca0) pid(19122) version 11:1:1:4 [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aaca0), client(1/0x2680d60) [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680d60 with con 0x26aabd0, requested num -1 [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:08.404 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:08.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:08.411 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:39:08.411 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26811d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:08.411 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26811d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:08.614 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaca0 [ CSSD]2013-05-23 15:39:08.614 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaca0) con(0x261cae0) skgpid ospid 19122 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:09.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:09.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:09.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:11.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:11.018 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:11.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:11.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:11.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:13.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ae002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:13.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:39:13.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:39:13.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:39:13.150 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:13.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02af002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:13.157 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:39:13.157 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:39:13.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:13.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:13.798 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:14.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:14.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b0002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:15.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:15.794 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:16.021 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:16.021 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:16.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:17.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:17.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:18.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:19.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:19.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:20.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:20.023 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:39:20.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:21.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:21.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:22.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:22.456 [1199044928] >TRACE: clssgmAllocProc: (0x26808c0) allocated [ CSSD]2013-05-23 15:39:22.457 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:39:22.458 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26808c0 - 1,2,3 [ CSSD]2013-05-23 15:39:22.458 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9440) proc(0x26808c0) pid(19253) version 11:1:1:4 [ CSSD]2013-05-23 15:39:22.577 [1199044928] >TRACE: clssgmAllocProc: (0x2681e60) allocated [ CSSD]2013-05-23 15:39:22.577 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:39:22.578 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681e60 - 1,2,3 [ CSSD]2013-05-23 15:39:22.578 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2680f90) proc(0x2681e60) pid(19263) version 11:1:1:4 [ CSSD]2013-05-23 15:39:22.595 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:39:22.597 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:39:22.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681e60 [ CSSD]2013-05-23 15:39:22.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681e60) con(0x2680f90) skgpid ospid 19263 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5336/0x26aae60) [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5336 (0x26aae60) [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26aae60 with con 0x26aace0, requested num -1 [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x2680f90/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:22.680 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:39:22.686 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5336 (0x26aae60) [ CSSD]2013-05-23 15:39:22.686 [1199044928] >TRACE: clssgmExitGrock: client 5336 (0x26aae60), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:39:22.686 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681290) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:39:22.686 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2681290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:22.687 [1199044928] >TRACE: clssgmDeadProc: proc 0x26808c0 [ CSSD]2013-05-23 15:39:22.687 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26808c0) con(0x26a9440) skgpid ospid 19253 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:23.649 [1199044928] >TRACE: clssgmAllocProc: (0x26a9950) allocated [ CSSD]2013-05-23 15:39:23.649 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:39:23.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9950 - 1,2,3 [ CSSD]2013-05-23 15:39:23.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681170) proc(0x26a9950) pid(19279) version 11:1:1:4 [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9950), client(1/0x26813b0) [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26813b0) [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26813b0 with con 0x26a9880, requested num -1 [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa0e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:23.656 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:23.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26813b0) [ CSSD]2013-05-23 15:39:23.663 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26813b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:39:23.663 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa3e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:23.663 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa3e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:23.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:23.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:23.829 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:23.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9950 [ CSSD]2013-05-23 15:39:23.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9950) con(0x2681170) skgpid ospid 19279 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:24.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b1002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:24.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:25.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:25.026 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:25.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:25.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:26.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:27.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:27.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:28.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:28.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b2002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:28.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:39:28.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:39:28.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:39:28.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:28.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b3002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:28.406 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:39:28.407 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:39:29.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:29.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:30.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:30.029 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:30.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:31.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:31.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:32.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:33.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:33.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:33.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:34.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b4002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:34.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:35.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:35.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:35.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:35.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:36.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:37.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:37.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:38.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:38.905 [1199044928] >TRACE: clssgmAllocProc: (0x26808c0) allocated [ CSSD]2013-05-23 15:39:38.906 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:39:38.906 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26808c0 - 1,2,3 [ CSSD]2013-05-23 15:39:38.906 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9440) proc(0x26808c0) pid(19440) version 11:1:1:4 [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26808c0), client(1/0x26aae60) [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aae60) [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aae60 with con 0x26aace0, requested num -1 [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681050/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:38.913 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:38.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aae60) [ CSSD]2013-05-23 15:39:38.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aae60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:39:38.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:38.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:39.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x26808c0 [ CSSD]2013-05-23 15:39:39.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26808c0) con(0x26a9440) skgpid ospid 19440 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:39.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:39.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:40.034 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:40.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:40.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:41.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:41.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:42.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:43.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b5002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:43.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:39:43.648 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:39:43.648 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:39:43.648 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:43.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b6002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:43.655 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:39:43.655 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:39:43.879 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:43.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:43.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:44.037 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:44.037 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:39:44.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b7002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:44.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:46.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:46.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:46.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:48.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:48.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:48.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:49.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:49.040 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:50.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:50.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:50.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:52.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:52.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:52.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:53.909 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:39:54.042 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:54.042 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:39:54.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:54.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:54.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b8002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:54.169 [1199044928] >TRACE: clssgmAllocProc: (0x26aaca0) allocated [ CSSD]2013-05-23 15:39:54.170 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:39:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaca0 - 1,2,3 [ CSSD]2013-05-23 15:39:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cae0) proc(0x26aaca0) pid(19597) version 11:1:1:4 [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aaca0), client(1/0x2680d60) [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680d60 with con 0x26aabd0, requested num -1 [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:39:54.178 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:54.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:39:54.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:39:54.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26811d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:39:54.185 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26811d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:39:54.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaca0 [ CSSD]2013-05-23 15:39:54.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaca0) con(0x261cae0) skgpid ospid 19597 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:39:54.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:56.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:56.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:56.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:58.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:39:58.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:39:58.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:39:58.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b9002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:58.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:39:58.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:39:58.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:39:58.898 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:39:58.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ba002c) incarnation(174631051) [ CSSD]2013-05-23 15:39:58.905 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:39:58.905 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:39:59.045 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:39:59.045 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:00.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:00.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:00.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:02.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:02.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:02.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:03.949 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:04.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:04.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:04.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:04.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:04.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bb002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:04.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:04.557 [1199044928] >TRACE: clssgmAllocProc: (0x26808c0) allocated [ CSSD]2013-05-23 15:40:04.558 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:40:04.558 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26808c0 - 1,2,3 [ CSSD]2013-05-23 15:40:04.558 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9440) proc(0x26808c0) pid(19925/19925) version 11:1:1:4 [ CSSD]2013-05-23 15:40:04.564 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26808c0), client(1/0x26aae60) [ CSSD]2013-05-23 15:40:04.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aae60) [ CSSD]2013-05-23 15:40:04.564 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:40:04.564 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 15:40:04.870 [1199044928] >TRACE: clssgmAllocProc: (0x26820e0) allocated [ CSSD]2013-05-23 15:40:04.871 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:40:04.871 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26820e0 - 1,2,3 [ CSSD]2013-05-23 15:40:04.871 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681460) proc(0x26820e0) pid(19927) version 11:1:1:4 [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26820e0), client(1/0x2695df0) [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2695df0) [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2695df0 with con 0x26956e0, requested num -1 [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2695f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:40:04.878 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:04.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2695df0) [ CSSD]2013-05-23 15:40:04.885 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2695df0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:40:04.885 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2696260) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:04.886 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2696260) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aae60) [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aae60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aae60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmDeadProc: proc 0x26808c0 [ CSSD]2013-05-23 15:40:05.038 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26808c0) con(0x26a9440) skgpid 19925 ospid 19925 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:05.088 [1199044928] >TRACE: clssgmDeadProc: proc 0x26820e0 [ CSSD]2013-05-23 15:40:05.088 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26820e0) con(0x2681460) skgpid ospid 19927 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:06.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:06.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:06.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:08.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:08.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:08.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:08.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02bc002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:08.617 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:08.617 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:08.617 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:08.617 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:08.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bd002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:08.624 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:08.624 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:40:09.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:09.051 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:09.424 [1199044928] >TRACE: clssgmAllocProc: (0x26aaca0) allocated [ CSSD]2013-05-23 15:40:09.425 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:40:09.425 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaca0 - 1,2,3 [ CSSD]2013-05-23 15:40:09.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cae0) proc(0x26aaca0) pid(19966) version 11:1:1:4 [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aaca0), client(1/0x2680d60) [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2680d60 with con 0x26aabd0, requested num -1 [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680ed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:40:09.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:09.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2680d60) [ CSSD]2013-05-23 15:40:09.440 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2680d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:40:09.440 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26811d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:09.440 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26811d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:40:09.643 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaca0 [ CSSD]2013-05-23 15:40:09.643 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaca0) con(0x261cae0) skgpid ospid 19966 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:10.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:10.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:10.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb5e0 [ CSSD]2013-05-23 15:40:11.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb5e0) con(0x269a460) skgpid 18753 ospid 18753 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:12.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:12.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:12.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:13.980 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:14.053 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:14.053 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:14.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02be002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:14.156 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:14.156 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:14.156 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:14.156 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:14.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bf002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:14.163 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:14.163 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:40:14.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c0002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:14.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:14.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:14.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:16.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:16.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:16.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:18.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:18.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8d20 [ CSSD]2013-05-23 15:40:18.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8d20) con(0x267fd80) skgpid 14528 ospid 14528 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:18.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:40:18.535 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261bfb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:40:18.535 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261bfb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:40:18.535 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:40:18.536 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d60 [ CSSD]2013-05-23 15:40:18.536 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d60) con(0x26916a0) skgpid 14530 ospid 14530 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:18.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:19.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:19.056 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:20.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:20.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:20.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:22.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:22.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:22.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:24.000 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:24.059 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:24.059 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:24.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c1002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:24.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:24.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:24.675 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 15:40:24.676 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:40:24.677 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 15:40:24.677 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261cae0) proc(0x261b8e0) pid(20111) version 11:1:1:4 [ CSSD]2013-05-23 15:40:24.682 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261b8e0), client(1/0x266f1a0) [ CSSD]2013-05-23 15:40:24.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:40:24.682 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x261f650, requested num -1 [ CSSD]2013-05-23 15:40:24.682 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:24.682 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce7b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:40:24.683 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:40:24.683 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:24.689 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:40:24.690 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:40:24.690 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:24.690 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:40:24.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:24.892 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 15:40:24.892 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x261cae0) skgpid ospid 20111 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:25.575 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 15:40:25.575 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:40:25.576 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 15:40:25.576 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261f650) proc(0x261b8e0) pid(18959/18959) version 11:1:1:4 [ CSSD]2013-05-23 15:40:25.592 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261b8e0), client(1/0x2678eb0) [ CSSD]2013-05-23 15:40:25.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:40:25.592 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:40:25.592 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:40:26.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:26.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:26.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:28.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:28.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:28.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:29.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:29.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:29.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c2002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:29.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:29.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:29.405 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:29.405 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:29.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c3002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:29.412 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:29.412 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:40:30.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:30.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:30.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:32.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:32.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:32.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:33.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:33.064 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:40:34.020 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:34.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c4002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:34.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:34.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:34.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:36.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:36.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:36.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:38.066 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:38.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:38.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:38.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:38.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:39.926 [1199044928] >TRACE: clssgmAllocProc: (0x26e8b70) allocated [ CSSD]2013-05-23 15:40:39.926 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:40:39.927 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8b70 - 1,2,3 [ CSSD]2013-05-23 15:40:39.927 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26e8b70) pid(20283) version 11:1:1:4 [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8b70), client(1/0x261bfb0) [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:40:39.933 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:39.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:40:39.939 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:40:39.939 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269ab20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:39.939 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269ab20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:40:40.142 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8b70 [ CSSD]2013-05-23 15:40:40.142 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8b70) con(0x26916a0) skgpid ospid 20283 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:40.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:40.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:40.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:42.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:42.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:42.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:43.069 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:43.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:44.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:44.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c5002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:44.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:44.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:44.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c6002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:44.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:44.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:44.654 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:44.654 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:44.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c7002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:44.661 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:44.661 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:40:44.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:46.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:46.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:46.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:48.072 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:48.072 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:48.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:48.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:49.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:50.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:50.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:51.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:52.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:52.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:53.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:53.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:53.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:54.061 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:40:54.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c8002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:54.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:54.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:55.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:55.174 [1199044928] >TRACE: clssgmAllocProc: (0x26e8b70) allocated [ CSSD]2013-05-23 15:40:55.175 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:40:55.176 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8b70 - 1,2,3 [ CSSD]2013-05-23 15:40:55.176 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26e8b70) pid(20432) version 11:1:1:4 [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8b70), client(1/0x261bfb0) [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:40:55.183 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:55.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:40:55.190 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:40:55.190 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269ab20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:40:55.190 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269ab20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:40:55.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c9002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:55.263 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:55.263 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:55.263 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:55.263 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:55.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ca002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:55.271 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:55.271 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:40:55.392 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8b70 [ CSSD]2013-05-23 15:40:55.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8b70) con(0x26916a0) skgpid ospid 20432 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:40:56.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:56.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:57.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:58.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:40:58.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:40:58.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:40:58.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:40:59.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:40:59.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cb002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:59.923 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:40:59.923 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:40:59.923 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:40:59.923 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:40:59.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cc002c) incarnation(174631051) [ CSSD]2013-05-23 15:40:59.930 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:40:59.930 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:00.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:00.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:01.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:02.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:02.079 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:41:02.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:02.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:03.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:04.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:04.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02cd002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:04.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:04.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:05.135 [1199044928] >TRACE: clssgmAllocProc: (0x26e8b70) allocated [ CSSD]2013-05-23 15:41:05.136 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:41:05.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8b70 - 1,2,3 [ CSSD]2013-05-23 15:41:05.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26e8b70) pid(20542) version 11:1:1:4 [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8b70), client(1/0x261bfb0) [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x26916a0, requested num -1 [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:41:05.142 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:05.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:05.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:05.148 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:41:05.148 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269ab20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:05.148 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269ab20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:41:05.351 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8b70 [ CSSD]2013-05-23 15:41:05.351 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8b70) con(0x269a460) skgpid ospid 20542 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:06.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:06.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:07.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:07.082 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:07.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:08.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:08.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:08.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ce002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:08.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:41:08.885 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:41:08.885 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:41:08.885 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:08.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cf002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:08.892 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:41:08.892 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:09.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:10.424 [1199044928] >TRACE: clssgmAllocProc: (0x26e8b70) allocated [ CSSD]2013-05-23 15:41:10.425 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:41:10.426 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8b70 - 1,2,3 [ CSSD]2013-05-23 15:41:10.426 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26e8b70) pid(20581) version 11:1:1:4 [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8b70), client(1/0x261bfb0) [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x2698d00, requested num -1 [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:41:10.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:10.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:10.439 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:41:10.439 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269ab20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:10.439 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269ab20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:41:10.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8b70 [ CSSD]2013-05-23 15:41:10.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8b70) con(0x26916a0) skgpid ospid 20581 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:10.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:10.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:11.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:12.084 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:12.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:12.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:12.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:13.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:14.106 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:14.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d0002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:14.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d1002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:14.804 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:41:14.804 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:41:14.804 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:41:14.804 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:14.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d2002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:14.811 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:41:14.811 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:14.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:14.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:14.941 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:41:14.941 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:41:14.943 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:41:14.943 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:41:15.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d3002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:15.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:41:15.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:41:15.173 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:41:15.174 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:15.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d4002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:15.180 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:41:15.180 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:15.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:15.546 [1199044928] >TRACE: clssgmAllocProc: (0x26e8b70) allocated [ CSSD]2013-05-23 15:41:15.546 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:41:15.547 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8b70 - 1,2,3 [ CSSD]2013-05-23 15:41:15.547 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26e8b70) pid(20656/20656) version 11:1:1:4 [ CSSD]2013-05-23 15:41:15.562 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8b70), client(1/0x261bfb0) [ CSSD]2013-05-23 15:41:15.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:15.562 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:41:15.562 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261bfb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261bfb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8b70 [ CSSD]2013-05-23 15:41:15.580 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8b70) con(0x269a460) skgpid 20656 ospid 20656 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:16.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:16.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:17.087 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:17.087 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:17.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:18.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:18.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:19.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:20.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:20.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:21.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:22.090 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:22.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:22.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2678250) [ CSSD]2013-05-23 15:41:22.840 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2678250), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:41:22.840 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2678250), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:41:22.840 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 15:41:22.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 15:41:22.848 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:41:22.848 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:41:22.849 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:41:22.849 [1199044928] >TRACE: clssgmDeadProc: proc 0x2677de0 [ CSSD]2013-05-23 15:41:22.849 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2677de0) con(0x269db60) skgpid 15358 ospid 15358 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:23.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:23.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:23.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:24.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:24.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d5002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:25.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:25.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:25.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:25.674 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1b0) allocated [ CSSD]2013-05-23 15:41:25.674 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:41:25.675 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1b0 - 1,2,3 [ CSSD]2013-05-23 15:41:25.675 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26ee1b0) pid(20746) version 11:1:1:4 [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ee1b0), client(1/0x261bfb0) [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x268c760, requested num -1 [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2677de0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:41:25.681 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:25.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:25.688 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:41:25.688 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ce910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:25.688 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ce910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:41:25.890 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1b0 [ CSSD]2013-05-23 15:41:25.890 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1b0) con(0x26916a0) skgpid ospid 20746 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:26.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:26.092 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:41:27.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:27.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:27.432 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:29.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:29.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:29.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:30.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d6002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:30.435 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:41:30.435 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:41:30.435 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:41:30.435 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:30.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d7002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:30.443 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:41:30.443 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:31.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:31.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:31.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:31.095 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:31.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:33.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:33.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:33.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:34.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:34.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d8002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:35.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:35.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:35.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:36.097 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:36.098 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:36.904 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1b0) allocated [ CSSD]2013-05-23 15:41:36.904 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:41:36.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1b0 - 1,2,3 [ CSSD]2013-05-23 15:41:36.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269a460) proc(0x26ee1b0) pid(20721/20721) version 11:1:1:4 [ CSSD]2013-05-23 15:41:36.910 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26ee1b0), client(1/0x266f1a0) [ CSSD]2013-05-23 15:41:36.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:41:36.911 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:41:36.911 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:41:37.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:37.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:37.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:39.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:39.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:39.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:40.933 [1199044928] >TRACE: clssgmAllocProc: (0x26907f0) allocated [ CSSD]2013-05-23 15:41:40.934 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:41:40.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26907f0 - 1,2,3 [ CSSD]2013-05-23 15:41:40.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26907f0) pid(20911) version 11:1:1:4 [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26907f0), client(1/0x2698d10) [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2698d10) [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2698d10 with con 0x26e8aa0, requested num -1 [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a5e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:41:40.950 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:40.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2698d10) [ CSSD]2013-05-23 15:41:40.957 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2698d10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:41:40.957 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e2c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:40.957 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e2c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:41:41.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:41.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:41.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:41.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:41.159 [1199044928] >TRACE: clssgmDeadProc: proc 0x26907f0 [ CSSD]2013-05-23 15:41:41.159 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26907f0) con(0x26916a0) skgpid ospid 20911 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:41.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:43.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:43.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:43.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:44.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:44.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d9002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:45.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:45.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:45.578 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:45.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02da002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:45.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:41:45.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:41:45.685 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:41:45.685 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:45.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02db002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:45.692 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:41:45.692 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:41:46.103 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:46.103 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:47.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:47.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:47.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:49.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:49.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:49.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:51.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:51.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:41:51.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:51.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:51.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:53.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:53.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:53.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:54.201 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:41:54.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02dc002c) incarnation(174631051) [ CSSD]2013-05-23 15:41:55.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:41:55.108 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:41:55.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:55.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:55.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:56.192 [1199044928] >TRACE: clssgmAllocProc: (0x26907f0) allocated [ CSSD]2013-05-23 15:41:56.192 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:41:56.193 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26907f0 - 1,2,3 [ CSSD]2013-05-23 15:41:56.193 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26907f0) pid(21052) version 11:1:1:4 [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26907f0), client(1/0x261bfb0) [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x26e8aa0, requested num -1 [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a5e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:41:56.209 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:41:56.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:41:56.215 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:41:56.215 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e2c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:41:56.215 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e2c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:41:56.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x26907f0 [ CSSD]2013-05-23 15:41:56.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26907f0) con(0x26916a0) skgpid ospid 21052 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:41:57.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:57.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:57.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:41:59.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:41:59.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:41:59.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:00.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:00.110 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:00.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02dd002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:00.933 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:00.933 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:00.933 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:00.933 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:00.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02de002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:00.940 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:00.941 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:01.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:01.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:01.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:03.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:03.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:03.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:04.226 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:04.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02df002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:05.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:05.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:05.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e0002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:05.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:05.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:05.294 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:05.294 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:05.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e1002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:05.301 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:05.301 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:05.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:05.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:05.394 [1199044928] >TRACE: clssgmAllocProc: (0x26907f0) allocated [ CSSD]2013-05-23 15:42:05.395 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:42:05.396 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26907f0 - 1,2,3 [ CSSD]2013-05-23 15:42:05.396 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26907f0) pid(21168) version 11:1:1:4 [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26907f0), client(1/0x267c0b0) [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c0b0 with con 0x26e1ca0, requested num -1 [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a5e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:42:05.403 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:05.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c0b0) [ CSSD]2013-05-23 15:42:05.411 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c0b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:42:05.411 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e2c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:05.411 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e2c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:42:05.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x26907f0 [ CSSD]2013-05-23 15:42:05.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26907f0) con(0x26916a0) skgpid ospid 21168 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:05.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:07.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:07.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:07.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:09.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e2002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:09.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:09.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:09.134 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:09.134 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:09.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e3002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:09.142 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:09.142 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:09.322 [1199044928] >TRACE: clssgmAllocProc: (0x26907f0) allocated [ CSSD]2013-05-23 15:42:09.323 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:42:09.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26907f0 - 1,2,3 [ CSSD]2013-05-23 15:42:09.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26916a0) proc(0x26907f0) pid(20719/20719) version 11:1:1:4 [ CSSD]2013-05-23 15:42:09.339 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26907f0), client(1/0x2698d10) [ CSSD]2013-05-23 15:42:09.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2698d10) [ CSSD]2013-05-23 15:42:09.339 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:42:09.339 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:42:09.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:09.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:09.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:10.116 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:10.116 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:11.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:11.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:11.458 [1199044928] >TRACE: clssgmAllocProc: (0x26bb5e0) allocated [ CSSD]2013-05-23 15:42:11.458 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:42:11.459 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb5e0 - 1,2,3 [ CSSD]2013-05-23 15:42:11.459 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690740) proc(0x26bb5e0) pid(21284) version 11:1:1:4 [ CSSD]2013-05-23 15:42:11.461 [1199044928] >TRACE: clssgmAllocProc: (0x26801c0) allocated [ CSSD]2013-05-23 15:42:11.462 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:42:11.462 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26801c0 - 1,2,3 [ CSSD]2013-05-23 15:42:11.462 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ca0) proc(0x26801c0) pid(21247) version 11:1:1:4 [ CSSD]2013-05-23 15:42:11.466 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb5e0), client(1/0x261bfb0) [ CSSD]2013-05-23 15:42:11.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:42:11.466 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261bfb0 with con 0x269e070, requested num -1 [ CSSD]2013-05-23 15:42:11.466 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:11.466 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2680890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:42:11.467 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:42:11.467 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:11.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261bfb0) [ CSSD]2013-05-23 15:42:11.473 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261bfb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:42:11.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2680b90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:11.473 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2680b90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:42:11.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb5e0 [ CSSD]2013-05-23 15:42:11.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb5e0) con(0x2690740) skgpid ospid 21284 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:11.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:13.221 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:42:13.222 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:42:13.223 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:42:13.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:42:13.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e4002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:13.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:13.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:13.301 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:42:13.301 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:42:13.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e5002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:13.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:13.310 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:13.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:13.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:13.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:14.011 [1199044928] >TRACE: clssgmDeadProc: proc 0x26801c0 [ CSSD]2013-05-23 15:42:14.011 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26801c0) con(0x26e1ca0) skgpid ospid 21247 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:14.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:14.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e6002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:15.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:15.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:15.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:15.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:15.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:16.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e7002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:16.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:16.190 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:16.190 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:16.191 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:16.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e8002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:16.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:16.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:17.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:17.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:17.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:19.120 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:19.120 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:42:19.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:19.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:19.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:21.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:21.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:21.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:23.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:23.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:23.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:24.123 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:24.123 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:24.274 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:24.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e9002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:25.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:25.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:25.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:26.719 [1199044928] >TRACE: clssgmAllocProc: (0x26bb5e0) allocated [ CSSD]2013-05-23 15:42:26.720 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:42:26.720 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb5e0 - 1,2,3 [ CSSD]2013-05-23 15:42:26.720 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ca0) proc(0x26bb5e0) pid(21692) version 11:1:1:4 [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb5e0), client(1/0x7f82ac01c9c0) [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac01c9c0 with con 0x7f82ac007600, requested num -1 [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:42:26.737 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:26.744 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac01c9c0) [ CSSD]2013-05-23 15:42:26.744 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac01c9c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:42:26.744 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0191a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:26.744 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0191a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:42:26.947 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb5e0 [ CSSD]2013-05-23 15:42:26.947 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb5e0) con(0x26e1ca0) skgpid ospid 21692 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:27.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:27.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:27.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:29.126 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:29.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:29.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:29.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:29.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:31.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ea002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:31.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:31.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:31.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:31.441 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:31.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02eb002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:31.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:31.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:31.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:31.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:31.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:33.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:33.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:33.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:34.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:34.129 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:34.296 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:34.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ec002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:35.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:35.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:35.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:37.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:37.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:37.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:39.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:39.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:39.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:39.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:39.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:41.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:41.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:41.980 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019770) allocated [ CSSD]2013-05-23 15:42:41.981 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:42:41.981 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019770 - 1,2,3 [ CSSD]2013-05-23 15:42:41.981 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018eb0) proc(0x7f82ac019770) pid(21851) version 11:1:1:4 [ CSSD]2013-05-23 15:42:41.987 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac019770), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 15:42:41.987 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:42:41.987 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076d0 with con 0x7f82ac019bc0, requested num -1 [ CSSD]2013-05-23 15:42:41.987 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:41.987 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:42:41.988 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:42:41.988 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:41.994 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:42:41.994 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:42:41.994 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:41.994 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:42:42.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:42.196 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019770 [ CSSD]2013-05-23 15:42:42.196 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019770) con(0x7f82ac018eb0) skgpid ospid 21851 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:43.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:43.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:44.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:44.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:44.134 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:44.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:44.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ed002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:45.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:45.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:46.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:46.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ee002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:46.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:42:46.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:42:46.691 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:42:46.691 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:46.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ef002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:46.698 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:42:46.698 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:42:47.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:47.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:48.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:48.558 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268be20) [ CSSD]2013-05-23 15:42:48.559 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268be20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:42:48.559 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268be20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:42:48.559 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:42:48.559 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 15:42:48.559 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x267bdb0) skgpid 16244 ospid 16244 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:49.137 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:49.137 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:49.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:49.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:50.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:51.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:51.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:52.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:53.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:53.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:54.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:54.139 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:54.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:54.337 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:42:54.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f0002c) incarnation(174631051) [ CSSD]2013-05-23 15:42:55.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:55.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:56.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:57.232 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0772b0) allocated [ CSSD]2013-05-23 15:42:57.233 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:42:57.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0772b0 - 1,2,3 [ CSSD]2013-05-23 15:42:57.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac0772b0) pid(22015) version 11:1:1:4 [ CSSD]2013-05-23 15:42:57.239 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0772b0), client(1/0x7f82ac019b00) [ CSSD]2013-05-23 15:42:57.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019b00) [ CSSD]2013-05-23 15:42:57.239 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019b00 with con 0x7f82ac0773e0, requested num -1 [ CSSD]2013-05-23 15:42:57.239 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:57.239 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:42:57.240 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:42:57.240 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:42:57.246 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019b00) [ CSSD]2013-05-23 15:42:57.246 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019b00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:42:57.246 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:42:57.246 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:42:57.448 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0772b0 [ CSSD]2013-05-23 15:42:57.448 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0772b0) con(0x7f82ac018e90) skgpid ospid 22015 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:42:57.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:57.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:42:58.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:42:59.142 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:42:59.142 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:42:59.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:42:59.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:00.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:01.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:01.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:01.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f1002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:01.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:43:01.942 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:43:01.942 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:43:01.942 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:01.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f2002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:01.949 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:43:01.949 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:43:02.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:03.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:03.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:04.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:04.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:04.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:04.360 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:04.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f3002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:05.654 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019770) allocated [ CSSD]2013-05-23 15:43:05.655 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:43:05.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019770 - 1,2,3 [ CSSD]2013-05-23 15:43:05.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018eb0) proc(0x7f82ac019770) pid(22137) version 11:1:1:4 [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac019770), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076d0 with con 0x7f82ac019bc0, requested num -1 [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:05.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:05.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:05.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:43:05.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:05.670 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:05.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:05.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:05.872 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019770 [ CSSD]2013-05-23 15:43:05.872 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019770) con(0x7f82ac018eb0) skgpid ospid 22137 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:06.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:07.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:07.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:08.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:09.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:09.148 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:09.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f4002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:09.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:43:09.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:43:09.404 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:43:09.404 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:09.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f5002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:09.411 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:43:09.411 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:43:09.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:09.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:10.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:11.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:11.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:12.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:12.485 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019590) allocated [ CSSD]2013-05-23 15:43:12.486 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:43:12.487 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019590 - 1,2,3 [ CSSD]2013-05-23 15:43:12.487 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac019590) pid(22188) version 11:1:1:4 [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac019590), client(1/0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019ad0 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:12.492 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:12.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:12.499 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019ad0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:43:12.499 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:12.499 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:12.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019590 [ CSSD]2013-05-23 15:43:12.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019590) con(0x7f82ac018e90) skgpid ospid 22188 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:13.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:13.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:14.150 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:14.150 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:14.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:14.382 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:14.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f6002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:15.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:15.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:16.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:17.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f7002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:17.193 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:43:17.193 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:43:17.193 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:43:17.194 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:17.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f8002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:17.201 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:43:17.201 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:43:18.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:18.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:18.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:19.153 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:19.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:20.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:20.027 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:20.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:22.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:22.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:22.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:24.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:24.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:24.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:24.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:24.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:24.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:24.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f9002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:26.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:26.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:26.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:27.734 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0772b0) allocated [ CSSD]2013-05-23 15:43:27.735 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:43:27.735 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0772b0 - 1,2,3 [ CSSD]2013-05-23 15:43:27.735 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac0772b0) pid(22327) version 11:1:1:4 [ CSSD]2013-05-23 15:43:27.741 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0772b0), client(1/0x7f82ac019b00) [ CSSD]2013-05-23 15:43:27.741 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019b00) [ CSSD]2013-05-23 15:43:27.741 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019b00 with con 0x7f82ac0773e0, requested num -1 [ CSSD]2013-05-23 15:43:27.741 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:27.741 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:43:27.742 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:27.742 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:27.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019b00) [ CSSD]2013-05-23 15:43:27.748 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019b00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:43:27.748 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:27.748 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:27.951 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0772b0 [ CSSD]2013-05-23 15:43:27.951 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0772b0) con(0x7f82ac018e90) skgpid ospid 22327 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:28.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:28.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:28.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:29.159 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:29.159 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:30.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:30.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:30.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:32.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:32.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:32.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fa002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:32.445 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:43:32.445 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:43:32.445 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:43:32.445 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:32.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fb002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:32.453 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:43:32.453 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:43:32.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:34.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:34.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:34.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:34.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:34.434 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:34.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:34.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fc002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:35.943 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019770) allocated [ CSSD]2013-05-23 15:43:35.943 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:43:35.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019770 - 1,2,3 [ CSSD]2013-05-23 15:43:35.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018eb0) proc(0x7f82ac019770) pid(22450) version 11:1:1:4 [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac019770), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac0076d0 with con 0x7f82ac019bc0, requested num -1 [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:35.951 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:35.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:43:35.958 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:43:35.958 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019a40) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:43:35.958 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac019a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:36.066 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 15:43:36.067 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:43:36.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 15:43:36.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac019bf0) proc(0x7f82ac003440) pid(22455) version 11:1:1:4 [ CSSD]2013-05-23 15:43:36.083 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:43:36.086 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:43:36.088 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:43:36.090 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 15:43:36.090 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac019bf0) skgpid ospid 22455 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:36.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:36.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:36.160 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019770 [ CSSD]2013-05-23 15:43:36.160 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019770) con(0x7f82ac018eb0) skgpid ospid 22450 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:36.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:38.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:38.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:38.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:39.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:39.164 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:40.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:40.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:40.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:41.177 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0772b0) allocated [ CSSD]2013-05-23 15:43:41.178 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:43:41.179 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0772b0 - 1,2,3 [ CSSD]2013-05-23 15:43:41.179 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac0772b0) pid(22513) version 11:1:1:4 [ CSSD]2013-05-23 15:43:41.746 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0772b0 [ CSSD]2013-05-23 15:43:41.746 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0772b0) con(0x7f82ac018e90) skgpid ospid 22513 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:42.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:42.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:42.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:42.988 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac019590) allocated [ CSSD]2013-05-23 15:43:42.988 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:43:42.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac019590 - 1,2,3 [ CSSD]2013-05-23 15:43:42.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac019590) pid(22670) version 11:1:1:4 [ CSSD]2013-05-23 15:43:42.995 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac019590), client(1/0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019ad0 with con 0x7f82ac0773d0, requested num -1 [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006220/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:42.996 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:43.002 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019ad0) [ CSSD]2013-05-23 15:43:43.002 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019ad0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:43:43.002 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006520) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:43.002 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006520) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:43.205 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac019590 [ CSSD]2013-05-23 15:43:43.205 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac019590) con(0x7f82ac018e90) skgpid ospid 22670 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:44.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:44.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:44.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:44.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:44.466 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:44.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:44.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fd002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:46.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:46.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:46.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:47.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fe002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:47.705 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:43:47.705 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:43:47.705 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:43:47.705 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:47.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ff002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:47.713 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:43:47.713 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac01c840) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:43:48.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:48.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:48.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:49.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:49.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:50.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:50.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:50.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:52.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:52.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:52.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:52.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x261c970) [ CSSD]2013-05-23 15:43:52.925 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x261c970), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:43:52.925 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x261c970), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:43:52.925 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261cb90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261cb90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9f10 [ CSSD]2013-05-23 15:43:52.929 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9f10) con(0x26b9290) skgpid 16917 ospid 16917 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:54.172 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:54.172 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:43:54.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:54.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:54.494 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:43:54.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:54.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0300002c) incarnation(174631051) [ CSSD]2013-05-23 15:43:56.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:56.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:56.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:43:57.503 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0772b0) allocated [ CSSD]2013-05-23 15:43:57.504 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:43:57.505 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0772b0 - 1,2,3 [ CSSD]2013-05-23 15:43:57.505 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac018e90) proc(0x7f82ac0772b0) pid(22800/22800) version 11:1:1:4 [ CSSD]2013-05-23 15:43:57.521 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0772b0), client(1/0x7f82ac019720) [ CSSD]2013-05-23 15:43:57.521 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac019720) [ CSSD]2013-05-23 15:43:57.521 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:43:57.521 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:43:58.174 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:43:58.175 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:43:58.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 15:43:58.240 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:43:58.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 15:43:58.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006550) proc(0x7f82ac003440) pid(22834) version 11:1:1:4 [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003980) [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003980) [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003980 with con 0x7f82ac012ee0, requested num -1 [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:43:58.247 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:43:58.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003980) [ CSSD]2013-05-23 15:43:58.254 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003980), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:43:58.254 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:43:58.254 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:43:58.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:43:58.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:43:58.456 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 15:43:58.456 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac006550) skgpid ospid 22834 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:43:58.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:00.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:00.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:00.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:02.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:02.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:02.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:02.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0301002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:02.966 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:44:02.966 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:44:02.966 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0060b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:44:02.966 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:02.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0302002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:02.974 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:44:02.974 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019b10) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:44:03.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:03.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:04.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:04.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:04.514 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:04.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:04.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0303002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:05.912 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 15:44:05.913 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:44:05.913 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 15:44:05.913 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac003440) pid(22940) version 11:1:1:4 [ CSSD]2013-05-23 15:44:05.919 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac013050) [ CSSD]2013-05-23 15:44:05.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac013050) [ CSSD]2013-05-23 15:44:05.919 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac013050 with con 0x7f82ac006e90, requested num -1 [ CSSD]2013-05-23 15:44:05.919 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:05.919 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0131c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:44:05.920 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:05.920 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:05.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac013050) [ CSSD]2013-05-23 15:44:05.926 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac013050), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:44:05.926 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0134c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:05.926 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0134c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:06.129 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 15:44:06.129 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac007600) skgpid ospid 22940 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:06.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:06.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:06.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:07.686 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003440) allocated [ CSSD]2013-05-23 15:44:07.687 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:44:07.687 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003440 - 1,2,3 [ CSSD]2013-05-23 15:44:07.687 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006550) proc(0x7f82ac003440) pid(21962/21962) version 11:1:1:4 [ CSSD]2013-05-23 15:44:07.693 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac003440), client(1/0x7f82ac003a30) [ CSSD]2013-05-23 15:44:07.693 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac003a30) [ CSSD]2013-05-23 15:44:07.693 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:44:07.693 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:44:08.180 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:08.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:08.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:08.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:08.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:09.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0304002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:09.667 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:44:09.667 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:44:09.667 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013120/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:44:09.667 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:09.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0305002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:09.675 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:44:09.675 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0038e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:44:10.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:10.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:10.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:12.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:12.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:12.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:13.183 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:13.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:13.492 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe10) allocated [ CSSD]2013-05-23 15:44:13.493 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:44:13.493 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe10 - 1,2,3 [ CSSD]2013-05-23 15:44:13.493 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0136b0) proc(0x7f82ac00fe10) pid(22991) version 11:1:1:4 [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00fe10), client(1/0x7f82ac001070) [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001070) [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001070 with con 0x7f82ac00ff40, requested num -1 [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0011e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:13.499 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:13.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001070) [ CSSD]2013-05-23 15:44:13.505 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:44:13.505 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0014e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:13.505 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0014e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:13.707 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe10 [ CSSD]2013-05-23 15:44:13.707 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe10) con(0x7f82ac0136b0) skgpid ospid 22991 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:14.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:14.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:14.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:14.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:14.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0306002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:16.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:16.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:16.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:18.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:18.185 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:18.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0307002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:18.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:44:18.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:44:18.219 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013120/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:44:18.219 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:18.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0308002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:18.226 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:44:18.226 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0038e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:44:18.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:18.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:18.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:20.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:20.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:21.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:22.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:22.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:22.761 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0008c0) allocated [ CSSD]2013-05-23 15:44:22.762 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:44:22.763 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0008c0 - 1,2,3 [ CSSD]2013-05-23 15:44:22.763 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0008c0) pid(23096) version 11:1:1:4 [ CSSD]2013-05-23 15:44:22.881 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac002970) allocated [ CSSD]2013-05-23 15:44:22.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:44:22.883 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac002970 - 1,2,3 [ CSSD]2013-05-23 15:44:22.883 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac003980) proc(0x7f82ac002970) pid(23106) version 11:1:1:4 [ CSSD]2013-05-23 15:44:22.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:44:22.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:44:22.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac002970 [ CSSD]2013-05-23 15:44:22.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac002970) con(0x7f82ac003980) skgpid ospid 23106 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:22.983 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5337/0x7f82ac000ef0) [ CSSD]2013-05-23 15:44:22.983 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5337 (0x7f82ac000ef0) [ CSSD]2013-05-23 15:44:22.983 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac000ef0 with con 0x7f82ac003980, requested num -1 [ CSSD]2013-05-23 15:44:22.983 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:44:22.983 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac001060/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:44:22.984 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:22.984 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:44:22.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5337 (0x7f82ac000ef0) [ CSSD]2013-05-23 15:44:22.989 [1199044928] >TRACE: clssgmExitGrock: client 5337 (0x7f82ac000ef0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:44:22.989 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001360) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:44:22.989 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac001360) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:22.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0008c0 [ CSSD]2013-05-23 15:44:22.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0008c0) con(0x7f82ac007600) skgpid ospid 23096 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:23.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:23.188 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:23.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:24.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:24.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:24.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:25.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0309002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:25.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:26.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:26.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:27.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:27.190 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:27.190 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:44:28.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:28.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:28.742 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0008c0) allocated [ CSSD]2013-05-23 15:44:28.743 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:44:28.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0008c0 - 1,2,3 [ CSSD]2013-05-23 15:44:28.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0008c0) pid(23160) version 11:1:1:4 [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0008c0), client(1/0x7f82ac003980) [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003980) [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac003980 with con 0x7f82ac00fec0, requested num -1 [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001080/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:28.750 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:28.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003980) [ CSSD]2013-05-23 15:44:28.757 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003980), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:44:28.757 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:28.757 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:28.960 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0008c0 [ CSSD]2013-05-23 15:44:28.960 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0008c0) con(0x7f82ac007600) skgpid ospid 23160 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:29.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:30.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:30.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:31.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:32.193 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:32.193 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:32.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:32.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:33.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:33.212 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0772b0), client(2/0x7f82ac0134e0) [ CSSD]2013-05-23 15:44:33.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac0134e0) [ CSSD]2013-05-23 15:44:33.212 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:44:33.212 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 15:44:33.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030a002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:33.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:44:33.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:44:33.468 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:44:33.468 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:33.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030b002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:33.475 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:44:33.475 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013390) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:44:34.580 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:34.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:34.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:35.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030c002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:35.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:36.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:36.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:37.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:37.196 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:37.196 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:38.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:38.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:39.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:40.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:40.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:41.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:42.198 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:42.198 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:42.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:42.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:43.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:43.993 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc30) allocated [ CSSD]2013-05-23 15:44:43.994 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:44:43.994 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc30 - 1,2,3 [ CSSD]2013-05-23 15:44:43.994 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013be0) proc(0x7f82ac00fc30) pid(23346) version 11:1:1:4 [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00fc30), client(1/0x7f82ac0015d0) [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015d0 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001740/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:44.000 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:44.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:44:44.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:44:44.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:44.007 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:44.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc30 [ CSSD]2013-05-23 15:44:44.209 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc30) con(0x7f82ac013be0) skgpid ospid 23346 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:44:44.602 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:44.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:44.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:45.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030d002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:45.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:46.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:46.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:47.201 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:47.201 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:47.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:48.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030e002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:48.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:44:48.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:44:48.718 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:44:48.718 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:48.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030f002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:48.726 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:44:48.726 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013390) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:44:48.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:48.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:49.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:50.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:50.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:51.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:52.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:52.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:52.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:52.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:53.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:54.622 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:44:54.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:54.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:55.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0310002c) incarnation(174631051) [ CSSD]2013-05-23 15:44:55.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:56.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:56.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:57.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:44:57.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:44:57.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:58.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:44:58.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:44:59.253 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0141b0) allocated [ CSSD]2013-05-23 15:44:59.254 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:44:59.254 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0141b0 - 1,2,3 [ CSSD]2013-05-23 15:44:59.254 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0141b0) pid(23514) version 11:1:1:4 [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0141b0), client(1/0x7f82ac00ff50) [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ff50) [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ff50 with con 0x7f82ac013430, requested num -1 [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0015e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:44:59.270 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:44:59.271 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:44:59.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ff50) [ CSSD]2013-05-23 15:44:59.277 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ff50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:44:59.277 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0018e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:44:59.277 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0018e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:44:59.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:44:59.480 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0141b0 [ CSSD]2013-05-23 15:44:59.480 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0141b0) con(0x7f82ac007600) skgpid ospid 23514 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:00.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:00.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:01.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:02.209 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:02.209 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:02.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:02.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:03.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:03.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0311002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:03.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:45:03.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:45:03.977 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:45:03.977 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:03.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0312002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:03.984 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:45:03.984 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013390) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:45:04.643 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:04.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:04.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:05.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0313002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:05.266 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0141b0) allocated [ CSSD]2013-05-23 15:45:05.267 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:45:05.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0141b0 - 1,2,3 [ CSSD]2013-05-23 15:45:05.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0141b0) pid(23609/23609) version 11:1:1:4 [ CSSD]2013-05-23 15:45:05.284 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0141b0), client(1/0x7f82ac00fe70) [ CSSD]2013-05-23 15:45:05.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00fe70) [ CSSD]2013-05-23 15:45:05.284 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:45:05.284 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:45:05.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:05.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00fe70) [ CSSD]2013-05-23 15:45:05.557 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00fe70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:45:05.557 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00fe70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:45:05.558 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:45:05.558 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0141b0 [ CSSD]2013-05-23 15:45:05.558 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0141b0) con(0x7f82ac007600) skgpid 23609 ospid 23609 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:06.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0028a0) allocated [ CSSD]2013-05-23 15:45:06.173 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:45:06.173 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0028a0 - 1,2,3 [ CSSD]2013-05-23 15:45:06.173 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0028a0) pid(23611) version 11:1:1:4 [ CSSD]2013-05-23 15:45:06.179 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0028a0), client(1/0x7f82ac0140f0) [ CSSD]2013-05-23 15:45:06.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0140f0) [ CSSD]2013-05-23 15:45:06.179 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0140f0 with con 0x7f82ac013df0, requested num -1 [ CSSD]2013-05-23 15:45:06.179 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:06.179 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac00eb90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:45:06.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:45:06.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:06.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0140f0) [ CSSD]2013-05-23 15:45:06.186 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0140f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:45:06.186 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac00ee90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:06.186 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac00ee90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:45:06.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0028a0 [ CSSD]2013-05-23 15:45:06.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0028a0) con(0x7f82ac007600) skgpid ospid 23611 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:07.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:07.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:07.212 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:07.212 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:07.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:09.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:09.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:09.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:09.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0314002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:09.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:45:09.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:45:09.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:45:09.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:09.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0315002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:09.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:45:09.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013390) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:45:11.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:11.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:11.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:12.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:12.215 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:13.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:13.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:13.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:14.514 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc30) allocated [ CSSD]2013-05-23 15:45:14.515 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:45:14.515 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc30 - 1,2,3 [ CSSD]2013-05-23 15:45:14.515 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013be0) proc(0x7f82ac00fc30) pid(23674) version 11:1:1:4 [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00fc30), client(1/0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015d0 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001740/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:45:14.522 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:14.529 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:14.529 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:45:14.529 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:14.529 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:45:14.673 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:14.732 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc30 [ CSSD]2013-05-23 15:45:14.732 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc30) con(0x7f82ac013be0) skgpid ospid 23674 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:15.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0316002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:15.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:15.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:15.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:16.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:16.217 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:45:17.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:17.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:17.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ef0b0) [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ef0b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f50 [ CSSD]2013-05-23 15:45:18.590 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f50) con(0x26a6970) skgpid 18142 ospid 18142 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:19.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:19.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:19.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0317002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:19.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:45:19.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:45:19.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013650/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:45:19.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:19.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0318002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:19.233 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:45:19.233 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013390) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:45:19.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:21.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:21.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:21.219 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:21.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:21.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:23.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:23.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:23.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:24.732 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:25.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0319002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:25.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:25.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:25.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:26.222 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:26.222 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:27.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:27.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:27.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:29.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:29.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:29.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:29.770 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc30) allocated [ CSSD]2013-05-23 15:45:29.771 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:45:29.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc30 - 1,2,3 [ CSSD]2013-05-23 15:45:29.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013be0) proc(0x7f82ac00fc30) pid(23831) version 11:1:1:4 [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac00fc30), client(1/0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015d0 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001740/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:45:29.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:29.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015d0) [ CSSD]2013-05-23 15:45:29.795 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:45:29.795 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:29.795 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:45:29.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc30 [ CSSD]2013-05-23 15:45:29.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc30) con(0x7f82ac013be0) skgpid ospid 23831 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:31.036 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac014070) allocated [ CSSD]2013-05-23 15:45:31.037 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:45:31.037 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac014070 - 1,2,3 [ CSSD]2013-05-23 15:45:31.037 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0025c0) proc(0x7f82ac014070) pid(23755/23755) version 11:1:1:4 [ CSSD]2013-05-23 15:45:31.053 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac014070), client(1/0x7f82ac001720) [ CSSD]2013-05-23 15:45:31.053 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001720) [ CSSD]2013-05-23 15:45:31.053 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:45:31.053 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:45:31.225 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:31.225 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:31.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:31.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:31.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:33.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:33.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:33.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:34.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031a002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:34.476 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:45:34.476 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:45:34.476 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:45:34.476 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:34.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031b002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:34.483 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:45:34.483 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:45:34.754 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:35.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031c002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:35.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:35.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:35.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:36.228 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:36.228 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:37.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:37.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:37.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:39.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:39.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:39.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:41.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:41.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:41.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:41.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:41.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:43.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:43.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:43.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:44.811 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:45.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 15:45:45.042 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:45:45.043 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 15:45:45.043 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001e20) proc(0x7f82ac004f70) pid(24005) version 11:1:1:4 [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac004f70), client(1/0x7f82ac005680) [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005680 with con 0x7f82ac00ff20, requested num -1 [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0057f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:45:45.059 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:45.067 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:45:45.067 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:45:45.067 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005af0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:45:45.067 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:45:45.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031d002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:45.232 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:45.233 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:45:45.270 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 15:45:45.270 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac001e20) skgpid ospid 24005 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:45:45.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:45.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:45.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:47.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:47.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:47.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:49.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:49.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:49.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031e002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:49.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:45:49.737 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:45:49.737 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:45:49.737 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:45:49.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031f002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:49.744 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:45:49.744 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:45:49.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:50.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:50.236 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:51.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:51.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:51.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:53.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:53.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:53.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:54.832 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:45:55.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0320002c) incarnation(174631051) [ CSSD]2013-05-23 15:45:55.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:45:55.239 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:45:55.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:55.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:55.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:57.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:57.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:57.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:45:59.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:45:59.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:45:59.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:00.242 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:00.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:00.310 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 15:46:00.311 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:46:00.312 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 15:46:00.312 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001e20) proc(0x7f82ac004f70) pid(24146) version 11:1:1:4 [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac004f70), client(1/0x7f82ac005680) [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005680 with con 0x7f82ac00ff20, requested num -1 [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0057f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:46:00.318 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:00.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:00.324 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:46:00.324 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005af0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:00.324 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:46:00.527 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 15:46:00.527 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac001e20) skgpid ospid 24146 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:01.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:01.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:01.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:03.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:03.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:04.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:04.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:04.245 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:46:04.854 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:04.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0321002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:04.987 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:04.987 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:04.987 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:46:04.987 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:04.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0322002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:04.995 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:04.995 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:05.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0323002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:05.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:05.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:06.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:06.430 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 15:46:06.431 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:46:06.431 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 15:46:06.431 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001e20) proc(0x7f82ac004f70) pid(24243) version 11:1:1:4 [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac004f70), client(1/0x7f82ac005680) [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005680 with con 0x7f82ac00ff20, requested num -1 [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0057f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:46:06.437 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:06.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:06.443 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:46:06.443 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005af0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:06.443 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:46:06.646 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 15:46:06.646 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac001e20) skgpid ospid 24243 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:07.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:07.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:08.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:09.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:09.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:09.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:09.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:10.092 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:10.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0324002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:10.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:10.195 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:10.195 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:46:10.195 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:10.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0325002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:10.202 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:10.202 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:11.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:11.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:12.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:13.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:13.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:14.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:14.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:14.250 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:14.876 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:15.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0326002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:15.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:15.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:15.094 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:46:15.095 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:15.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0327002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:15.101 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:15.101 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:15.234 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:46:15.235 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:46:15.236 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:46:15.236 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:46:15.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0328002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:15.560 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 15:46:15.561 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:46:15.561 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 15:46:15.561 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac004f70) pid(24308) version 11:1:1:4 [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac004f70), client(1/0x7f82ac0055b0) [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0055b0) [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0055b0 with con 0x7f82ac00fe60, requested num -1 [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:46:15.567 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:15.574 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0055b0) [ CSSD]2013-05-23 15:46:15.574 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0055b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:46:15.574 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005a20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:15.574 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005a20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:46:15.776 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 15:46:15.776 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac007600) skgpid ospid 24308 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:15.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:15.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:16.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fba0) allocated [ CSSD]2013-05-23 15:46:16.086 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:46:16.086 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fba0 - 1,2,3 [ CSSD]2013-05-23 15:46:16.086 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac00fba0) pid(24357/24357) version 11:1:1:4 [ CSSD]2013-05-23 15:46:16.103 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac00fba0), client(1/0x7f82ac00fa20) [ CSSD]2013-05-23 15:46:16.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00fa20) [ CSSD]2013-05-23 15:46:16.103 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:46:16.103 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:46:16.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00fa20) [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00fa20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00fa20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fba0 [ CSSD]2013-05-23 15:46:16.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fba0) con(0x7f82ac007600) skgpid 24357 ospid 24357 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:17.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:17.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:18.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:19.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:19.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:19.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:19.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:20.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:20.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0329002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:20.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:20.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:20.236 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001890/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:46:20.236 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:20.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032a002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:20.243 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:20.243 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0015d0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:21.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:21.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:22.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2678eb0) [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2678eb0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 15:46:22.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x261f650) skgpid 18959 ospid 18959 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:23.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:23.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:24.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:24.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:24.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:24.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:25.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032b002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:25.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:25.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:26.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:27.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:27.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:28.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:29.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:29.257 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:29.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:29.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:30.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:30.811 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 15:46:30.812 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:46:30.813 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 15:46:30.813 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001e20) proc(0x7f82ac004f70) pid(24461) version 11:1:1:4 [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac004f70), client(1/0x7f82ac005680) [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005680 with con 0x7f82ac00ff20, requested num -1 [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0057f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:46:30.819 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:30.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005680) [ CSSD]2013-05-23 15:46:30.826 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:46:30.826 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005af0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:30.826 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:46:31.029 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 15:46:31.029 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac001e20) skgpid ospid 24461 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:31.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:31.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:32.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:33.259 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:33.259 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:46:33.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:33.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:34.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:34.776 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac014070), client(2/0x7f82ac001b80) [ CSSD]2013-05-23 15:46:34.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac001b80) [ CSSD]2013-05-23 15:46:34.776 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:46:34.776 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 15:46:34.922 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:35.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032c002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:35.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032d002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:35.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:35.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:35.496 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001cf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:46:35.496 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:35.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032e002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:35.504 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:35.504 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001a40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:35.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:35.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:36.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:37.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:37.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:38.262 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:38.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:38.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:40.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:40.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:40.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:42.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:42.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:42.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:43.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:43.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:44.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:44.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:44.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:44.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:45.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032f002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:46.061 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005280) allocated [ CSSD]2013-05-23 15:46:46.062 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:46:46.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005280 - 1,2,3 [ CSSD]2013-05-23 15:46:46.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac005280) pid(24640) version 11:1:1:4 [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac005280), client(1/0x7f82ac0051e0) [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0051e0) [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0051e0 with con 0x7f82ac005480, requested num -1 [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:46:46.068 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:46.075 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0051e0) [ CSSD]2013-05-23 15:46:46.075 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0051e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:46:46.075 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005d90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:46:46.075 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005d90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:46:46.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:46.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:46.278 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005280 [ CSSD]2013-05-23 15:46:46.278 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005280) con(0x7f82ac007600) skgpid ospid 24640 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:46:46.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:48.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:48.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:48.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:48.267 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:48.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:50.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:50.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:50.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:50.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0330002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:50.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:46:50.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:46:50.746 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001cf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:46:50.746 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:46:50.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0331002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:50.753 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:46:50.753 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001a40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:46:52.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:52.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:52.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:53.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:53.270 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:54.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:54.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:54.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:54.966 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:46:55.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0332002c) incarnation(174631051) [ CSSD]2013-05-23 15:46:56.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:56.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:56.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:46:58.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:46:58.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:46:58.273 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:46:58.273 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:46:58.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:00.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:00.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:00.337 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0052e0) allocated [ CSSD]2013-05-23 15:47:00.337 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:47:00.338 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0052e0 - 1,2,3 [ CSSD]2013-05-23 15:47:00.338 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0052e0) pid(24775/24775) version 11:1:1:4 [ CSSD]2013-05-23 15:47:00.354 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0052e0), client(1/0x7f82ac0057e0) [ CSSD]2013-05-23 15:47:00.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0057e0) [ CSSD]2013-05-23 15:47:00.355 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:47:00.355 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:47:00.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:01.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038820) allocated [ CSSD]2013-05-23 15:47:01.321 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:47:01.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038820 - 1,2,3 [ CSSD]2013-05-23 15:47:01.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038820) pid(24789) version 11:1:1:4 [ CSSD]2013-05-23 15:47:01.328 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038820), client(1/0x7f82ac063b50) [ CSSD]2013-05-23 15:47:01.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:01.328 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063b50 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:47:01.328 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:01.328 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063cc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:01.329 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:01.329 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:01.335 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:01.335 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063b50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:01.335 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:01.335 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:01.538 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038820 [ CSSD]2013-05-23 15:47:01.538 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038820) con(0x7f82ac036570) skgpid ospid 24789 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:02.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:02.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:02.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:03.275 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:03.275 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:04.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:04.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:04.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:04.989 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:05.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0333002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:06.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0334002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:06.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:06.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:06.006 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005950/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:47:06.006 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:06.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0335002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:06.013 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:06.013 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac005690) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:06.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:06.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:06.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:06.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038820) allocated [ CSSD]2013-05-23 15:47:06.692 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:47:06.692 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038820 - 1,2,3 [ CSSD]2013-05-23 15:47:06.692 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038820) pid(24872) version 11:1:1:4 [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038820), client(1/0x7f82ac063b50) [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063b50 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063cc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:06.698 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:06.705 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:06.705 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063b50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:06.705 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:06.705 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:06.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038820 [ CSSD]2013-05-23 15:47:06.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038820) con(0x7f82ac036570) skgpid ospid 24872 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:08.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:08.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:08.278 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:08.278 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:08.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:10.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:10.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:10.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0336002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:10.456 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:10.456 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:10.456 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005950/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:47:10.456 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:10.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0337002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:10.463 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:10.463 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac005690) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:10.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:10.850 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038880) allocated [ CSSD]2013-05-23 15:47:10.851 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:47:10.852 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038880 - 1,2,3 [ CSSD]2013-05-23 15:47:10.852 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038880) pid(24918) version 11:1:1:4 [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038880), client(1/0x7f82ac063b50) [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063b50 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063cc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:10.858 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:10.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063b50) [ CSSD]2013-05-23 15:47:10.865 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063b50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:10.865 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:10.866 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:11.068 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038880 [ CSSD]2013-05-23 15:47:11.068 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038880) con(0x7f82ac036570) skgpid ospid 24918 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:11.881 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0364b0) allocated [ CSSD]2013-05-23 15:47:11.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:47:11.882 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0364b0 - 1,2,3 [ CSSD]2013-05-23 15:47:11.882 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac063850) proc(0x7f82ac0364b0) pid(24957) version 11:1:1:4 [ CSSD]2013-05-23 15:47:12.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:12.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:12.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:13.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:13.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:13.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:47:13.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:47:13.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:47:13.559 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:47:13.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0338002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:13.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:13.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:13.635 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac064150/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:47:13.635 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:47:13.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0339002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:13.642 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:13.642 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac065d20) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:14.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:14.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:14.526 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0364b0 [ CSSD]2013-05-23 15:47:14.526 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0364b0) con(0x7f82ac063850) skgpid ospid 24957 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:14.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:15.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:15.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033a002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:16.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:16.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:16.574 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038760) allocated [ CSSD]2013-05-23 15:47:16.575 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:47:16.575 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038760 - 1,2,3 [ CSSD]2013-05-23 15:47:16.575 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0364b0) proc(0x7f82ac038760) pid(25290) version 11:1:1:4 [ CSSD]2013-05-23 15:47:16.581 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038760), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:47:16.581 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:47:16.581 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063a90 with con 0x7f82ac038520, requested num -1 [ CSSD]2013-05-23 15:47:16.581 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:16.581 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:16.582 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:16.582 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:16.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:47:16.588 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:16.588 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac038b20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:16.588 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac038b20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:16.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:16.791 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038760 [ CSSD]2013-05-23 15:47:16.791 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038760) con(0x7f82ac0364b0) skgpid ospid 25290 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:18.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:18.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:18.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:18.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:18.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:20.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:20.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:20.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:21.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033b002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:21.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:21.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:21.267 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a60/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:47:21.267 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:21.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033c002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:21.274 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:21.274 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0055a0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:22.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:22.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:22.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:23.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:23.286 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:24.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:24.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:24.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:25.036 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:25.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033d002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:26.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:26.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:26.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:27.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:27.288 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:47:28.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:28.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:28.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:30.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:30.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:30.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0057e0) [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0057e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0057e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0052e0 [ CSSD]2013-05-23 15:47:31.578 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0052e0) con(0x7f82ac007600) skgpid 24775 ospid 24775 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:31.825 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0051b0) allocated [ CSSD]2013-05-23 15:47:31.825 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:47:31.826 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0051b0 - 1,2,3 [ CSSD]2013-05-23 15:47:31.826 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0051b0) pid(25462) version 11:1:1:4 [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac0051b0), client(1/0x7f82ac00fba0) [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00fba0) [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00fba0 with con 0x7f82ac004f70, requested num -1 [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0364b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:31.843 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:31.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00fba0) [ CSSD]2013-05-23 15:47:31.850 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00fba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:31.850 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005480) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:31.850 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005480) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:32.053 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0051b0 [ CSSD]2013-05-23 15:47:32.053 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0051b0) con(0x7f82ac007600) skgpid ospid 25462 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:32.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:32.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:32.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:32.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:32.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:34.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:34.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:34.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:35.059 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:35.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033e002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:36.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033f002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:36.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:36.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:36.527 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001cf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:47:36.528 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:36.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0340002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:36.534 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:36.534 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001a40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:36.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:36.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:36.929 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:37.293 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:37.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:38.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:38.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:38.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:40.366 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005390) allocated [ CSSD]2013-05-23 15:47:40.366 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:47:40.367 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005390 - 1,2,3 [ CSSD]2013-05-23 15:47:40.367 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001ea0) proc(0x7f82ac005390) pid(25575) version 11:1:1:4 [ CSSD]2013-05-23 15:47:40.372 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac005390), client(1/0x7f82ac005a20) [ CSSD]2013-05-23 15:47:40.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005a20) [ CSSD]2013-05-23 15:47:40.372 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005a20 with con 0x7f82ac0052d0, requested num -1 [ CSSD]2013-05-23 15:47:40.372 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:40.372 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005b90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:40.373 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:40.373 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:40.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005a20) [ CSSD]2013-05-23 15:47:40.379 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:40.379 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0364b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:40.379 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0364b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:40.582 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005390 [ CSSD]2013-05-23 15:47:40.582 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005390) con(0x7f82ac001ea0) skgpid ospid 25575 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:40.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:40.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:40.946 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:42.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:42.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:42.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:42.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:42.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:44.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:44.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:45.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:45.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:45.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0341002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:46.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:46.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:47.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:47.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005390) allocated [ CSSD]2013-05-23 15:47:47.085 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:47:47.086 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005390 - 1,2,3 [ CSSD]2013-05-23 15:47:47.086 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001ea0) proc(0x7f82ac005390) pid(25623) version 11:1:1:4 [ CSSD]2013-05-23 15:47:47.092 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac005390), client(1/0x7f82ac005a20) [ CSSD]2013-05-23 15:47:47.092 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac005a20) [ CSSD]2013-05-23 15:47:47.092 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac005a20 with con 0x7f82ac0052d0, requested num -1 [ CSSD]2013-05-23 15:47:47.092 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:47.092 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005b90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:47:47.093 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:47:47.093 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:47.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac005a20) [ CSSD]2013-05-23 15:47:47.100 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac005a20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:47:47.100 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0364b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:47:47.100 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0364b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:47:47.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:47.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:47.302 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005390 [ CSSD]2013-05-23 15:47:47.302 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005390) con(0x7f82ac001ea0) skgpid ospid 25623 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:47:48.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:48.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:49.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:50.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:50.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:51.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:51.301 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:51.301 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:47:51.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0342002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:51.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:47:51.787 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:47:51.787 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac001cf0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:47:51.787 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:47:51.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0343002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:51.795 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:47:51.795 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001a40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:47:52.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:52.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:53.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:54.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:54.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:55.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:55.103 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:47:55.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0344002c) incarnation(174631051) [ CSSD]2013-05-23 15:47:56.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:47:56.304 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:47:56.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:56.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:57.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:47:58.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:47:58.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:47:59.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:00.405 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005390) allocated [ CSSD]2013-05-23 15:48:00.406 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:00.406 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005390 - 1,2,3 [ CSSD]2013-05-23 15:48:00.406 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001ea0) proc(0x7f82ac005390) pid(25768/25768) version 11:1:1:4 [ CSSD]2013-05-23 15:48:00.412 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82ac005390), client(1/0x7f82ac005920) [ CSSD]2013-05-23 15:48:00.412 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac005920) [ CSSD]2013-05-23 15:48:00.412 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:48:00.412 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:48:00.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:00.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:01.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:01.306 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:01.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:02.337 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:02.338 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:48:02.339 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:02.339 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(25789) version 11:1:1:4 [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038840), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063a90 with con 0x7f82ac038600, requested num -1 [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:02.345 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:02.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:02.352 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:48:02.352 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:02.352 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:02.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:02.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid ospid 25789 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:02.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:02.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:03.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:04.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:04.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:05.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:05.125 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:05.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0345002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:06.309 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:06.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:06.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:06.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:06.948 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038790) allocated [ CSSD]2013-05-23 15:48:06.948 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:06.949 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038790 - 1,2,3 [ CSSD]2013-05-23 15:48:06.949 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac038790) pid(25862) version 11:1:1:4 [ CSSD]2013-05-23 15:48:06.955 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038790), client(1/0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:06.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:06.955 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0386f0 with con 0x7f82ac0389b0, requested num -1 [ CSSD]2013-05-23 15:48:06.955 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:06.955 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:48:06.956 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:06.956 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:06.962 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:06.962 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0386f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:48:06.962 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063e60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:06.963 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:07.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0346002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:07.047 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:48:07.047 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:48:07.047 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac063790/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:48:07.047 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:07.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0347002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:07.053 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:48:07.054 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac038640) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:48:07.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:07.165 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038790 [ CSSD]2013-05-23 15:48:07.165 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038790) con(0x7f82ac007600) skgpid ospid 25862 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:08.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:08.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:09.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:10.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0348002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:10.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:48:10.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:48:10.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:48:10.716 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:10.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0349002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:10.723 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:48:10.724 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:48:10.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:10.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:11.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:11.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:11.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:12.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:12.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:13.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:14.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:14.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:15.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:15.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:15.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034a002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:16.314 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:16.314 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:16.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:16.978 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:17.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:17.588 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:17.588 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:48:17.589 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:17.589 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(25940) version 11:1:1:4 [ CSSD]2013-05-23 15:48:17.594 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038840), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:48:17.594 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:17.594 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063a90 with con 0x7f82ac038600, requested num -1 [ CSSD]2013-05-23 15:48:17.594 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:17.594 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:48:17.595 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:17.595 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:17.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:17.601 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:48:17.601 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:17.601 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:17.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:17.804 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid ospid 25940 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:19.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:19.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:19.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:20.316 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:20.316 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:48:21.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:21.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:21.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:22.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034b002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:22.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:48:22.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:48:22.296 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:48:22.297 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:22.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034c002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:22.303 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:48:22.303 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:48:23.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:23.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:23.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:25.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:25.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:25.174 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:25.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:25.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:25.319 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:25.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034d002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:27.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:27.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:27.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:28.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:28.239 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:28.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:28.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(26052/26052) version 11:1:1:4 [ CSSD]2013-05-23 15:48:28.245 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038840), client(1/0x7f82ac038790) [ CSSD]2013-05-23 15:48:28.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac038790) [ CSSD]2013-05-23 15:48:28.245 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:48:28.245 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:48:28.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac038790) [ CSSD]2013-05-23 15:48:28.286 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac038790), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:48:28.286 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac038790), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:48:28.286 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:48:28.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:28.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid 26052 ospid 26052 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:28.463 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038760) allocated [ CSSD]2013-05-23 15:48:28.464 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:28.464 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038760 - 1,2,3 [ CSSD]2013-05-23 15:48:28.464 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0364b0) proc(0x7f82ac038760) pid(26055/26055) version 11:1:1:4 [ CSSD]2013-05-23 15:48:28.480 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038760), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:48:28.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:28.480 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:48:28.480 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac063a90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac063a90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038760 [ CSSD]2013-05-23 15:48:28.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038760) con(0x7f82ac0364b0) skgpid 26055 ospid 26055 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:29.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:29.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:29.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:30.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:30.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:31.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:31.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:31.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:32.836 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:32.837 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:48:32.837 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:32.837 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(26096) version 11:1:1:4 [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038840), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063a90 with con 0x7f82ac038600, requested num -1 [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:32.843 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:32.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:32.849 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:48:32.849 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:32.850 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:33.052 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:33.052 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid ospid 26096 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:33.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:33.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:33.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:35.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:35.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:35.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:35.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:35.324 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:35.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:35.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034e002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:36.244 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038790) allocated [ CSSD]2013-05-23 15:48:36.245 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:36.245 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038790 - 1,2,3 [ CSSD]2013-05-23 15:48:36.245 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac038790) pid(26162) version 11:1:1:4 [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038790), client(1/0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac0386f0 with con 0x7f82ac0389b0, requested num -1 [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063b60/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:36.262 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:36.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0386f0) [ CSSD]2013-05-23 15:48:36.269 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0386f0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:48:36.269 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063e60) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:48:36.269 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac063e60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:36.381 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07c140) allocated [ CSSD]2013-05-23 15:48:36.381 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:36.382 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07c140 - 1,2,3 [ CSSD]2013-05-23 15:48:36.382 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac038b60) proc(0x7f82ac07c140) pid(26167) version 11:1:1:4 [ CSSD]2013-05-23 15:48:36.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:48:36.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:48:36.402 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:48:36.403 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07c140 [ CSSD]2013-05-23 15:48:36.403 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07c140) con(0x7f82ac038b60) skgpid ospid 26167 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:36.471 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038790 [ CSSD]2013-05-23 15:48:36.471 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038790) con(0x7f82ac007600) skgpid ospid 26162 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:37.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:37.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:37.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:37.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034f002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:37.545 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:48:37.545 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:48:37.545 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:48:37.546 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:37.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0350002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:37.553 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:48:37.553 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:48:39.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:39.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:39.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:40.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:40.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:40.694 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:40.695 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:48:40.696 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:40.696 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(26219) version 11:1:1:4 [ CSSD]2013-05-23 15:48:41.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:41.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:41.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:41.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid ospid 26219 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:41.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:43.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:43.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:43.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:44.329 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:44.329 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:48:45.219 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:45.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:45.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:45.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:45.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0351002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:47.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:47.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:47.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:48.083 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038840) allocated [ CSSD]2013-05-23 15:48:48.084 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:48:48.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038840 - 1,2,3 [ CSSD]2013-05-23 15:48:48.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038840) pid(26440) version 11:1:1:4 [ CSSD]2013-05-23 15:48:48.090 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac038840), client(1/0x7f82ac063a90) [ CSSD]2013-05-23 15:48:48.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:48.090 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac063a90 with con 0x7f82ac038600, requested num -1 [ CSSD]2013-05-23 15:48:48.090 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:48.090 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:48:48.091 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:48:48.091 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:48.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac063a90) [ CSSD]2013-05-23 15:48:48.097 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac063a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:48:48.097 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:48:48.097 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:48:48.300 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038840 [ CSSD]2013-05-23 15:48:48.300 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038840) con(0x7f82ac036590) skgpid ospid 26440 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:49.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:49.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:49.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:49.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:49.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:51.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:51.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:51.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:52.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0352002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:52.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:48:52.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:48:52.796 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:48:52.796 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:48:52.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0353002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:52.803 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:48:52.803 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2698d10) [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2698d10), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2698d10), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmDeadProc: proc 0x26907f0 [ CSSD]2013-05-23 15:48:52.993 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26907f0) con(0x26916a0) skgpid 20719 ospid 20719 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1b0 [ CSSD]2013-05-23 15:48:52.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1b0) con(0x269a460) skgpid 20721 ospid 20721 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:48:53.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:53.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:53.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:54.334 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:54.334 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:55.241 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:48:55.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:55.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:55.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:55.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0354002c) incarnation(174631051) [ CSSD]2013-05-23 15:48:57.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:57.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:57.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:48:59.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:48:59.337 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:48:59.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:48:59.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:48:59.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:01.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:01.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:01.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:03.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0388b0) allocated [ CSSD]2013-05-23 15:49:03.335 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:49:03.336 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0388b0 - 1,2,3 [ CSSD]2013-05-23 15:49:03.336 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac0388b0) pid(26585) version 11:1:1:4 [ CSSD]2013-05-23 15:49:03.341 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0388b0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 15:49:03.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:03.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0387a0, requested num -1 [ CSSD]2013-05-23 15:49:03.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:03.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:49:03.342 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:03.342 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:03.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:03.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:49:03.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:03.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:03.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:03.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:03.551 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0388b0 [ CSSD]2013-05-23 15:49:03.551 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0388b0) con(0x7f82ac036590) skgpid ospid 26585 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:03.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:04.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:04.339 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:05.263 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:05.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:05.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:05.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:05.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0355002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:07.206 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038800) allocated [ CSSD]2013-05-23 15:49:07.207 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:49:07.208 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038800 - 1,2,3 [ CSSD]2013-05-23 15:49:07.208 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac038800) pid(26669) version 11:1:1:4 [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038800), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac038570, requested num -1 [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:07.214 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:07.220 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:07.220 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:49:07.220 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:07.220 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:07.424 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038800 [ CSSD]2013-05-23 15:49:07.424 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038800) con(0x7f82ac007600) skgpid ospid 26669 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:07.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:07.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:07.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:08.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0356002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:08.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:49:08.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:49:08.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:49:08.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:08.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0357002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:08.063 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:49:08.063 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:49:09.342 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:09.342 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:09.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:09.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:09.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:10.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0358002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:10.975 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:49:10.975 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:49:10.975 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:49:10.976 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:10.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0359002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:10.982 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:49:10.982 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:49:11.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:11.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:11.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:13.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:13.344 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:49:13.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:13.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:13.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:15.285 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:15.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:15.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:15.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:15.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035a002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:17.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:17.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:17.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:18.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:18.346 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:18.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038830) allocated [ CSSD]2013-05-23 15:49:18.587 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:49:18.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038830 - 1,2,3 [ CSSD]2013-05-23 15:49:18.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac038830) pid(26747) version 11:1:1:4 [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038830), client(1/0x7f82ac038780) [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038780) [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038780 with con 0x7f82ac038600, requested num -1 [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:18.604 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:18.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038780) [ CSSD]2013-05-23 15:49:18.610 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038780), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:49:18.610 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:18.610 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:18.813 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038830 [ CSSD]2013-05-23 15:49:18.813 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038830) con(0x7f82ac036590) skgpid ospid 26747 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:19.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:19.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:19.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:21.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:21.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:21.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:23.066 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0388b0) allocated [ CSSD]2013-05-23 15:49:23.066 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:49:23.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0388b0 - 1,2,3 [ CSSD]2013-05-23 15:49:23.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac0388b0) pid(26821) version 11:1:1:4 [ CSSD]2013-05-23 15:49:23.184 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac07bef0) allocated [ CSSD]2013-05-23 15:49:23.185 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:49:23.185 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac07bef0 - 1,2,3 [ CSSD]2013-05-23 15:49:23.185 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac063c50) proc(0x7f82ac07bef0) pid(26831) version 11:1:1:4 [ CSSD]2013-05-23 15:49:23.202 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:49:23.204 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:49:23.207 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac07bef0 [ CSSD]2013-05-23 15:49:23.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac07bef0) con(0x7f82ac063c50) skgpid ospid 26831 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5338/0x7f82ac0387a0) [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5338 (0x7f82ac0387a0) [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac0387a0 with con 0x7f82ac038ab0, requested num -1 [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac07c380/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:23.287 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:49:23.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5338 (0x7f82ac0387a0) [ CSSD]2013-05-23 15:49:23.293 [1199044928] >TRACE: clssgmExitGrock: client 5338 (0x7f82ac0387a0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:49:23.293 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac07c680) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:49:23.293 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac07c680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:23.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0388b0 [ CSSD]2013-05-23 15:49:23.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0388b0) con(0x7f82ac036590) skgpid ospid 26821 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:23.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035b002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:23.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:49:23.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:49:23.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:49:23.303 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:23.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035c002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:23.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:49:23.310 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:49:23.349 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:23.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:23.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:23.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:23.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:25.308 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:25.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:25.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:25.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035d002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:25.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:27.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:27.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:27.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:28.352 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:28.352 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:29.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:29.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:29.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:31.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:31.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:31.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:33.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:33.355 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:33.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:33.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:33.847 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038780) allocated [ CSSD]2013-05-23 15:49:33.847 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:49:33.848 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038780 - 1,2,3 [ CSSD]2013-05-23 15:49:33.848 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac038780) pid(26936) version 11:1:1:4 [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038780), client(1/0x7f82ac0386e0) [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0386e0) [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0386e0 with con 0x7f82ac038b20, requested num -1 [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063b50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:33.854 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:33.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0386e0) [ CSSD]2013-05-23 15:49:33.860 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0386e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:49:33.860 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063e50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:33.861 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:33.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:34.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038780 [ CSSD]2013-05-23 15:49:34.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038780) con(0x7f82ac007600) skgpid ospid 26936 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:35.336 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:35.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:35.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:35.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035e002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:36.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:37.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:37.357 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:49:37.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:37.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:38.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:38.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035f002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:38.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:49:38.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:49:38.552 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:49:38.553 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:38.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0360002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:38.559 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:49:38.559 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:49:39.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:39.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:40.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:41.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:41.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:42.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:42.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:42.359 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:43.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:43.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:44.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:45.431 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:45.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0361002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:45.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:45.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:46.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:47.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:47.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:47.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:47.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:48.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:49.095 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0388b0) allocated [ CSSD]2013-05-23 15:49:49.095 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:49:49.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0388b0 - 1,2,3 [ CSSD]2013-05-23 15:49:49.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac0388b0) pid(27088) version 11:1:1:4 [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0388b0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0387a0, requested num -1 [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:49:49.101 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:49.107 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:49:49.107 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:49:49.107 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:49:49.107 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:49:49.310 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0388b0 [ CSSD]2013-05-23 15:49:49.310 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0388b0) con(0x7f82ac036590) skgpid ospid 27088 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:49:49.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:49.987 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:50.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:51.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:51.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:52.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:52.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:52.365 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:53.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0362002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:53.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:49:53.813 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:49:53.813 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:49:53.813 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:49:53.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0363002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:53.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:49:53.821 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:49:54.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:54.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:54.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:55.453 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:49:55.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0364002c) incarnation(174631051) [ CSSD]2013-05-23 15:49:56.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:56.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:56.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:49:57.367 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:49:57.367 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:49:58.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:49:58.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:49:58.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:00.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:00.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:00.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:02.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:02.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:02.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:02.370 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:02.370 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:04.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:04.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:04.344 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038780) allocated [ CSSD]2013-05-23 15:50:04.345 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:50:04.346 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038780 - 1,2,3 [ CSSD]2013-05-23 15:50:04.346 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac038780) pid(27430) version 11:1:1:4 [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038780), client(1/0x7f82ac0386e0) [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0386e0) [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0386e0 with con 0x7f82ac038b20, requested num -1 [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063b50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:50:04.351 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:04.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0386e0) [ CSSD]2013-05-23 15:50:04.358 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0386e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:50:04.358 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063e50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:04.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063e50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:50:04.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:04.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038780 [ CSSD]2013-05-23 15:50:04.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038780) con(0x7f82ac007600) skgpid ospid 27430 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:04.626 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac065a60) allocated [ CSSD]2013-05-23 15:50:04.627 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:50:04.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac065a60 - 1,2,3 [ CSSD]2013-05-23 15:50:04.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac065a60) pid(27472/27472) version 11:1:1:4 [ CSSD]2013-05-23 15:50:04.643 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac065a60), client(1/0x7f82ac0659c0) [ CSSD]2013-05-23 15:50:04.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0659c0) [ CSSD]2013-05-23 15:50:04.643 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:50:04.643 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:50:04.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0659c0) [ CSSD]2013-05-23 15:50:04.917 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0659c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:50:04.917 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0659c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:50:04.917 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:50:04.918 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac065a60 [ CSSD]2013-05-23 15:50:04.918 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac065a60) con(0x7f82ac007600) skgpid 27472 ospid 27472 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:05.475 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:05.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0365002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:06.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:06.079 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:06.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:06.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:06.372 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:50:07.463 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0388b0) allocated [ CSSD]2013-05-23 15:50:07.464 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:50:07.464 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0388b0 - 1,2,3 [ CSSD]2013-05-23 15:50:07.464 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036590) proc(0x7f82ac0388b0) pid(27494) version 11:1:1:4 [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0388b0), client(1/0x7f82ac038b80) [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038b80 with con 0x7f82ac0387a0, requested num -1 [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:50:07.481 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:07.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038b80) [ CSSD]2013-05-23 15:50:07.488 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038b80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:50:07.488 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:07.488 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:50:07.690 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0388b0 [ CSSD]2013-05-23 15:50:07.690 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0388b0) con(0x7f82ac036590) skgpid ospid 27494 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:08.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:08.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:08.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:09.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0366002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:09.064 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:09.064 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:09.064 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:09.065 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:09.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0367002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:09.071 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:09.071 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:10.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:10.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:10.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:11.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0368002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:11.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:11.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:11.244 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:11.244 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:11.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0369002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:11.251 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:11.251 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0056e0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:11.375 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:11.375 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:12.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:12.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:12.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:14.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:14.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:14.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:15.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:15.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036a002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:16.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:16.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:16.377 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:16.377 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:16.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:18.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:18.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:18.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:18.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac003a30) [ CSSD]2013-05-23 15:50:18.671 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac003a30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:50:18.671 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac003a30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:50:18.671 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:50:18.672 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003440 [ CSSD]2013-05-23 15:50:18.672 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003440) con(0x7f82ac006550) skgpid 21962 ospid 21962 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:19.593 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006d30) allocated [ CSSD]2013-05-23 15:50:19.593 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:50:19.594 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006d30 - 1,2,3 [ CSSD]2013-05-23 15:50:19.594 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0056e0) proc(0x7f82ac006d30) pid(27582) version 11:1:1:4 [ CSSD]2013-05-23 15:50:19.599 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac006d30), client(1/0x7f82ac0035f0) [ CSSD]2013-05-23 15:50:19.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0035f0) [ CSSD]2013-05-23 15:50:19.599 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0035f0 with con 0x7f82ac003270, requested num -1 [ CSSD]2013-05-23 15:50:19.599 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:19.599 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:50:19.600 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:50:19.600 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:19.606 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0035f0) [ CSSD]2013-05-23 15:50:19.606 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0035f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:50:19.606 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0364b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:19.607 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0364b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:50:19.809 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006d30 [ CSSD]2013-05-23 15:50:19.809 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006d30) con(0x7f82ac0056e0) skgpid ospid 27582 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:20.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:20.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:20.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:21.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:21.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:22.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:22.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:22.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:24.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:24.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:24.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036b002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:24.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:24.313 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:24.313 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac005a90/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:24.313 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:24.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036c002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:24.320 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:24.320 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac005d90) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:24.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:25.518 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:26.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036d002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:26.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:26.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:26.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:26.383 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:26.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:28.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:28.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:28.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:30.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:30.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:30.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:30.385 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:50:30.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:32.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:32.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:32.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:33.965 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006d30) allocated [ CSSD]2013-05-23 15:50:33.966 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:50:33.967 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006d30 - 1,2,3 [ CSSD]2013-05-23 15:50:33.967 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0056e0) proc(0x7f82ac006d30) pid(27574/27574) version 11:1:1:4 [ CSSD]2013-05-23 15:50:33.983 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac006d30), client(1/0x7f82ac003280) [ CSSD]2013-05-23 15:50:33.983 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac003280) [ CSSD]2013-05-23 15:50:33.983 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:50:33.983 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:50:34.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:34.316 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:34.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:34.842 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038870) allocated [ CSSD]2013-05-23 15:50:34.842 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:50:34.843 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038870 - 1,2,3 [ CSSD]2013-05-23 15:50:34.843 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038870) pid(27733) version 11:1:1:4 [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038870), client(1/0x7f82ac038af0) [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038af0) [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038af0 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063ce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:50:34.849 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:34.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038af0) [ CSSD]2013-05-23 15:50:34.856 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:50:34.856 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:34.856 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:50:35.059 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038870 [ CSSD]2013-05-23 15:50:35.059 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038870) con(0x7f82ac036570) skgpid ospid 27733 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:35.387 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:35.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:35.540 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:36.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036e002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:36.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:36.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:36.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:38.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:38.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:38.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:39.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036f002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:39.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:39.573 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:39.573 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:39.573 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:39.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0370002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:39.580 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:39.580 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:40.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:40.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:40.390 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:40.390 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:40.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:42.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:42.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:42.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:44.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:44.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:44.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:45.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:45.393 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:45.561 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:46.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0371002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:46.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:46.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:46.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:48.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:48.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:48.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:50.091 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038890) allocated [ CSSD]2013-05-23 15:50:50.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:50:50.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038890 - 1,2,3 [ CSSD]2013-05-23 15:50:50.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038890) pid(27891) version 11:1:1:4 [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038890), client(1/0x7f82ac038af0) [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038af0) [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038af0 with con 0x7f82ac038780, requested num -1 [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063ce0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:50:50.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:50.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038af0) [ CSSD]2013-05-23 15:50:50.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038af0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:50:50.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063fe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:50:50.106 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063fe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:50:50.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038890 [ CSSD]2013-05-23 15:50:50.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038890) con(0x7f82ac036570) skgpid ospid 27891 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:50:50.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:50.395 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:50.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:50.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:50.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:52.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:52.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:52.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:54.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:54.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:54.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0372002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:54.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:54.832 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:54.832 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:54.832 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:54.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0373002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:54.839 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:54.839 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:54.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:55.398 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:55.398 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:50:55.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:50:55.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0374002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:55.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:50:55.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:50:55.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:50:55.611 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:50:55.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0375002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:55.617 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:50:55.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:50:56.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0376002c) incarnation(174631051) [ CSSD]2013-05-23 15:50:56.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:56.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:56.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:58.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:50:58.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:50:58.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:50:59.400 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:50:59.400 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:51:00.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:00.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:00.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:02.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:02.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:02.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:04.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:04.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:04.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:04.597 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:04.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:05.342 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038810) allocated [ CSSD]2013-05-23 15:51:05.343 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:51:05.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038810 - 1,2,3 [ CSSD]2013-05-23 15:51:05.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038810) pid(28034) version 11:1:1:4 [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038810), client(1/0x7f82ac038a90) [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038a90 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:51:05.351 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:05.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:05.357 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:51:05.357 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:05.357 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:51:05.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038810 [ CSSD]2013-05-23 15:51:05.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038810) con(0x7f82ac036570) skgpid ospid 28034 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:05.629 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:06.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0377002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:06.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:06.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:06.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:07.734 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038810) allocated [ CSSD]2013-05-23 15:51:07.735 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:51:07.735 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038810 - 1,2,3 [ CSSD]2013-05-23 15:51:07.735 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038810) pid(28089) version 11:1:1:4 [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038810), client(1/0x7f82ac038a90) [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038a90 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:51:07.742 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:07.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:07.748 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:51:07.748 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:07.748 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:51:07.951 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038810 [ CSSD]2013-05-23 15:51:07.951 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038810) con(0x7f82ac036570) skgpid ospid 28089 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:08.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:08.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:08.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:09.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:09.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:10.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0378002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:10.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:10.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:10.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:51:10.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:10.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0379002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:10.086 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:10.087 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:10.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:10.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:11.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:11.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037a002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:11.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:11.499 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:11.499 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:51:11.499 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:11.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037b002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:11.506 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:11.506 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:12.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:12.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:13.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:14.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:14.408 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:14.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:14.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:15.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:15.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037c002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:15.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:15.399 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:15.399 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac012960/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:51:15.399 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:15.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037d002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:15.406 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:15.406 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac012c60) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:15.546 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:51:15.546 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:51:15.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:51:15.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:51:15.553 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0387e0) allocated [ CSSD]2013-05-23 15:51:15.553 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:51:15.554 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0387e0 - 1,2,3 [ CSSD]2013-05-23 15:51:15.554 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007600) proc(0x7f82ac0387e0) pid(28148/28148) version 11:1:1:4 [ CSSD]2013-05-23 15:51:15.569 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac0387e0), client(1/0x7f82ac0386d0) [ CSSD]2013-05-23 15:51:15.569 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac0386d0) [ CSSD]2013-05-23 15:51:15.569 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:51:15.569 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac0386d0) [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac0386d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac0386d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0387e0 [ CSSD]2013-05-23 15:51:15.627 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0387e0) con(0x7f82ac007600) skgpid 28148 ospid 28148 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:15.650 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:16.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037e002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:16.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:16.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:17.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:18.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:18.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:19.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:19.410 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:19.410 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:20.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac038810) allocated [ CSSD]2013-05-23 15:51:20.594 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:51:20.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac038810 - 1,2,3 [ CSSD]2013-05-23 15:51:20.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac036570) proc(0x7f82ac038810) pid(28183) version 11:1:1:4 [ CSSD]2013-05-23 15:51:20.600 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82ac038810), client(1/0x7f82ac038a90) [ CSSD]2013-05-23 15:51:20.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:20.600 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac038a90 with con 0x7f82ac038760, requested num -1 [ CSSD]2013-05-23 15:51:20.600 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:20.600 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac063c10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:51:20.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:51:20.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:20.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac038a90) [ CSSD]2013-05-23 15:51:20.607 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac038a90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:51:20.607 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac063f10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:20.607 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac063f10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:51:20.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:20.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:20.809 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac038810 [ CSSD]2013-05-23 15:51:20.809 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac038810) con(0x7f82ac036570) skgpid ospid 28183 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:21.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:22.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:22.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:23.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac0134e0) [ CSSD]2013-05-23 15:51:23.042 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac0134e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:51:23.042 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac0134e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:51:23.042 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac019720) [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac019720), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac019720), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0772b0 [ CSSD]2013-05-23 15:51:23.050 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0772b0) con(0x7f82ac018e90) skgpid 22800 ospid 22800 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:23.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:23.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:23.412 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:51:24.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:24.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:25.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:25.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037f002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:25.341 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:25.341 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:25.341 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:51:25.341 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:25.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0380002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:25.348 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:25.348 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:25.672 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:26.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0381002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:26.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:26.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:27.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:28.415 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:28.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:28.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:28.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:29.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:30.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:30.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:31.163 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:32.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:32.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:33.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:33.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:33.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:34.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:34.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:35.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:35.707 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:35.852 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac077370) allocated [ CSSD]2013-05-23 15:51:35.853 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:51:35.853 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac077370 - 1,2,3 [ CSSD]2013-05-23 15:51:35.853 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0131e0) proc(0x7f82ac077370) pid(28343) version 11:1:1:4 [ CSSD]2013-05-23 15:51:35.858 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac077370), client(1/0x7f82ac0135b0) [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0135b0) [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0135b0 with con 0x7f82ac019710, requested num -1 [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:51:35.859 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:35.865 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0135b0) [ CSSD]2013-05-23 15:51:35.865 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0135b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:51:35.865 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:35.865 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:51:36.067 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac077370 [ CSSD]2013-05-23 15:51:36.068 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac077370) con(0x7f82ac0131e0) skgpid ospid 28343 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:36.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0382002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:36.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:36.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:37.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:38.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:38.420 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:38.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:38.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:39.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:40.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0383002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:40.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:40.601 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:40.601 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:51:40.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:40.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0384002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:40.608 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:40.608 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:40.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:40.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:41.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:42.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:42.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:43.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:43.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:43.423 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:44.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:44.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:45.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:45.737 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:46.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0385002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:46.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:46.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:47.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:48.426 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:48.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:48.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:48.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:49.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:51.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:51.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:51.102 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01c840) allocated [ CSSD]2013-05-23 15:51:51.102 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:51:51.103 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01c840 - 1,2,3 [ CSSD]2013-05-23 15:51:51.103 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac005fe0) proc(0x7f82ac01c840) pid(28511) version 11:1:1:4 [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac01c840), client(1/0x7f82ac0192d0) [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0192d0 with con 0x7f82ac018dd0, requested num -1 [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:51:51.109 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:51.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0192d0) [ CSSD]2013-05-23 15:51:51.115 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0192d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:51:51.115 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0190d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:51:51.115 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0190d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:51:51.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:51.318 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01c840 [ CSSD]2013-05-23 15:51:51.318 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01c840) con(0x7f82ac005fe0) skgpid ospid 28511 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:51:52.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:52.428 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:51:53.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:53.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:53.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:55.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:55.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:55.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:55.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:51:55.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0386002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:55.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:51:55.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:51:55.850 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:51:55.850 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:51:55.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0387002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:55.857 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:51:55.857 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:51:56.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0388002c) incarnation(174631051) [ CSSD]2013-05-23 15:51:57.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:57.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:57.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:51:57.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:51:57.430 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:51:59.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:51:59.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:51:59.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:01.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:01.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:01.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:02.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:02.433 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:03.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:03.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:03.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:05.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:05.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:05.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:05.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0389002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:05.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:05.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:05.640 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:05.640 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:05.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038a002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:05.646 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:05.647 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:05.799 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:06.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038b002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:06.351 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac01c840) allocated [ CSSD]2013-05-23 15:52:06.352 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:52:06.352 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac01c840 - 1,2,3 [ CSSD]2013-05-23 15:52:06.352 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013120) proc(0x7f82ac01c840) pid(28678) version 11:1:1:4 [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac01c840), client(1/0x7f82ac0135b0) [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0135b0) [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0135b0 with con 0x7f82ac019710, requested num -1 [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:52:06.358 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:06.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0135b0) [ CSSD]2013-05-23 15:52:06.364 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0135b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:52:06.364 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac0190d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:06.364 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac0190d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:52:06.567 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac01c840 [ CSSD]2013-05-23 15:52:06.567 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac01c840) con(0x7f82ac013120) skgpid ospid 28678 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:07.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:07.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:07.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:07.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:07.436 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:07.991 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac077370) allocated [ CSSD]2013-05-23 15:52:07.992 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:52:07.992 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac077370 - 1,2,3 [ CSSD]2013-05-23 15:52:07.992 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0131e0) proc(0x7f82ac077370) pid(28725) version 11:1:1:4 [ CSSD]2013-05-23 15:52:07.998 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac077370), client(1/0x7f82ac0076d0) [ CSSD]2013-05-23 15:52:07.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:52:07.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0076d0 with con 0x7f82ac019710, requested num -1 [ CSSD]2013-05-23 15:52:07.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:07.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac012960/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:52:07.999 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:52:07.999 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:08.005 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0076d0) [ CSSD]2013-05-23 15:52:08.005 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0076d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:52:08.005 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac019590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:08.005 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac019590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:52:08.207 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac077370 [ CSSD]2013-05-23 15:52:08.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac077370) con(0x7f82ac0131e0) skgpid ospid 28725 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:09.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:09.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:09.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:11.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038c002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:11.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:11.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:11.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:11.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:11.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038d002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:11.112 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:11.112 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:11.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:11.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:11.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:11.478 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac077370) allocated [ CSSD]2013-05-23 15:52:11.479 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:52:11.479 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac077370 - 1,2,3 [ CSSD]2013-05-23 15:52:11.479 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0131e0) proc(0x7f82ac077370) pid(28791) version 11:1:1:4 [ CSSD]2013-05-23 15:52:11.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038e002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:11.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:11.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:11.778 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018dd0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:11.778 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:11.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038f002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:11.785 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:11.785 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019590) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:12.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:12.439 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:13.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:13.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:13.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:13.892 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:52:13.892 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:52:13.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:52:13.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:52:13.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0390002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:13.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:13.969 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:13.969 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac018dd0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:52:13.969 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:52:13.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0391002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:13.976 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:13.976 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac019590) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:14.165 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac077370 [ CSSD]2013-05-23 15:52:14.165 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac077370) con(0x7f82ac0131e0) skgpid ospid 28791 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:15.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:15.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:15.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:15.833 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:16.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0392002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:16.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:16.441 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:52:17.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:17.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:17.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:19.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:19.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:19.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:21.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:21.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:21.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:21.443 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:21.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:21.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac077370) allocated [ CSSD]2013-05-23 15:52:21.611 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:52:21.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac077370 - 1,2,3 [ CSSD]2013-05-23 15:52:21.611 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0131e0) proc(0x7f82ac077370) pid(29161) version 11:1:1:4 [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82ac077370), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:52:21.617 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:21.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:52:21.623 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:52:21.623 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:21.623 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:52:21.826 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac077370 [ CSSD]2013-05-23 15:52:21.826 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac077370) con(0x7f82ac0131e0) skgpid ospid 29161 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:23.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:23.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:23.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:25.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:25.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:25.572 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:25.859 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:26.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0393002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:26.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0394002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:26.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:26.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:26.357 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:26.357 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:26.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0395002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:26.364 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:26.364 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:26.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:26.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:27.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:27.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:27.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:29.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:29.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:29.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:31.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:31.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:31.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:31.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:31.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:33.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:33.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:33.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:35.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:35.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:35.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:35.880 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:36.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0396002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:36.450 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:36.450 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:36.858 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:52:36.859 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:52:36.859 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:52:36.859 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(29332) version 11:1:1:4 [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a5440), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:52:36.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:36.880 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:52:36.880 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:52:36.880 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:36.881 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:52:37.083 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:52:37.083 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 29332 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:37.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:37.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:37.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:39.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:39.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:39.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:41.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:41.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:41.453 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:41.453 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:41.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0397002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:41.607 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:41.607 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:41.607 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:41.607 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:41.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0398002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:41.614 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:41.614 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:41.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:43.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:43.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:43.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:45.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:45.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:45.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:45.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:46.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0399002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:46.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:46.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:47.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:47.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:47.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:48.732 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac001b80) [ CSSD]2013-05-23 15:52:48.732 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac001b80), grp DBHWPROD, member 0 [ CSSD]2013-05-23 15:52:48.732 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac001b80), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 15:52:48.732 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001720) [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001720), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001720), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac014070 [ CSSD]2013-05-23 15:52:48.738 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac014070) con(0x7f82ac0025c0) skgpid 23755 ospid 23755 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:49.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:49.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:49.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:50.457 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:50.457 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:52:51.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:51.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:51.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:52.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:52:52.121 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:52:52.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:52:52.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(29487) version 11:1:1:4 [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:52:52.127 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:52.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:52:52.133 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:52:52.133 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:52:52.133 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:52:52.336 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:52:52.336 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 29487 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:52:53.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:53.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:53.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:55.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:52:55.460 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:52:55.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:55.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:55.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:55.958 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:52:56.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039a002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:56.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039b002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:56.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:52:56.867 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:52:56.867 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:52:56.867 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:52:56.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039c002c) incarnation(174631051) [ CSSD]2013-05-23 15:52:56.874 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:52:56.874 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:52:57.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:57.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:57.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:52:59.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:52:59.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:52:59.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:00.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:00.462 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:00.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac005920) [ CSSD]2013-05-23 15:53:00.562 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac005920), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:53:00.562 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac005920), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:53:00.563 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 15:53:00.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005390 [ CSSD]2013-05-23 15:53:00.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005390) con(0x7f82ac001ea0) skgpid 25768 ospid 25768 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:01.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:01.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:01.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:03.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:03.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:03.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:05.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:05.465 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:05.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:05.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:05.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:05.982 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:06.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039d002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:07.368 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:07.369 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:53:07.369 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:07.369 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(29632) version 11:1:1:4 [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:07.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:07.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:07.382 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:53:07.382 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:07.382 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:07.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:07.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:07.584 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:53:07.584 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 29632 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:07.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:08.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:53:08.258 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:08.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:53:08.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(29679) version 11:1:1:4 [ CSSD]2013-05-23 15:53:08.264 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 15:53:08.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:53:08.264 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 15:53:08.264 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:08.264 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:53:08.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:08.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:08.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:53:08.271 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:53:08.271 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:08.271 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:08.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 15:53:08.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 29679 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:09.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:09.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:09.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:10.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:10.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:11.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:11.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:11.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:12.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039e002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:12.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:53:12.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:53:12.036 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:53:12.036 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:12.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039f002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:12.043 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:53:12.043 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:53:12.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a0002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:12.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:53:12.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:53:12.129 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:53:12.130 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:12.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a1002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:12.136 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:53:12.136 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:53:13.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:13.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:14.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:14.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:14.469 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:53:15.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:15.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:16.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:16.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:16.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a2002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:17.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:17.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:18.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:19.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:19.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:19.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:19.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:20.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:21.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:21.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:22.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:22.617 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:22.617 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:53:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(29775) version 11:1:1:4 [ CSSD]2013-05-23 15:53:22.623 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:22.624 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:22.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:53:22.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:53:22.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:22.631 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:22.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:53:22.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 29775 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:23.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:23.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:24.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:24.475 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:24.475 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:25.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:25.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:26.037 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:26.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:26.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a3002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:27.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a4002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:27.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:53:27.378 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:53:27.378 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:53:27.378 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:27.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a5002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:27.386 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:53:27.386 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:53:27.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:27.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:28.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:29.477 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:29.477 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:29.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:29.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:30.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:31.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:31.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:32.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:33.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:33.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:34.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:34.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:34.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:35.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:35.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:36.060 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:36.145 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 15:53:36.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:36.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 15:53:36.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(29464/29464) version 11:1:1:4 [ CSSD]2013-05-23 15:53:36.163 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 15:53:36.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 15:53:36.163 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:53:36.163 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 15:53:36.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:36.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a6002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:36.545 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:36.546 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:36.547 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:36.547 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(29934) version 11:1:1:4 [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4204870 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:36.563 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:36.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 15:53:36.570 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:53:36.570 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:53:36.570 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:36.677 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42be580) allocated [ CSSD]2013-05-23 15:53:36.677 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:36.678 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42be580 - 1,2,3 [ CSSD]2013-05-23 15:53:36.678 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42be580) pid(29939) version 11:1:1:4 [ CSSD]2013-05-23 15:53:36.693 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:53:36.696 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:53:36.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:53:36.700 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42be580 [ CSSD]2013-05-23 15:53:36.700 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42be580) con(0x7f82b42aee40) skgpid ospid 29939 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:36.772 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:53:36.772 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 29934 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:37.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:37.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:37.867 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:37.867 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:53:37.868 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:37.868 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(29975) version 11:1:1:4 [ CSSD]2013-05-23 15:53:37.873 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:37.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:37.873 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4285e90, requested num -1 [ CSSD]2013-05-23 15:53:37.873 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:37.873 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:53:37.874 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:37.874 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:37.880 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:53:37.880 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:53:37.880 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:37.880 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:38.082 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:53:38.082 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 29975 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:38.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:39.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:39.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:39.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:39.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:40.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:41.248 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:41.249 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:41.249 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:41.249 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b42a5440) pid(30051) version 11:1:1:4 [ CSSD]2013-05-23 15:53:41.792 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 15:53:41.792 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a8c30) skgpid ospid 30051 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:41.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:41.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:42.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:42.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a7002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:42.649 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:53:42.649 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:53:42.649 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:53:42.649 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:42.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a8002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:42.656 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:53:42.657 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:53:43.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:43.485 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:53:43.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:43.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:44.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:45.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:45.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:46.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:46.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:46.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a9002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:47.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:47.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:48.322 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:48.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:48.487 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:49.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:49.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:50.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:51.171 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 15:53:51.172 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:51.173 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 15:53:51.173 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bea70) proc(0x7f82b42a5440) pid(30276/30276) version 11:1:1:4 [ CSSD]2013-05-23 15:53:51.189 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a5440), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 15:53:51.189 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 15:53:51.189 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:53:51.189 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 15:53:51.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:51.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:52.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:53.118 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 15:53:53.119 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:53:53.119 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 15:53:53.119 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(30300) version 11:1:1:4 [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42c5f40), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:53:53.125 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:53.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:53:53.133 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:53:53.133 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ad0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:53:53.133 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ad0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:53:53.336 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 15:53:53.336 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid ospid 30300 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:53:53.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:53.490 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:53:53.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:53.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:54.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:55.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:55.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:55.985 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 15:53:55.986 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:53:55.987 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 15:53:55.987 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42a3ea0) pid(30349/30349) version 11:1:1:4 [ CSSD]2013-05-23 15:53:56.003 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a3ea0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 15:53:56.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 15:53:56.003 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:53:56.003 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 15:53:56.108 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:53:56.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:56.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03aa002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:57.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ab002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:57.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:53:57.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:53:57.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:53:57.899 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:53:57.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ac002c) incarnation(174631051) [ CSSD]2013-05-23 15:53:57.906 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:53:57.906 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:53:57.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:53:57.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:53:58.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:53:58.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:53:58.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:00.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:00.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:00.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:00.626 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 15:54:00.627 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:54:00.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 15:54:00.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(30261/30261) version 11:1:1:4 [ CSSD]2013-05-23 15:54:00.643 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 15:54:00.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:54:00.643 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:54:00.643 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:54:02.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:02.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:02.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:03.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:03.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:04.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:04.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:04.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:06.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:06.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:06.131 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:06.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:06.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ad002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:08.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:08.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:08.370 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 15:54:08.370 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:54:08.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 15:54:08.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42b3030) pid(30468) version 11:1:1:4 [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3030), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:08.377 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:08.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:54:08.383 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:54:08.383 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:08.383 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:08.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:08.498 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:08.510 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ccf90) allocated [ CSSD]2013-05-23 15:54:08.510 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:54:08.511 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ccf90 - 1,2,3 [ CSSD]2013-05-23 15:54:08.511 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ccf90) pid(30509) version 11:1:1:4 [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ccf90), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42b3980, requested num -1 [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:08.527 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:08.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:54:08.533 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:54:08.533 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8550) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:08.534 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:08.586 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 15:54:08.586 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b4257120) skgpid ospid 30468 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:08.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:08.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ccf90 [ CSSD]2013-05-23 15:54:08.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ccf90) con(0x7f82b42cbf30) skgpid ospid 30509 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:10.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:10.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:10.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:12.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:12.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:12.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ae002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:12.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:54:12.303 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:54:12.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:54:12.304 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:12.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03af002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:12.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:54:12.310 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:54:12.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:13.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b0002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:13.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:54:13.153 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:54:13.153 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:54:13.153 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:13.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b1002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:13.160 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:54:13.160 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:54:13.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:13.501 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:14.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:14.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:14.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:16.165 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:16.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:16.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:16.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:16.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b2002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:18.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:18.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:18.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:18.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:18.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:20.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:20.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:20.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:22.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:22.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:22.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:23.379 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 15:54:23.379 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:54:23.380 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 15:54:23.380 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5840) proc(0x7f82b42b3030) pid(30617) version 11:1:1:4 [ CSSD]2013-05-23 15:54:23.497 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cd1d0) allocated [ CSSD]2013-05-23 15:54:23.498 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:54:23.499 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cd1d0 - 1,2,3 [ CSSD]2013-05-23 15:54:23.499 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429f510) proc(0x7f82b42cd1d0) pid(30627) version 11:1:1:4 [ CSSD]2013-05-23 15:54:23.505 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:23.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:23.516 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:54:23.518 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:54:23.521 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cd1d0 [ CSSD]2013-05-23 15:54:23.521 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cd1d0) con(0x7f82b429f510) skgpid ospid 30627 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5339/0x7f82b41ff1f0) [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5339 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42a1690/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:23.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:54:23.606 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5339 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:54:23.606 [1199044928] >TRACE: clssgmExitGrock: client 5339 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:54:23.606 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3980) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:54:23.607 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b3980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:23.608 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 15:54:23.608 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b42b5840) skgpid ospid 30617 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:23.629 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ccf90) allocated [ CSSD]2013-05-23 15:54:23.630 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:54:23.631 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ccf90 - 1,2,3 [ CSSD]2013-05-23 15:54:23.631 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e0a0) proc(0x7f82b42ccf90) pid(30637) version 11:1:1:4 [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ccf90), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:23.646 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:23.653 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:54:23.653 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:54:23.653 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:23.653 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:23.855 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ccf90 [ CSSD]2013-05-23 15:54:23.855 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ccf90) con(0x7f82b429e0a0) skgpid ospid 30637 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:24.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:24.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:24.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:26.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:26.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:26.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:26.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b3002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:26.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:28.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:28.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:28.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b4002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:28.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:54:28.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:54:28.414 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:54:28.414 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:28.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b5002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:28.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:54:28.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:54:28.508 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:28.508 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:28.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:30.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:30.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:30.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 15:54:30.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid 30261 ospid 30261 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:32.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:32.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:32.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:33.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:33.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:34.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:34.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:34.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:36.228 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:36.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:36.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:36.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b6002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:36.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:37.512 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:37.512 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:54:38.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:38.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:38.800 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:38.889 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 15:54:38.890 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:54:38.891 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 15:54:38.891 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(30790) version 11:1:1:4 [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:38.897 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:38.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:54:38.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:54:38.904 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:38.904 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:39.106 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 15:54:39.106 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid ospid 30790 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:40.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:40.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:40.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:42.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:42.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:42.515 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:42.515 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:42.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:43.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b7002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:43.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:54:43.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:54:43.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:54:43.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:43.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b8002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:43.673 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:54:43.673 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:54:44.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:44.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:44.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:46.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:46.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:46.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:46.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b9002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:46.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:47.518 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:47.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:48.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:48.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:48.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:50.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:50.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:50.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:52.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:52.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:52.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:52.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:52.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:54.140 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 15:54:54.140 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:54:54.141 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 15:54:54.141 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8a0) pid(30950) version 11:1:1:4 [ CSSD]2013-05-23 15:54:54.146 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:54:54.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:54:54.146 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 15:54:54.146 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:54.146 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:54:54.147 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:54:54.147 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:54.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:54:54.153 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:54:54.153 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:54:54.153 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:54:54.356 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 15:54:54.356 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4257120) skgpid ospid 30950 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:54:54.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:54.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:54.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:56.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:54:56.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:56.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:56.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ba002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:56.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:54:57.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:54:57.523 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:54:58.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:54:58.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:54:58.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03bb002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:58.915 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:54:58.915 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:54:58.915 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:54:58.915 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:54:58.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bc002c) incarnation(174631051) [ CSSD]2013-05-23 15:54:58.923 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:54:58.923 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:54:59.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:00.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:00.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:01.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:01.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:01.526 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:55:02.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:02.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:03.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:04.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:04.645 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:04.946 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 15:55:04.947 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:55:04.947 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 15:55:04.947 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(31103/31103) version 11:1:1:4 [ CSSD]2013-05-23 15:55:04.953 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:55:04.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:55:04.953 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:55:04.953 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:55:05.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41edd50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 15:55:05.230 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid 31103 ospid 31103 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:06.295 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:06.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:06.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:06.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:06.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:06.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03bd002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:07.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:08.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:08.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:08.778 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 15:55:08.779 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:55:08.779 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 15:55:08.779 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ba8a0) pid(31131) version 11:1:1:4 [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:55:08.785 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:08.792 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:55:08.792 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:55:08.792 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:08.792 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:55:08.994 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 15:55:08.994 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42cbf30) skgpid ospid 31131 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:09.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:09.397 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 15:55:09.398 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:55:09.398 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 15:55:09.398 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42c7b30) pid(31140) version 11:1:1:4 [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7b30), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:55:09.404 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:09.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:55:09.411 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:55:09.411 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:09.411 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:55:09.613 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 15:55:09.613 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42cbf30) skgpid ospid 31140 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:10.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:10.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:11.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:11.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:11.531 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:12.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03be002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:12.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:55:12.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:55:12.556 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:55:12.556 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:12.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bf002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:12.563 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:55:12.563 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:55:12.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:12.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:13.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:14.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c0002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:14.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:55:14.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:55:14.176 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:55:14.176 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:14.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c1002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:14.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:55:14.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:55:14.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:14.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:15.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:16.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:16.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:16.534 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:16.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:16.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:16.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c2002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:17.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:18.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:18.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:19.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:20.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:20.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:21.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:21.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:21.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:22.097 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a3ea0), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 15:55:22.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 15:55:22.097 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:55:22.097 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 15:55:22.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:22.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:23.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:24.646 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7bf0) allocated [ CSSD]2013-05-23 15:55:24.647 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:55:24.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7bf0 - 1,2,3 [ CSSD]2013-05-23 15:55:24.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42c7bf0) pid(31287) version 11:1:1:4 [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7bf0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:55:24.653 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:24.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:55:24.660 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:55:24.660 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:24.660 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:55:24.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:24.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:24.862 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7bf0 [ CSSD]2013-05-23 15:55:24.862 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7bf0) con(0x7f82b42baac0) skgpid ospid 31287 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:25.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:26.345 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:26.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:26.539 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:26.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c3002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:26.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:26.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:27.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:28.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:28.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:29.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:29.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c4002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:29.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:55:29.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:55:29.438 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:55:29.438 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:29.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c5002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:29.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:55:29.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:55:30.541 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:30.541 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:55:30.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:30.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:31.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:32.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:32.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:33.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:34.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:34.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:35.306 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:35.544 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:35.544 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:36.367 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:36.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c6002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:36.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:36.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:37.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:38.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:38.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:39.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:39.896 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7bf0) allocated [ CSSD]2013-05-23 15:55:39.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:55:39.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7bf0 - 1,2,3 [ CSSD]2013-05-23 15:55:39.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42c7bf0) pid(31462) version 11:1:1:4 [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7bf0), client(1/0x7f82b42be660) [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42be660 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:55:39.903 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:39.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 15:55:39.910 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42be660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:55:39.910 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:39.910 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:55:40.112 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7bf0 [ CSSD]2013-05-23 15:55:40.112 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7bf0) con(0x7f82b42baac0) skgpid ospid 31462 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:40.546 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:40.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:40.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:40.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:41.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:43.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:43.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:43.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:44.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c7002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:44.688 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:55:44.688 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:55:44.688 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:55:44.689 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:44.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c8002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:44.696 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:55:44.696 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:55:45.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:45.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:45.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:45.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:45.549 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:46.391 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:46.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c9002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:47.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:47.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:47.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:49.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:49.094 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:49.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:50.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:50.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:51.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:51.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:51.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:53.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:53.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:53.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:54.554 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:54.554 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:55:55.145 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 15:55:55.146 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:55:55.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 15:55:55.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b429dfe0) pid(31612) version 11:1:1:4 [ CSSD]2013-05-23 15:55:55.151 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429dfe0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 15:55:55.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:55:55.151 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 15:55:55.151 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:55.151 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:55:55.152 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:55:55.152 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:55.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:55:55.157 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:55:55.157 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:55:55.158 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:55:55.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:55.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:55.360 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 15:55:55.360 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b42a9150) skgpid ospid 31612 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:55:55.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:56.411 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:55:56.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ca002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:57.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:57.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:57.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:59.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:55:59.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:55:59.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:55:59.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:55:59.557 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:55:59.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03cb002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:59.947 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:55:59.947 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:55:59.947 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:55:59.948 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:55:59.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cc002c) incarnation(174631051) [ CSSD]2013-05-23 15:55:59.955 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:55:59.955 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:01.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:01.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:01.539 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:03.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:03.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:03.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:04.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:04.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:05.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:05.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:05.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:06.437 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:06.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03cd002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:07.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:07.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:07.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:09.034 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 15:56:09.034 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:56:09.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 15:56:09.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42cf950) pid(31757) version 11:1:1:4 [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cf950), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:56:09.042 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:09.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:56:09.048 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:56:09.048 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3030) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:09.049 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3030) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:56:09.251 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 15:56:09.251 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b42a9150) skgpid ospid 31757 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:09.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:09.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:09.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:09.562 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:09.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:10.393 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7bf0) allocated [ CSSD]2013-05-23 15:56:10.394 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:56:10.394 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7bf0 - 1,2,3 [ CSSD]2013-05-23 15:56:10.394 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42c7bf0) pid(31772) version 11:1:1:4 [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7bf0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:56:10.401 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:10.407 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:56:10.407 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:56:10.407 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b59e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:10.407 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b59e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:56:10.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7bf0 [ CSSD]2013-05-23 15:56:10.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7bf0) con(0x7f82b42baac0) skgpid ospid 31772 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:11.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:11.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:11.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:12.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ce002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:12.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:56:12.829 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:56:12.829 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:56:12.829 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:12.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cf002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:12.836 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:56:12.836 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:13.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:13.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:13.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:14.564 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:14.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:15.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d0002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:15.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:56:15.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:56:15.209 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:56:15.210 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:15.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d1002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:15.217 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:56:15.217 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:15.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:15.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:15.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:15.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d2002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:15.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:56:15.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:56:15.699 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 15:56:15.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:15.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d3002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:15.706 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:56:15.706 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:15.841 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:56:15.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:56:15.843 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:56:15.844 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:56:15.935 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429dfe0) allocated [ CSSD]2013-05-23 15:56:15.936 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:56:15.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429dfe0 - 1,2,3 [ CSSD]2013-05-23 15:56:15.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b429dfe0) pid(31851/31851) version 11:1:1:4 [ CSSD]2013-05-23 15:56:15.953 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b429dfe0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 15:56:15.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 15:56:15.953 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:56:15.953 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429dfe0 [ CSSD]2013-05-23 15:56:15.977 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429dfe0) con(0x7f82b4257120) skgpid 31851 ospid 31851 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:16.457 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:16.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d4002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:17.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:17.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:17.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:19.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:19.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:19.567 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:19.567 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:19.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:21.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:21.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:21.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:23.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:23.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:23.569 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:23.570 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:56:23.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:25.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:25.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:25.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 15:56:25.644 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:56:25.644 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 15:56:25.644 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42cf950) pid(31926) version 11:1:1:4 [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cf950), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:56:25.661 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:25.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 15:56:25.668 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:56:25.668 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:25.668 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:56:25.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:25.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 15:56:25.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b4257120) skgpid ospid 31926 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:26.479 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:27.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d5002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:27.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:27.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:27.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:28.572 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:28.572 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:29.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:29.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:29.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:30.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d6002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:30.458 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:56:30.458 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:56:30.458 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:56:30.458 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:30.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d7002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:30.465 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:56:30.465 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:31.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:31.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:31.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:33.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:33.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:33.575 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:33.575 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:33.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:35.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:35.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:35.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:35.991 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7bf0) allocated [ CSSD]2013-05-23 15:56:35.992 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:56:35.993 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7bf0 - 1,2,3 [ CSSD]2013-05-23 15:56:35.993 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baac0) proc(0x7f82b42c7bf0) pid(31912/31912) version 11:1:1:4 [ CSSD]2013-05-23 15:56:36.008 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7bf0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 15:56:36.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 15:56:36.008 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:56:36.008 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:56:36.500 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:37.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d8002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:37.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:37.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:37.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:38.578 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:38.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:39.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:39.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:40.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:40.903 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:56:40.904 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:56:40.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:56:40.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(32099) version 11:1:1:4 [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:56:40.911 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:40.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:56:40.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:56:40.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:40.918 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:56:41.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:56:41.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 32099 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:41.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:41.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:42.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:43.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:43.582 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:43.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:43.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:44.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:45.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:45.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:45.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d9002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:45.707 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:56:45.707 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:56:45.707 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:56:45.707 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:45.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03da002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:45.714 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:56:45.714 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:56:46.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:46.524 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:47.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03db002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:47.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:47.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:48.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:48.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:48.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:49.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:49.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:50.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:51.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:51.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:52.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:53.588 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:53.589 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:53.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:53.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:54.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:55.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:55.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:56.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:56.154 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:56:56.155 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:56:56.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:56:56.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(32242) version 11:1:1:4 [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:56:56.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:56:56.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:56:56.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:56:56.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:56:56.169 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:56:56.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:56:56.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 32242 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:56:56.550 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:56:57.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03dc002c) incarnation(174631051) [ CSSD]2013-05-23 15:56:57.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:57.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:56:58.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:56:58.591 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:56:58.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:56:59.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:56:59.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:00.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:00.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03dd002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:00.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:00.968 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:00.968 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:57:00.968 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:00.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03de002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:00.976 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:00.976 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:01.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:01.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:02.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:03.594 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:03.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:03.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:03.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:04.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:05.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:05.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:06.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:06.573 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:07.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03df002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:07.596 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:07.597 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:57:07.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:07.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:08.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:09.295 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:57:09.296 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:09.296 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:57:09.296 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(32394) version 11:1:1:4 [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41edd50 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:09.302 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:09.303 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:09.309 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:57:09.309 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41edd50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:09.309 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:09.309 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:09.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:57:09.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 32394 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:09.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:09.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:10.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:11.186 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:57:11.187 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:11.187 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:57:11.187 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(32427) version 11:1:1:4 [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:11.192 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:11.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:57:11.197 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:11.197 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:11.197 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:11.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:57:11.400 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 32427 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:11.417 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:57:11.418 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:57:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:57:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46b0) proc(0x7f82b42b39e0) pid(32446) version 11:1:1:4 [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:11.424 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:11.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:57:11.431 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:11.431 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd110) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:11.431 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:11.633 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:57:11.633 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b46b0) skgpid ospid 32446 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:11.837 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3030) allocated [ CSSD]2013-05-23 15:57:11.838 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:11.838 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3030 - 1,2,3 [ CSSD]2013-05-23 15:57:11.838 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42b3030) pid(32465) version 11:1:1:4 [ CSSD]2013-05-23 15:57:11.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:11.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:12.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:12.599 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:12.599 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:13.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e0002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:13.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:13.088 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:13.088 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:57:13.088 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:13.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e1002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:13.095 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:13.095 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:13.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:13.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:14.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:57:14.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:57:14.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:57:14.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:57:14.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e2002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:14.306 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:14.306 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:14.306 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 15:57:14.306 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 15:57:14.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e3002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:14.314 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:14.314 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:14.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:14.414 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3030 [ CSSD]2013-05-23 15:57:14.414 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3030) con(0x7f82b42cbf30) skgpid ospid 32465 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:16.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:16.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:16.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e4002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:16.215 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:16.215 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:16.215 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:57:16.215 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:16.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e5002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:16.222 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:16.222 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:16.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:16.594 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:17.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e6002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:17.602 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:17.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:18.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:18.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:18.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:20.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:20.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:20.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:22.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:22.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:22.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:22.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:22.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:24.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:24.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:24.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:26.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:26.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:26.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:26.615 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:26.680 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:57:26.681 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:57:26.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:57:26.682 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(441) version 11:1:1:4 [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:26.688 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:26.695 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:57:26.695 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:26.695 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:26.695 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:26.898 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:57:26.898 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 441 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:27.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e7002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:27.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:27.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:28.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:28.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:28.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:30.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:30.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:30.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:31.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e8002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:31.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:31.464 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:31.464 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:57:31.464 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:31.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e9002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:31.472 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:31.472 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:31.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:31.609 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:57:32.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:32.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:32.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:34.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:34.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:34.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:36.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:36.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:36.552 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:36.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:36.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:36.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:37.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ea002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:38.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:38.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:38.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:40.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:40.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:40.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:40.708 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b39e0) allocated [ CSSD]2013-05-23 15:57:40.708 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:40.709 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b39e0 - 1,2,3 [ CSSD]2013-05-23 15:57:40.709 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3030) proc(0x7f82b42b39e0) pid(597) version 11:1:1:4 [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b39e0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:40.715 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:40.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:57:40.722 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:40.722 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd1e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:40.722 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd1e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:40.925 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b39e0 [ CSSD]2013-05-23 15:57:40.925 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b39e0) con(0x7f82b42b3030) skgpid ospid 597 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:41.614 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:41.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:41.944 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf760) allocated [ CSSD]2013-05-23 15:57:41.945 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:57:41.945 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf760 - 1,2,3 [ CSSD]2013-05-23 15:57:41.945 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b46b0) proc(0x7f82b42cf760) pid(611) version 11:1:1:4 [ CSSD]2013-05-23 15:57:41.951 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cf760), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:57:41.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:57:41.951 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b429f510, requested num -1 [ CSSD]2013-05-23 15:57:41.951 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:41.951 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:41.952 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:41.952 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:41.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:57:41.958 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:41.958 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cd080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:41.958 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cd080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:42.160 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf760 [ CSSD]2013-05-23 15:57:42.161 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf760) con(0x7f82b42b46b0) skgpid ospid 611 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:42.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:42.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:42.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:44.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:44.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:44.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:46.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:46.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:46.617 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:46.617 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:46.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:46.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:46.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03eb002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:46.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:57:46.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:57:46.726 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:57:46.726 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:46.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ec002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:46.734 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:57:46.734 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac0035f0) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:57:47.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ed002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:48.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:48.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:48.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac003280) [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac003280), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac003280), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006d30 [ CSSD]2013-05-23 15:57:48.824 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006d30) con(0x7f82ac0056e0) skgpid 27574 ospid 27574 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:50.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:50.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:50.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:51.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3210) allocated [ CSSD]2013-05-23 15:57:51.321 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:51.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3210 - 1,2,3 [ CSSD]2013-05-23 15:57:51.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b3800) proc(0x7f82b42b3210) pid(734/734) version 11:1:1:4 [ CSSD]2013-05-23 15:57:51.338 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3210), client(1/0x7f82b41edd50) [ CSSD]2013-05-23 15:57:51.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41edd50) [ CSSD]2013-05-23 15:57:51.338 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:57:51.338 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 15:57:51.619 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:51.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:52.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:52.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:52.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:54.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:54.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:54.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:56.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:56.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:56.622 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:57:56.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:57:56.684 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:57:56.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:57.193 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8320) allocated [ CSSD]2013-05-23 15:57:57.194 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:57:57.194 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8320 - 1,2,3 [ CSSD]2013-05-23 15:57:57.194 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b42c8320) pid(778) version 11:1:1:4 [ CSSD]2013-05-23 15:57:57.200 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42c8320), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 15:57:57.200 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:57:57.200 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 15:57:57.200 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:57.200 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:57:57.201 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:57:57.201 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:57:57.207 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:57:57.207 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:57:57.207 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8b90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:57:57.207 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8b90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:57:57.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ee002c) incarnation(174631051) [ CSSD]2013-05-23 15:57:57.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8320 [ CSSD]2013-05-23 15:57:57.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8320) con(0x7f82b42a1690) skgpid ospid 778 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:57:58.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:57:58.402 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:57:58.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:57:59.277 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8320) allocated [ CSSD]2013-05-23 15:57:59.278 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:57:59.278 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8320 - 1,2,3 [ CSSD]2013-05-23 15:57:59.278 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1690) proc(0x7f82b42c8320) pid(762/762) version 11:1:1:4 [ CSSD]2013-05-23 15:57:59.294 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42c8320), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 15:57:59.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 15:57:59.294 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:57:59.294 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 15:58:00.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:00.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:00.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:00.625 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:58:00.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:01.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ef002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:01.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:58:01.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:58:01.977 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:58:01.977 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:01.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f0002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:01.985 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:58:01.985 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:58:02.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:02.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:02.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:04.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:04.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:04.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:05.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:05.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:06.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:06.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:06.706 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:06.834 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:07.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f1002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:08.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:08.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:08.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:09.553 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42825e0) allocated [ CSSD]2013-05-23 15:58:09.554 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:58:09.554 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42825e0 - 1,2,3 [ CSSD]2013-05-23 15:58:09.554 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8270) proc(0x7f82b42825e0) pid(926) version 11:1:1:4 [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42825e0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:09.570 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:09.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 15:58:09.577 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:58:09.577 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d50d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:09.577 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d50d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:09.779 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42825e0 [ CSSD]2013-05-23 15:58:09.779 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42825e0) con(0x7f82b42c8270) skgpid ospid 926 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:10.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:10.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:10.630 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:10.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:10.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:12.459 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42825e0) allocated [ CSSD]2013-05-23 15:58:12.460 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:58:12.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42825e0 - 1,2,3 [ CSSD]2013-05-23 15:58:12.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42825e0) pid(953) version 11:1:1:4 [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42825e0), client(1/0x7f82b42be660) [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42be660 with con 0x7f82b42d8550, requested num -1 [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4dd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:12.467 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:12.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 15:58:12.473 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42be660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:58:12.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d50d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:12.473 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d50d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:12.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:12.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:12.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42825e0 [ CSSD]2013-05-23 15:58:12.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42825e0) con(0x7f82b42cbf30) skgpid ospid 953 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:12.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:13.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f2002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:13.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:58:13.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:58:13.347 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:58:13.347 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:13.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f3002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:13.354 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:58:13.354 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:58:14.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:14.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:14.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:15.632 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:15.632 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:16.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:16.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:16.726 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:16.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:17.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f4002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:17.227 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:58:17.227 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:58:17.227 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:58:17.227 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:17.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f5002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:17.233 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:58:17.233 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:58:17.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f6002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:18.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:18.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:18.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:20.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:20.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:20.635 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:20.635 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:20.809 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42825e0) allocated [ CSSD]2013-05-23 15:58:20.810 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:58:20.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42825e0 - 1,2,3 [ CSSD]2013-05-23 15:58:20.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42825e0) pid(717/717) version 11:1:1:4 [ CSSD]2013-05-23 15:58:20.827 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42825e0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 15:58:20.827 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 15:58:20.827 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 15:58:20.827 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 15:58:20.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:22.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:22.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:22.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:24.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:24.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:24.637 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:24.637 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:58:24.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:26.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:26.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:26.750 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:26.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:27.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f7002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:27.712 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdcb0) allocated [ CSSD]2013-05-23 15:58:27.713 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:58:27.713 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdcb0 - 1,2,3 [ CSSD]2013-05-23 15:58:27.713 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8270) proc(0x7f82b41fdcb0) pid(1103) version 11:1:1:4 [ CSSD]2013-05-23 15:58:27.719 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdcb0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 15:58:27.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:58:27.719 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d4b90, requested num -1 [ CSSD]2013-05-23 15:58:27.719 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:27.719 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9380/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:58:27.720 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:27.720 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:27.726 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 15:58:27.726 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:58:27.726 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9680) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:27.726 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:27.928 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdcb0 [ CSSD]2013-05-23 15:58:27.928 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdcb0) con(0x7f82b42c8270) skgpid ospid 1103 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:28.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:28.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:28.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:29.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:29.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:30.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:30.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:30.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:32.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f8002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:32.476 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:58:32.476 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:58:32.476 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:58:32.476 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:32.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f9002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:32.483 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:58:32.483 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:58:32.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:32.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:32.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:34.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:34.643 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:34.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:34.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:35.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:36.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:36.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:36.776 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:36.850 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdcb0) allocated [ CSSD]2013-05-23 15:58:36.851 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:58:36.851 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdcb0 - 1,2,3 [ CSSD]2013-05-23 15:58:36.851 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8270) proc(0x7f82b41fdcb0) pid(1209) version 11:1:1:4 [ CSSD]2013-05-23 15:58:36.858 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdcb0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42aee50 with con 0x7f82b42d4b90, requested num -1 [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9380/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:36.859 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:36.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 15:58:36.866 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 15:58:36.866 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9680) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 15:58:36.866 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c9680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:36.972 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 15:58:36.973 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:58:36.973 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 15:58:36.973 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4b90) proc(0x7f82b42dc520) pid(1220) version 11:1:1:4 [ CSSD]2013-05-23 15:58:36.989 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:58:36.991 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:58:36.994 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:58:36.995 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 15:58:36.995 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42d4b90) skgpid ospid 1220 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:37.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:37.068 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdcb0 [ CSSD]2013-05-23 15:58:37.068 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdcb0) con(0x7f82b42c8270) skgpid ospid 1209 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:37.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fa002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:38.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:38.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:39.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:39.550 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42c7bf0), client(2/0x7f82b42a2a00) [ CSSD]2013-05-23 15:58:39.550 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 15:58:39.550 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 15:58:39.550 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 15:58:39.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:39.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:40.654 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:58:40.655 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:58:40.655 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:58:40.655 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4b90) proc(0x7f82b42d3d20) pid(1282) version 11:1:1:4 [ CSSD]2013-05-23 15:58:40.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:40.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:41.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:41.162 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:58:41.162 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d4b90) skgpid ospid 1282 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:42.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:42.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:42.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:58:42.961 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:58:42.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:58:42.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(1451) version 11:1:1:4 [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42c8270, requested num -1 [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:42.967 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:42.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:58:42.973 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:58:42.973 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:42.973 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:43.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:43.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:58:43.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 1451 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:44.648 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:44.648 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:44.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:44.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:45.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:46.794 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:46.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:46.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:47.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:47.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fb002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:47.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03fc002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:47.736 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:58:47.736 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:58:47.736 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:58:47.736 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:47.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fd002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:47.743 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:58:47.743 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:58:48.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:48.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:49.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:49.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:49.650 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:50.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:50.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:51.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:52.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:52.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:53.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:54.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:54.653 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:58:54.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:54.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:55.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:56.814 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:58:56.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:56.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:57.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:57.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fe002c) incarnation(174631051) [ CSSD]2013-05-23 15:58:58.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:58:58.220 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:58:58.221 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:58:58.221 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(1638) version 11:1:1:4 [ CSSD]2013-05-23 15:58:58.226 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 15:58:58.226 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:58:58.226 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42c8270, requested num -1 [ CSSD]2013-05-23 15:58:58.226 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:58.226 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:58:58.227 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:58:58.227 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:58:58.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:58:58.234 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:58:58.234 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:58:58.234 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:58:58.436 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:58:58.437 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 1638 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:58:58.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:58:58.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:58:59.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:58:59.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:58:59.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:01.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:01.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:01.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:02.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ff002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:02.986 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:59:02.986 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:59:02.986 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:59:02.986 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:02.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0400002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:02.993 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:59:02.993 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:59:03.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:03.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:03.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:04.658 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:04.658 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:05.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:05.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:05.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:06.835 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:07.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:07.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:07.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:07.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0401002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:09.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:09.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:09.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:09.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:09.661 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:09.819 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:09.820 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:59:09.821 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:09.821 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(1765) version 11:1:1:4 [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42d4f60, requested num -1 [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:09.827 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:09.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:59:09.834 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:59:09.834 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:09.834 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:10.037 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:10.037 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 1765 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:11.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:11.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:11.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:13.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:13.146 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:13.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:13.470 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:13.471 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:59:13.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:13.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4b90) proc(0x7f82b42d3d20) pid(1798) version 11:1:1:4 [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b4207960) [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d3c50, requested num -1 [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:13.478 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:13.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 15:59:13.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:59:13.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9b20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:13.485 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9b20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:13.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0402002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:13.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:59:13.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:59:13.606 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:59:13.607 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:13.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0403002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:13.614 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:59:13.614 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:59:13.687 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:13.687 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d4b90) skgpid ospid 1798 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:14.664 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:14.664 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:15.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:15.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:15.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:16.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:17.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:17.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:17.387 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:17.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0404002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:18.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0405002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:18.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:59:18.236 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:59:18.236 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:59:18.236 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:18.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0406002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:18.244 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:59:18.244 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:59:18.666 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:18.666 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:59:19.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:19.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:19.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:21.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:21.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:21.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:23.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:23.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:23.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:23.669 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:23.669 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:23.693 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:23.694 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:59:23.695 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:23.695 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(1909) version 11:1:1:4 [ CSSD]2013-05-23 15:59:23.813 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 15:59:23.814 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 15:59:23.814 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 15:59:23.814 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f60) proc(0x7f82b42dc520) pid(1919) version 11:1:1:4 [ CSSD]2013-05-23 15:59:23.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:59:23.833 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 15:59:23.836 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 15:59:23.836 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42d4f60) skgpid ospid 1919 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5340/0x7f82b4207ce0) [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5340 (0x7f82b4207ce0) [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207ce0 with con 0x7f82b42d4f60, requested num -1 [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42c9750/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:23.916 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 15:59:23.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5340 (0x7f82b4207ce0) [ CSSD]2013-05-23 15:59:23.922 [1199044928] >TRACE: clssgmExitGrock: client 5340 (0x7f82b4207ce0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 15:59:23.922 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 15:59:23.922 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:23.923 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:23.923 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 1909 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:25.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:25.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:25.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:26.877 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:27.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:27.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:27.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:27.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0407002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:28.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:28.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:28.724 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:28.724 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:59:28.725 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:28.725 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(1972) version 11:1:1:4 [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42d4b90, requested num -1 [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:28.731 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:28.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 15:59:28.738 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:59:28.738 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:28.738 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:28.941 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:28.941 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 1972 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:29.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:29.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:29.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:31.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:31.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:31.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:33.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:33.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:33.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:33.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0408002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:33.498 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:59:33.498 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:59:33.498 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:59:33.498 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:33.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0409002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:33.506 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:59:33.506 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:59:33.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:33.674 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:35.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:35.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:35.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:36.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:37.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:37.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:37.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:37.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040a002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:38.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:38.677 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:39.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:39.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:39.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:41.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:41.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:41.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:42.679 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:42.679 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 15:59:43.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:43.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:43.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:43.973 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:43.974 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:59:43.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:43.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42d3d20) pid(2119) version 11:1:1:4 [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d4f60, requested num -1 [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:43.981 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:43.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 15:59:43.988 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:59:43.988 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:43.988 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:44.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:44.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d8550) skgpid ospid 2119 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:45.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:45.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:45.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:46.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:47.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:47.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:47.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040b002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:47.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:47.681 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:47.681 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:48.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040c002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:48.749 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 15:59:48.749 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 15:59:48.749 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 15:59:48.749 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:48.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040d002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:48.757 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 15:59:48.757 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 15:59:49.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:49.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:49.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:51.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:51.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:51.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:52.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:52.684 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:53.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:53.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:53.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:55.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:55.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:55.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:56.952 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 15:59:57.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:57.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:57.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040e002c) incarnation(174631051) [ CSSD]2013-05-23 15:59:57.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 15:59:57.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 15:59:57.686 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 15:59:59.223 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 15:59:59.224 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 15:59:59.225 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 15:59:59.225 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4b90) proc(0x7f82b42d3d20) pid(2284) version 11:1:1:4 [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42d4f60, requested num -1 [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 15:59:59.231 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 15:59:59.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 15:59:59.237 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 15:59:59.237 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 15:59:59.237 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 15:59:59.440 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 15:59:59.440 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42d4b90) skgpid ospid 2284 with 0 clients, refcount 0 [ CSSD]2013-05-23 15:59:59.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 15:59:59.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 15:59:59.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:00.827 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 16:00:00.828 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:00.828 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 16:00:00.828 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8270) proc(0x7f82b42d3d20) pid(843/843) version 11:1:1:4 [ CSSD]2013-05-23 16:00:00.844 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:00:00.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:00:00.844 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:00.844 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:00:00.881 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc950) allocated [ CSSD]2013-05-23 16:00:00.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:00.882 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc950 - 1,2,3 [ CSSD]2013-05-23 16:00:00.882 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9aa0) proc(0x7f82b42dc950) pid(2337/2337) version 11:1:1:4 [ CSSD]2013-05-23 16:00:00.888 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dc950), client(1/0x7f82b42c8450) [ CSSD]2013-05-23 16:00:00.888 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42c8450) [ CSSD]2013-05-23 16:00:00.888 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:00.888 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:00:01.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:01.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:01.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:02.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:02.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:03.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:03.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:03.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:04.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040f002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:04.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:04.000 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:04.000 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:04.000 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:04.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0410002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:04.008 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:04.008 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:04.501 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df6b0) allocated [ CSSD]2013-05-23 16:00:04.502 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:04.503 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df6b0 - 1,2,3 [ CSSD]2013-05-23 16:00:04.503 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4b90) proc(0x7f82b42df6b0) pid(2559/2559) version 11:1:1:4 [ CSSD]2013-05-23 16:00:04.518 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42df6b0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:04.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:04.518 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:04.518 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:00:04.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:04.804 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cfb30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:00:04.804 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cfb30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:00:04.804 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:00:04.805 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df6b0 [ CSSD]2013-05-23 16:00:04.805 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df6b0) con(0x7f82b42d4b90) skgpid 2559 ospid 2559 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:05.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:05.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:05.693 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:06.971 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:07.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0411002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:07.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:07.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:07.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:07.691 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:07.698 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:09.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:09.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:09.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:10.071 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de2d0) allocated [ CSSD]2013-05-23 16:00:10.072 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:10.072 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de2d0 - 1,2,3 [ CSSD]2013-05-23 16:00:10.072 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd3f0) proc(0x7f82b42de2d0) pid(2603) version 11:1:1:4 [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de2d0), client(1/0x7f82b42be660) [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42be660 with con 0x7f82b42de070, requested num -1 [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dff60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:00:10.078 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:10.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 16:00:10.084 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42be660), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:00:10.084 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0260) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:10.085 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0260) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:00:10.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de2d0 [ CSSD]2013-05-23 16:00:10.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de2d0) con(0x7f82b42dd3f0) skgpid ospid 2603 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:11.693 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:11.693 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:00:11.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:11.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:11.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:13.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:13.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:13.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:13.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0412002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:13.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:13.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:13.871 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:13.871 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:13.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0413002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:13.879 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:13.879 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:14.483 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df6b0) allocated [ CSSD]2013-05-23 16:00:14.484 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:00:14.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df6b0 - 1,2,3 [ CSSD]2013-05-23 16:00:14.485 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b42df6b0) pid(2636) version 11:1:1:4 [ CSSD]2013-05-23 16:00:14.490 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42df6b0), client(1/0x7f82b4282940) [ CSSD]2013-05-23 16:00:14.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4282940) [ CSSD]2013-05-23 16:00:14.490 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4282940 with con 0x7f82b42df5d0, requested num -1 [ CSSD]2013-05-23 16:00:14.490 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:14.491 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dff20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:00:14.491 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:00:14.491 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:14.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4282940) [ CSSD]2013-05-23 16:00:14.498 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4282940), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:00:14.498 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0220) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:14.498 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0220) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:00:14.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df6b0 [ CSSD]2013-05-23 16:00:14.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df6b0) con(0x7f82b42d8550) skgpid ospid 2636 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:15.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:15.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:15.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:16.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:16.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:16.998 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:17.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0414002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:17.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:17.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:17.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:00:18.862 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid 29464 ospid 29464 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:19.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0415002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:19.259 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:19.259 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:19.259 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:19.259 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:19.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0416002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:19.267 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:19.267 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:19.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:19.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:19.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:21.698 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:21.699 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:21.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:21.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:21.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:23.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:23.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:23.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:25.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:25.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:25.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:26.701 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:26.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:27.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:27.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:00:27.413 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:27.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:00:27.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b4207a80) pid(2781/2781) version 11:1:1:4 [ CSSD]2013-05-23 16:00:27.430 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:00:27.430 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:00:27.430 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:27.430 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:00:27.554 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(2/0x7f82b42aee50) [ CSSD]2013-05-23 16:00:27.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42aee50) [ CSSD]2013-05-23 16:00:27.554 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:00:27.554 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:00:27.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0417002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:27.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:27.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:27.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:29.745 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dfb70) allocated [ CSSD]2013-05-23 16:00:29.746 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:00:29.747 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dfb70 - 1,2,3 [ CSSD]2013-05-23 16:00:29.747 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42dfb70) pid(2802) version 11:1:1:4 [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42dfb70), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42de5e0, requested num -1 [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:00:29.753 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:29.759 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:00:29.759 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:00:29.759 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:29.760 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:00:29.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:29.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:29.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:29.962 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dfb70 [ CSSD]2013-05-23 16:00:29.962 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dfb70) con(0x7f82b42c6340) skgpid ospid 2802 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:31.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:31.704 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:31.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:31.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:31.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:33.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:33.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:33.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:34.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0418002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:34.509 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:34.509 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:34.509 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:34.509 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:34.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0419002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:34.516 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:34.516 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:35.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:35.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:35.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:36.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42aee50) [ CSSD]2013-05-23 16:00:36.448 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42aee50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:00:36.448 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42aee50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:00:36.448 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:00:36.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:00:36.456 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:00:36.457 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:00:36.457 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:00:36.457 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:00:36.457 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42d8550) skgpid 2781 ospid 2781 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:36.468 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:00:36.469 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:36.469 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:00:36.469 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(2891/2891) version 11:1:1:4 [ CSSD]2013-05-23 16:00:36.485 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(1/0x7f82b42be660) [ CSSD]2013-05-23 16:00:36.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 16:00:36.485 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:36.485 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:00:36.706 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:36.706 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:37.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:37.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041a002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:37.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:37.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42be660) [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42be660), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42be660), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:00:37.971 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid 2891 ospid 2891 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:37.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:39.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:39.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:39.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:40.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:40.708 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:00:41.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:41.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:41.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:43.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:00:43.221 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:00:43.221 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:00:43.221 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8550) proc(0x7f82b4207a80) pid(2722/2722) version 11:1:1:4 [ CSSD]2013-05-23 16:00:43.238 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4207a80), client(1/0x7f82b4282940) [ CSSD]2013-05-23 16:00:43.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4282940) [ CSSD]2013-05-23 16:00:43.238 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:00:43.238 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:00:44.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:44.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:44.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:45.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de390) allocated [ CSSD]2013-05-23 16:00:45.009 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:00:45.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de390 - 1,2,3 [ CSSD]2013-05-23 16:00:45.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd4b0) proc(0x7f82b42de390) pid(2963) version 11:1:1:4 [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de390), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42de2b0, requested num -1 [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0020/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:00:45.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:45.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:00:45.023 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:00:45.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0320) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:00:45.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0320) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:00:45.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de390 [ CSSD]2013-05-23 16:00:45.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de390) con(0x7f82b42dd4b0) skgpid ospid 2963 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:00:45.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:45.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:46.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:46.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:46.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:47.065 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:47.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041b002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:48.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:48.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:48.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:49.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041c002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:49.758 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:49.758 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:49.758 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:49.758 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:49.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041d002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:49.766 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:49.766 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:50.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:50.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:50.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:50.713 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:50.714 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:52.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:52.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:52.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:54.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:54.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:54.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:55.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:00:55.716 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:00:55.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041e002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:55.948 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:00:55.948 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:00:55.948 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:00:55.948 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:00:55.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041f002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:55.955 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:00:55.955 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:00:56.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:56.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:56.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:00:57.089 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:00:57.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0420002c) incarnation(174631051) [ CSSD]2013-05-23 16:00:58.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:00:58.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:00:58.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:00.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:00.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:00.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:00.269 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de2d0) allocated [ CSSD]2013-05-23 16:01:00.269 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:01:00.270 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de2d0 - 1,2,3 [ CSSD]2013-05-23 16:01:00.270 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd3f0) proc(0x7f82b42de2d0) pid(3120) version 11:1:1:4 [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de2d0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42de070, requested num -1 [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dff60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:01:00.286 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:00.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 16:01:00.294 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:01:00.294 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0260) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:00.294 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0260) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:01:00.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de2d0 [ CSSD]2013-05-23 16:01:00.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de2d0) con(0x7f82b42dd3f0) skgpid ospid 3120 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:00.719 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:00.719 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:02.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:02.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:02.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:04.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:04.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:04.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:05.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0421002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:05.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:05.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:05.006 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:01:05.006 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:05.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0422002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:05.013 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:05.014 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:05.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:05.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:06.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:06.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:06.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:07.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:07.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0423002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:08.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:08.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:08.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:10.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:10.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:10.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:10.330 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de2d0) allocated [ CSSD]2013-05-23 16:01:10.331 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:01:10.331 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de2d0 - 1,2,3 [ CSSD]2013-05-23 16:01:10.331 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd3f0) proc(0x7f82b42de2d0) pid(3241) version 11:1:1:4 [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de2d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42de070, requested num -1 [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dff60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:01:10.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:10.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:01:10.344 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:01:10.344 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0260) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:10.344 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0260) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:01:10.546 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de2d0 [ CSSD]2013-05-23 16:01:10.546 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de2d0) con(0x7f82b42dd3f0) skgpid ospid 3241 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:10.724 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:10.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:12.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:12.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:12.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:14.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0424002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:14.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:14.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:14.137 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:01:14.137 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:14.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0425002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:14.145 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:14.145 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:14.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:14.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:14.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:15.469 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df6b0) allocated [ CSSD]2013-05-23 16:01:15.470 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:01:15.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df6b0 - 1,2,3 [ CSSD]2013-05-23 16:01:15.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42df6b0) pid(3283/3283) version 11:1:1:4 [ CSSD]2013-05-23 16:01:15.476 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42df6b0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:01:15.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:01:15.476 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:01:15.476 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:01:15.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:01:15.494 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:01:15.494 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:01:15.494 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:01:15.495 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df6b0 [ CSSD]2013-05-23 16:01:15.495 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df6b0) con(0x7f82b42c6340) skgpid 3283 ospid 3283 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:15.533 [1199044928] >TRACE: clssgmAllocProc: (0x268c5c0) allocated [ CSSD]2013-05-23 16:01:15.533 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:01:15.534 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c5c0 - 1,2,3 [ CSSD]2013-05-23 16:01:15.534 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c5c0) pid(3285) version 11:1:1:4 [ CSSD]2013-05-23 16:01:15.550 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x268c5c0), client(1/0x26e87b0) [ CSSD]2013-05-23 16:01:15.550 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:01:15.550 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e87b0 with con 0x261bfa0, requested num -1 [ CSSD]2013-05-23 16:01:15.550 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:15.550 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:01:15.551 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:01:15.551 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:15.558 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:01:15.558 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e87b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:01:15.558 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261b9b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:15.558 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261b9b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:01:15.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:15.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:15.761 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c5c0 [ CSSD]2013-05-23 16:01:15.761 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c5c0) con(0x266f0d0) skgpid ospid 3285 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:15.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0426002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:15.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:15.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:15.997 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:01:15.997 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:16.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0427002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:16.004 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:16.004 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:16.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:01:16.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:01:16.131 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:01:16.132 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:01:16.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:16.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:16.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:17.295 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:17.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0428002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:18.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:18.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:18.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:20.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0429002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:20.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:20.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:20.256 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:01:20.256 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:20.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042a002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:20.263 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:20.263 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:20.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:20.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:20.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:20.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:20.730 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:22.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:22.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:22.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:23.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:01:23.163 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:01:23.163 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:01:23.163 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 16:01:23.169 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4257820) skgpid 30349 ospid 30349 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:23.459 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:01:23.460 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:01:23.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:01:23.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x261be20) pid(3387/3387) version 11:1:1:4 [ CSSD]2013-05-23 16:01:23.478 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261be20), client(1/0x26e87b0) [ CSSD]2013-05-23 16:01:23.478 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:01:23.478 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:01:23.478 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:01:24.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:24.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:24.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:24.743 [1199044928] >TRACE: clssgmAllocProc: (0x26a69a0) allocated [ CSSD]2013-05-23 16:01:24.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:01:24.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a69a0 - 1,2,3 [ CSSD]2013-05-23 16:01:24.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ef170) proc(0x26a69a0) pid(2720/2720) version 11:1:1:4 [ CSSD]2013-05-23 16:01:24.750 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26a69a0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:01:24.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:01:24.750 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:01:24.750 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:01:25.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:25.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:26.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:26.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:26.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:27.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:27.331 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26a69a0), client(2/0x26e8a80) [ CSSD]2013-05-23 16:01:27.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26e8a80) [ CSSD]2013-05-23 16:01:27.331 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:01:27.331 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 16:01:27.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042b002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:28.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:28.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:28.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:30.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:30.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:30.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:30.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:30.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:30.806 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 16:01:30.807 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:01:30.807 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 16:01:30.807 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698a00) proc(0x261ca20) pid(3435) version 11:1:1:4 [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x261ca20), client(1/0x261c940) [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c940) [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c940 with con 0x26cdda0, requested num -1 [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b670/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:01:30.814 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:30.820 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c940) [ CSSD]2013-05-23 16:01:30.820 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c940), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:01:30.820 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b970) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:30.821 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b970) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:01:30.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42c8450) [ CSSD]2013-05-23 16:01:30.919 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42c8450), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:01:30.919 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42c8450), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:01:30.919 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:01:30.920 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc950 [ CSSD]2013-05-23 16:01:30.920 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc950) con(0x7f82b42c9aa0) skgpid 2337 ospid 2337 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:31.023 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 16:01:31.023 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x2698a00) skgpid ospid 3435 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:32.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:32.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:32.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:34.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:34.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:34.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:35.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042c002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:35.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:35.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:35.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:01:35.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:35.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042d002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:35.512 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:35.512 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:35.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:35.738 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:36.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:36.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:36.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:37.340 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:37.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042e002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:38.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:38.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:38.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:40.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:40.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:40.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:40.740 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:40.740 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:42.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:42.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:42.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:44.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:44.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:44.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:45.743 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:45.743 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:46.061 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 16:01:46.062 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:01:46.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 16:01:46.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x261ca20) pid(3608) version 11:1:1:4 [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x261ca20), client(1/0x261c880) [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c880 with con 0x2698a00, requested num -1 [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b5a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:01:46.079 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:46.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:01:46.084 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c880), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:01:46.084 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:01:46.084 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:01:46.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 16:01:46.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x26595a0) skgpid ospid 3608 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:01:46.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:46.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:46.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:47.369 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:47.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042f002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:48.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:48.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:48.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:50.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:50.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:50.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:50.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:50.746 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:50.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0430002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:50.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:01:50.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:01:50.765 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:01:50.766 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:01:50.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0431002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:50.773 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:01:50.773 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:01:52.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:52.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:52.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:54.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:54.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:54.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:55.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:01:55.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:01:56.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:56.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:56.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:01:57.395 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:01:57.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0432002c) incarnation(174631051) [ CSSD]2013-05-23 16:01:58.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:01:58.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:01:58.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:00.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:00.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:00.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:00.751 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:00.751 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:01.323 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 16:02:01.324 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:02:01.324 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 16:02:01.324 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x261ca20) pid(3807) version 11:1:1:4 [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x261ca20), client(1/0x261c880) [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c880 with con 0x2698a00, requested num -1 [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b5a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:02:01.331 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:01.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:02:01.338 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c880), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:02:01.338 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:01.338 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:02:01.541 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 16:02:01.541 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x26595a0) skgpid ospid 3807 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:02.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:02.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:02.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:04.643 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:04.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:04.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:05.754 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:05.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:05.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0433002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:05.989 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:05.989 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:05.989 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:05.989 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:05.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0434002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:05.997 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:05.997 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:06.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0435002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:06.017 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:06.017 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:06.017 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:06.017 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:06.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0436002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:06.023 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:06.023 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:06.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:06.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:06.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:07.418 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:08.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0437002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:08.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:08.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:08.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:10.586 [1199044928] >TRACE: clssgmAllocProc: (0x261ca20) allocated [ CSSD]2013-05-23 16:02:10.587 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:02:10.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca20 - 1,2,3 [ CSSD]2013-05-23 16:02:10.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x261ca20) pid(3973) version 11:1:1:4 [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x261ca20), client(1/0x261c880) [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c880 with con 0x2698a00, requested num -1 [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x268b5a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:02:10.593 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:10.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c880) [ CSSD]2013-05-23 16:02:10.600 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c880), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:02:10.600 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:10.600 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:02:10.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:10.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:10.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:10.803 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca20 [ CSSD]2013-05-23 16:02:10.803 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca20) con(0x26595a0) skgpid ospid 3973 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:10.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:10.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:11.283 [1199044928] >TRACE: clssgmAllocProc: (0x26597c0) allocated [ CSSD]2013-05-23 16:02:11.284 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:02:11.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26597c0 - 1,2,3 [ CSSD]2013-05-23 16:02:11.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26594c0) proc(0x26597c0) pid(4000) version 11:1:1:4 [ CSSD]2013-05-23 16:02:12.361 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261be20), client(2/0x268b340) [ CSSD]2013-05-23 16:02:12.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x268b340) [ CSSD]2013-05-23 16:02:12.361 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:02:12.361 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:02:12.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:12.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:12.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:13.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x26597c0 [ CSSD]2013-05-23 16:02:13.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26597c0) con(0x26594c0) skgpid ospid 4000 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:14.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0438002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:14.396 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:14.396 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:14.396 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:14.396 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:14.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0439002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:14.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:14.404 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:14.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:02:14.549 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:02:14.550 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:02:14.551 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:02:14.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043a002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:14.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:14.627 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:14.627 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:02:14.627 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:02:14.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043b002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:14.635 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:14.635 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:14.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:14.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:14.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:15.739 [1199044928] >TRACE: clssgmAllocProc: (0x2698d00) allocated [ CSSD]2013-05-23 16:02:15.740 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:02:15.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d00 - 1,2,3 [ CSSD]2013-05-23 16:02:15.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x2698d00) pid(4349/4349) version 11:1:1:4 [ CSSD]2013-05-23 16:02:15.756 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2698d00), client(1/0x261c5a0) [ CSSD]2013-05-23 16:02:15.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c5a0) [ CSSD]2013-05-23 16:02:15.756 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:02:15.756 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:02:15.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:15.759 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:15.772 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c5a0) [ CSSD]2013-05-23 16:02:15.772 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c5a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:02:15.772 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c5a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:02:15.772 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:02:15.773 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d00 [ CSSD]2013-05-23 16:02:15.773 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d00) con(0x26595a0) skgpid 4349 ospid 4349 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:16.575 [1199044928] >TRACE: clssgmAllocProc: (0x26cdb30) allocated [ CSSD]2013-05-23 16:02:16.576 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:02:16.577 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26cdb30 - 1,2,3 [ CSSD]2013-05-23 16:02:16.577 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2698950) proc(0x26cdb30) pid(4358) version 11:1:1:4 [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26cdb30), client(1/0x261c780) [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c780) [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c780 with con 0x26cda50, requested num -1 [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c8f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:02:16.582 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:16.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c780) [ CSSD]2013-05-23 16:02:16.589 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c780), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:02:16.589 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269d820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:16.589 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269d820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:02:16.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:16.791 [1199044928] >TRACE: clssgmDeadProc: proc 0x26cdb30 [ CSSD]2013-05-23 16:02:16.791 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26cdb30) con(0x2698950) skgpid ospid 4358 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:16.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:16.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:17.441 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:18.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043c002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:18.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:18.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:18.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:20.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:20.761 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:20.761 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:20.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:20.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:21.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043d002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:21.266 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:21.266 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:21.266 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:21.266 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:21.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043e002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:21.273 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:21.273 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:22.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:22.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:22.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:24.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:24.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:24.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:25.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:25.764 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:26.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:26.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:26.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:27.465 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:28.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043f002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:28.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:29.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:29.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:30.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:30.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:30.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:31.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:31.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:31.824 [1199044928] >TRACE: clssgmAllocProc: (0x2698d00) allocated [ CSSD]2013-05-23 16:02:31.824 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:02:31.825 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d00 - 1,2,3 [ CSSD]2013-05-23 16:02:31.825 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x2698d00) pid(4532) version 11:1:1:4 [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2698d00), client(1/0x26cdbe0) [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdbe0) [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdbe0 with con 0x261c340, requested num -1 [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c8b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:02:31.841 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:31.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdbe0) [ CSSD]2013-05-23 16:02:31.848 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdbe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:02:31.848 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269d820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:31.848 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269d820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:02:32.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d00 [ CSSD]2013-05-23 16:02:32.051 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d00) con(0x26595a0) skgpid ospid 4532 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:32.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:33.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:33.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:34.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:35.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:35.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:35.769 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:35.769 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:36.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0440002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:36.515 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:36.515 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:36.515 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:36.516 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:36.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0441002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:36.522 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:36.523 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:36.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:37.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:37.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:37.485 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:38.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0442002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:39.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:39.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:39.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:40.772 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:40.772 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:41.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:41.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:41.159 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:43.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:43.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:43.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:45.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:45.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:45.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:45.775 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:45.775 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:47.078 [1199044928] >TRACE: clssgmAllocProc: (0x2698d00) allocated [ CSSD]2013-05-23 16:02:47.079 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:02:47.079 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d00 - 1,2,3 [ CSSD]2013-05-23 16:02:47.079 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x2698d00) pid(4700) version 11:1:1:4 [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2698d00), client(1/0x26cdbe0) [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26cdbe0) [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26cdbe0 with con 0x261c340, requested num -1 [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c8b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:02:47.086 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:47.092 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26cdbe0) [ CSSD]2013-05-23 16:02:47.092 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26cdbe0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:02:47.092 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269d820) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:02:47.092 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269d820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:02:47.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:47.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:47.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:47.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d00 [ CSSD]2013-05-23 16:02:47.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d00) con(0x26595a0) skgpid ospid 4700 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:02:47.507 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:48.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0443002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:49.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:49.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:49.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:49.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:49.777 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:02:51.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:51.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:51.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:51.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0444002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:51.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:02:51.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:02:51.765 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:02:51.765 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:02:51.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0445002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:51.772 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:02:51.772 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:02:53.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:53.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:53.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:54.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:54.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:02:55.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:55.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:55.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:56.285 [1199044928] >TRACE: clssgmAllocProc: (0x2698d00) allocated [ CSSD]2013-05-23 16:02:56.286 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:02:56.287 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2698d00 - 1,2,3 [ CSSD]2013-05-23 16:02:56.287 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26595a0) proc(0x2698d00) pid(4771/4771) version 11:1:1:4 [ CSSD]2013-05-23 16:02:56.292 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2698d00), client(1/0x261c5a0) [ CSSD]2013-05-23 16:02:56.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c5a0) [ CSSD]2013-05-23 16:02:56.292 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:02:56.292 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:02:57.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:57.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:57.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:57.528 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:02:58.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0446002c) incarnation(174631051) [ CSSD]2013-05-23 16:02:59.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:02:59.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:02:59.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:02:59.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:02:59.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 16:03:00.837 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42c8270) skgpid 843 ospid 843 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:01.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:01.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:01.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:02.336 [1199044928] >TRACE: clssgmAllocProc: (0x269e300) allocated [ CSSD]2013-05-23 16:03:02.337 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:03:02.337 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e300 - 1,2,3 [ CSSD]2013-05-23 16:03:02.337 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269d820) proc(0x269e300) pid(4865) version 11:1:1:4 [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x269e300), client(1/0x2678f90) [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2678f90) [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2678f90 with con 0x26788b0, requested num -1 [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267b2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:02.344 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:02.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2678f90) [ CSSD]2013-05-23 16:03:02.351 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2678f90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:03:02.351 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267b5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:02.351 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267b5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:02.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e300 [ CSSD]2013-05-23 16:03:02.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e300) con(0x269d820) skgpid ospid 4865 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:03.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:03.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:03.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:04.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:04.785 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:05.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:05.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:05.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:06.001 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 16:03:06.001 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:06.001 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:06.002 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:03:06.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:03:06.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42bea70) skgpid 30276 ospid 30276 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:07.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0447002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:07.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:03:07.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:03:07.025 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:03:07.025 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:07.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0448002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:07.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:03:07.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:03:07.178 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x2698d00), client(2/0x261ca20) [ CSSD]2013-05-23 16:03:07.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x261ca20) [ CSSD]2013-05-23 16:03:07.178 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:03:07.178 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:03:07.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:07.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:07.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:07.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:08.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0449002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:09.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:09.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:09.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:09.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:09.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:10.844 [1199044928] >TRACE: clssgmAllocProc: (0x267d610) allocated [ CSSD]2013-05-23 16:03:10.845 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:10.845 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d610 - 1,2,3 [ CSSD]2013-05-23 16:03:10.845 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267cf90) proc(0x267d610) pid(4973) version 11:1:1:4 [ CSSD]2013-05-23 16:03:10.850 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x267d610), client(1/0x261cb90) [ CSSD]2013-05-23 16:03:10.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 16:03:10.850 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb90 with con 0x269dfa0, requested num -1 [ CSSD]2013-05-23 16:03:10.850 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:10.850 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678ba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:03:10.851 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:10.851 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:10.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 16:03:10.856 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:03:10.856 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2678ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:10.856 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2678ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:11.058 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d610 [ CSSD]2013-05-23 16:03:11.058 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d610) con(0x267cf90) skgpid ospid 4973 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:11.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:11.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:11.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:12.721 [1199044928] >TRACE: clssgmAllocProc: (0x269e370) allocated [ CSSD]2013-05-23 16:03:12.722 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:12.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e370 - 1,2,3 [ CSSD]2013-05-23 16:03:12.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269dcf0) proc(0x269e370) pid(4769/4769) version 11:1:1:4 [ CSSD]2013-05-23 16:03:12.728 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269e370), client(1/0x261cb90) [ CSSD]2013-05-23 16:03:12.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 16:03:12.728 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:03:12.728 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:03:13.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:13.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:13.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:14.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044a002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:14.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:03:14.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:03:14.655 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:03:14.655 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:14.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044b002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:14.662 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:03:14.662 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:03:14.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:14.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:15.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:15.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:15.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:17.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:17.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:17.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:17.571 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:17.582 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ad0) allocated [ CSSD]2013-05-23 16:03:17.583 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:03:17.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ad0 - 1,2,3 [ CSSD]2013-05-23 16:03:17.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9ad0) pid(5089) version 11:1:1:4 [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9ad0), client(1/0x26b9fa0) [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9fa0) [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9fa0 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:17.589 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:17.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9fa0) [ CSSD]2013-05-23 16:03:17.596 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9fa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:03:17.596 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690be0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:17.596 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690be0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:17.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ad0 [ CSSD]2013-05-23 16:03:17.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ad0) con(0x2678ed0) skgpid ospid 5089 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:18.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044c002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:18.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:18.792 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:03:19.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:19.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:19.497 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:21.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:21.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:21.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:22.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044d002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:22.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:03:22.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:03:22.276 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:03:22.276 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:22.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044e002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:22.283 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:03:22.283 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:03:23.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:23.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:23.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:23.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:23.795 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:25.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:25.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:25.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:27.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:27.597 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:27.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:27.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:28.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044f002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:28.660 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ad0) allocated [ CSSD]2013-05-23 16:03:28.661 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:28.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ad0 - 1,2,3 [ CSSD]2013-05-23 16:03:28.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9ad0) pid(5396/5396) version 11:1:1:4 [ CSSD]2013-05-23 16:03:28.678 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9ad0), client(1/0x26905b0) [ CSSD]2013-05-23 16:03:28.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26905b0) [ CSSD]2013-05-23 16:03:28.678 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:03:28.678 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26905b0) [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26905b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26905b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ad0 [ CSSD]2013-05-23 16:03:28.713 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ad0) con(0x2678ed0) skgpid 5396 ospid 5396 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:28.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:28.798 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:28.905 [1199044928] >TRACE: clssgmAllocProc: (0x267c400) allocated [ CSSD]2013-05-23 16:03:28.906 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:28.906 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c400 - 1,2,3 [ CSSD]2013-05-23 16:03:28.906 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9f60) proc(0x267c400) pid(5399/5399) version 11:1:1:4 [ CSSD]2013-05-23 16:03:28.923 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x267c400), client(1/0x26b9c50) [ CSSD]2013-05-23 16:03:28.923 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9c50) [ CSSD]2013-05-23 16:03:28.923 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:03:28.923 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9c50) [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9c50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9c50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c400 [ CSSD]2013-05-23 16:03:28.968 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c400) con(0x26b9f60) skgpid 5399 ospid 5399 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:29.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:29.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:29.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:31.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:31.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:31.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:32.847 [1199044928] >TRACE: clssgmAllocProc: (0x26b9b50) allocated [ CSSD]2013-05-23 16:03:32.848 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:03:32.848 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9b50 - 1,2,3 [ CSSD]2013-05-23 16:03:32.848 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9b50) pid(5428) version 11:1:1:4 [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9b50), client(1/0x2690810) [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690810) [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690810 with con 0x26b9a10, requested num -1 [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2690980/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:32.854 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:32.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690810) [ CSSD]2013-05-23 16:03:32.861 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:03:32.861 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690c80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:32.861 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690c80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:33.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9b50 [ CSSD]2013-05-23 16:03:33.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9b50) con(0x2678ed0) skgpid ospid 5428 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:33.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:33.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:33.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:33.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:33.801 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:35.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:35.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:35.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:37.145 [1199044928] >TRACE: clssgmAllocProc: (0x26b9be0) allocated [ CSSD]2013-05-23 16:03:37.146 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:37.146 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9be0 - 1,2,3 [ CSSD]2013-05-23 16:03:37.146 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9be0) pid(5503) version 11:1:1:4 [ CSSD]2013-05-23 16:03:37.163 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9be0), client(1/0x2679070) [ CSSD]2013-05-23 16:03:37.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:03:37.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2679070 with con 0x26b9b00, requested num -1 [ CSSD]2013-05-23 16:03:37.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:03:37.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:03:37.164 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:37.164 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:37.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:03:37.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:03:37.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690be0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:03:37.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x2690be0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:37.279 [1199044928] >TRACE: clssgmAllocProc: (0x269b530) allocated [ CSSD]2013-05-23 16:03:37.280 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:37.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b530 - 1,2,3 [ CSSD]2013-05-23 16:03:37.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9ec0) proc(0x269b530) pid(5510) version 11:1:1:4 [ CSSD]2013-05-23 16:03:37.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:03:37.300 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:03:37.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:03:37.304 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b530 [ CSSD]2013-05-23 16:03:37.304 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b530) con(0x26b9ec0) skgpid ospid 5510 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:37.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9be0 [ CSSD]2013-05-23 16:03:37.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9be0) con(0x267d620) skgpid ospid 5503 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:37.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0450002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:37.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:03:37.535 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:03:37.535 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:03:37.535 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:37.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0451002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:37.542 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:03:37.543 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:03:37.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:37.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:37.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:37.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:38.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0452002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:38.803 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:38.803 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:39.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:39.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:39.758 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:41.155 [1199044928] >TRACE: clssgmAllocProc: (0x26b9be0) allocated [ CSSD]2013-05-23 16:03:41.156 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:03:41.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9be0 - 1,2,3 [ CSSD]2013-05-23 16:03:41.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9be0) pid(5563) version 11:1:1:4 [ CSSD]2013-05-23 16:03:41.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:41.611 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9be0 [ CSSD]2013-05-23 16:03:41.611 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9be0) con(0x267d620) skgpid ospid 5563 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:41.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:41.764 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:43.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:43.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:43.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:43.805 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:43.806 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:45.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:45.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:45.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:47.623 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:47.719 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:47.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:47.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:48.095 [1199044928] >TRACE: clssgmAllocProc: (0x26b9b50) allocated [ CSSD]2013-05-23 16:03:48.095 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:03:48.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9b50 - 1,2,3 [ CSSD]2013-05-23 16:03:48.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9b50) pid(5771) version 11:1:1:4 [ CSSD]2013-05-23 16:03:48.101 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26b9b50), client(1/0x2690810) [ CSSD]2013-05-23 16:03:48.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690810) [ CSSD]2013-05-23 16:03:48.101 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690810 with con 0x26b9a10, requested num -1 [ CSSD]2013-05-23 16:03:48.101 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:48.102 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2690980/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:03:48.102 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:03:48.102 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:48.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690810) [ CSSD]2013-05-23 16:03:48.109 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:03:48.109 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690c80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:03:48.109 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690c80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:03:48.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0453002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:48.311 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9b50 [ CSSD]2013-05-23 16:03:48.311 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9b50) con(0x2678ed0) skgpid ospid 5771 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:48.808 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:48.808 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:49.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:49.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:49.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:51.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:51.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:51.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:52.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0454002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:52.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:03:52.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:03:52.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:03:52.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:03:52.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0455002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:52.792 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:03:52.792 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:03:53.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42a2a00) [ CSSD]2013-05-23 16:03:53.178 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:03:53.178 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42a2a00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:03:53.178 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7bf0 [ CSSD]2013-05-23 16:03:53.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7bf0) con(0x7f82b42baac0) skgpid 31912 ospid 31912 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:53.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:53.811 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:53.811 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:53.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:53.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:55.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:03:55.554 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:03:55.554 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:03:55.554 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:03:55.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8320 [ CSSD]2013-05-23 16:03:55.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8320) con(0x7f82b42a1690) skgpid 762 ospid 762 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:03:55.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:55.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:55.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:57.739 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:03:57.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:57.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:57.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:03:58.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0456002c) incarnation(174631051) [ CSSD]2013-05-23 16:03:58.813 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:03:58.813 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:03:59.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:03:59.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:03:59.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:01.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:01.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:01.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:03.351 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ac0) allocated [ CSSD]2013-05-23 16:04:03.352 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:04:03.353 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ac0 - 1,2,3 [ CSSD]2013-05-23 16:04:03.353 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9ac0) pid(5946) version 11:1:1:4 [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9ac0), client(1/0x26b9f90) [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9f90) [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9f90 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:03.359 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:03.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9f90) [ CSSD]2013-05-23 16:04:03.366 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9f90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:04:03.366 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:03.366 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:03.568 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ac0 [ CSSD]2013-05-23 16:04:03.568 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ac0) con(0x2678ed0) skgpid ospid 5946 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:03.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:03.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:03.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:03.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:03.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:05.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:06.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:06.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:07.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:07.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:08.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0457002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:08.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:04:08.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:04:08.044 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:04:08.044 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:08.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0458002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:08.051 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:04:08.051 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:04:08.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:08.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:08.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0459002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:08.818 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:08.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:10.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:10.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:10.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:11.106 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 16:04:11.106 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:04:11.107 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 16:04:11.107 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9bd0) pid(6057) version 11:1:1:4 [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9bd0), client(1/0x2679070) [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b9b00, requested num -1 [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:11.114 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:11.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:11.121 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:04:11.121 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:11.121 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:11.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 16:04:11.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x267d620) skgpid ospid 6057 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:12.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:12.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:12.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:13.821 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:13.821 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:14.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:14.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:14.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:14.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045a002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:14.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:04:14.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:04:14.924 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:04:14.924 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:14.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045b002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:14.932 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:04:14.932 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:04:16.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:16.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:16.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:17.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:18.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:18.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:18.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:18.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045c002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:18.607 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 16:04:18.607 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:04:18.608 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 16:04:18.608 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9bd0) pid(6121) version 11:1:1:4 [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9bd0), client(1/0x2679070) [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b9b00, requested num -1 [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:18.624 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:18.631 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:18.631 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:04:18.631 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:18.631 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:18.824 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:18.824 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:18.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 16:04:18.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x267d620) skgpid ospid 6121 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:20.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:20.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:20.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:22.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:22.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:22.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:23.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045d002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:23.295 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:04:23.295 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:04:23.295 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:04:23.295 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:23.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045e002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:23.301 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:04:23.302 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:04:23.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:23.827 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:24.006 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ac0) allocated [ CSSD]2013-05-23 16:04:24.007 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:04:24.008 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ac0 - 1,2,3 [ CSSD]2013-05-23 16:04:24.008 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9ac0) pid(6209) version 11:1:1:4 [ CSSD]2013-05-23 16:04:24.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:24.127 [1199044928] >TRACE: clssgmAllocProc: (0x269b130) allocated [ CSSD]2013-05-23 16:04:24.128 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:04:24.128 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b130 - 1,2,3 [ CSSD]2013-05-23 16:04:24.128 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690990) proc(0x269b130) pid(6221) version 11:1:1:4 [ CSSD]2013-05-23 16:04:24.146 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:04:24.149 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:04:24.153 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b130 [ CSSD]2013-05-23 16:04:24.153 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b130) con(0x2690990) skgpid ospid 6221 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:24.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:24.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5341/0x26b9a00) [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5341 (0x26b9a00) [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26b9a00 with con 0x26b9d40, requested num -1 [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26908d0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:24.228 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:04:24.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5341 (0x26b9a00) [ CSSD]2013-05-23 16:04:24.234 [1199044928] >TRACE: clssgmExitGrock: client 5341 (0x26b9a00), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:04:24.234 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:04:24.234 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:24.236 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ac0 [ CSSD]2013-05-23 16:04:24.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ac0) con(0x2678ed0) skgpid ospid 6209 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:26.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:26.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:26.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:27.801 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:28.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:28.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:28.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:28.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045f002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:28.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:28.829 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:30.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:30.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:30.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:32.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:32.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:32.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:33.832 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:33.832 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:33.869 [1199044928] >TRACE: clssgmAllocProc: (0x26b9ac0) allocated [ CSSD]2013-05-23 16:04:33.869 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:04:33.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9ac0 - 1,2,3 [ CSSD]2013-05-23 16:04:33.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2678ed0) proc(0x26b9ac0) pid(6320) version 11:1:1:4 [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9ac0), client(1/0x26b9f90) [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9f90) [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9f90 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:33.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:33.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9f90) [ CSSD]2013-05-23 16:04:33.882 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9f90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:04:33.882 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:33.882 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:34.084 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9ac0 [ CSSD]2013-05-23 16:04:34.084 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9ac0) con(0x2678ed0) skgpid ospid 6320 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:34.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:34.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:34.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:36.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:36.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:36.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:37.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:37.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:37.834 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:04:38.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:38.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:38.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:38.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0460002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:38.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0461002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:38.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:04:38.544 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:04:38.544 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:04:38.544 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:38.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0462002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:38.552 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:04:38.552 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:04:40.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:40.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:40.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:42.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:42.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:42.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:42.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:42.837 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:44.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:44.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:44.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:46.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:46.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:46.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:47.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:47.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:47.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:48.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:48.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0463002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:48.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:48.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:49.117 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 16:04:49.118 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:04:49.119 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 16:04:49.119 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9bd0) pid(6471) version 11:1:1:4 [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9bd0), client(1/0x2679070) [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b9b00, requested num -1 [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:04:49.135 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:49.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:04:49.142 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:04:49.142 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690bd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:04:49.142 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690bd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:04:49.345 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 16:04:49.345 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x267d620) skgpid ospid 6471 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:04:50.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:50.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:50.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:52.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:52.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:52.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:52.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:52.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:53.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0464002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:53.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:04:53.805 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:04:53.805 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:04:53.805 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:04:53.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0465002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:53.812 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:04:53.812 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:04:54.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:54.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:54.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:56.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:56.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:56.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:04:57.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:04:57.845 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:04:57.886 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:04:58.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:04:58.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0466002c) incarnation(174631051) [ CSSD]2013-05-23 16:04:58.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:04:58.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:00.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:00.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:00.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:01.055 [1199044928] >TRACE: clssgmAllocProc: (0x26b9bd0) allocated [ CSSD]2013-05-23 16:05:01.056 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:05:01.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9bd0 - 1,2,3 [ CSSD]2013-05-23 16:05:01.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d620) proc(0x26b9bd0) pid(6620/6620) version 11:1:1:4 [ CSSD]2013-05-23 16:05:01.072 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9bd0), client(1/0x2679070) [ CSSD]2013-05-23 16:05:01.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:05:01.072 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:05:01.072 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:05:01.847 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:01.848 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:05:02.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:02.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:02.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:04.381 [1199044928] >TRACE: clssgmAllocProc: (0x269b310) allocated [ CSSD]2013-05-23 16:05:04.382 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:05:04.383 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b310 - 1,2,3 [ CSSD]2013-05-23 16:05:04.383 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9f60) proc(0x269b310) pid(6660) version 11:1:1:4 [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b310), client(1/0x26ed5f0) [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed5f0) [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed5f0 with con 0x269b240, requested num -1 [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed760/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:05:04.399 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:04.406 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed5f0) [ CSSD]2013-05-23 16:05:04.406 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed5f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:05:04.406 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eda60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:04.406 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eda60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:05:04.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:04.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:04.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:04.609 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b310 [ CSSD]2013-05-23 16:05:04.609 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b310) con(0x26b9f60) skgpid ospid 6660 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:04.992 [1199044928] >TRACE: clssgmAllocProc: (0x269b200) allocated [ CSSD]2013-05-23 16:05:04.993 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:05:04.993 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b200 - 1,2,3 [ CSSD]2013-05-23 16:05:04.993 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690a70) proc(0x269b200) pid(6709/6709) version 11:1:1:4 [ CSSD]2013-05-23 16:05:05.010 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b200), client(1/0x26ed470) [ CSSD]2013-05-23 16:05:05.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ed470) [ CSSD]2013-05-23 16:05:05.010 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:05:05.010 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ed470) [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ed470), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ed470), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b200 [ CSSD]2013-05-23 16:05:05.306 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b200) con(0x2690a70) skgpid 6709 ospid 6709 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:05.837 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269e370), client(2/0x269b690) [ CSSD]2013-05-23 16:05:05.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x269b690) [ CSSD]2013-05-23 16:05:05.837 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:05:05.837 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:05:06.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:06.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:06.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:06.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:06.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:07.906 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:08.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0467002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:08.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:08.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:08.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:09.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0468002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:09.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:05:09.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:05:09.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:05:09.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:09.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0469002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:09.075 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:05:09.075 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:05:10.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:10.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:10.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:11.363 [1199044928] >TRACE: clssgmAllocProc: (0x269b260) allocated [ CSSD]2013-05-23 16:05:11.364 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:05:11.365 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b260 - 1,2,3 [ CSSD]2013-05-23 16:05:11.365 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690da0) proc(0x269b260) pid(6753) version 11:1:1:4 [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x269b260), client(1/0x26ed9e0) [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed9e0) [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed9e0 with con 0x269b390, requested num -1 [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edb50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:05:11.372 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:11.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed9e0) [ CSSD]2013-05-23 16:05:11.380 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed9e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:05:11.380 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ede50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:11.380 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ede50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:05:11.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b260 [ CSSD]2013-05-23 16:05:11.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b260) con(0x2690da0) skgpid ospid 6753 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:11.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:11.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:12.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:12.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:12.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:14.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:14.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:14.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:15.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046a002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:15.179 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:05:15.179 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:05:15.179 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:05:15.179 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:15.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046b002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:15.186 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:05:15.186 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:05:16.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:16.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:16.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:16.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:16.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:17.929 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:18.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046c002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:18.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:18.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:18.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:18.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:05:18.913 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:05:18.913 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:05:18.913 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:05:18.914 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42825e0 [ CSSD]2013-05-23 16:05:18.914 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42825e0) con(0x7f82b4257120) skgpid 717 ospid 717 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:19.647 [1199044928] >TRACE: clssgmAllocProc: (0x269b260) allocated [ CSSD]2013-05-23 16:05:19.648 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:05:19.648 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b260 - 1,2,3 [ CSSD]2013-05-23 16:05:19.648 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690da0) proc(0x269b260) pid(6821) version 11:1:1:4 [ CSSD]2013-05-23 16:05:19.654 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269b260), client(1/0x26ed9e0) [ CSSD]2013-05-23 16:05:19.654 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ed9e0) [ CSSD]2013-05-23 16:05:19.654 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ed9e0 with con 0x269b390, requested num -1 [ CSSD]2013-05-23 16:05:19.654 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:19.654 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edb50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:05:19.655 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:05:19.655 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:19.661 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ed9e0) [ CSSD]2013-05-23 16:05:19.661 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ed9e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:05:19.661 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ede50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:19.661 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ede50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:05:19.864 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b260 [ CSSD]2013-05-23 16:05:19.864 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b260) con(0x2690da0) skgpid ospid 6821 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:20.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:20.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:20.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:21.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:21.860 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:22.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:22.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:22.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:24.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046d002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:24.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:05:24.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:05:24.317 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:05:24.318 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:24.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046e002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:24.325 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:05:24.325 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:05:24.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:24.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:24.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:25.862 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:25.863 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:05:26.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:26.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:26.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:27.951 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:28.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046f002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:28.824 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:28.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:28.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:30.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:30.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:30.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:30.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:30.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:31.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:05:31.116 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2679070), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:05:31.116 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2679070), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:05:31.116 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:05:31.117 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9bd0 [ CSSD]2013-05-23 16:05:31.117 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9bd0) con(0x267d620) skgpid 6620 ospid 6620 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:32.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:32.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:32.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:34.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:34.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:34.897 [1199044928] >TRACE: clssgmAllocProc: (0x267c040) allocated [ CSSD]2013-05-23 16:05:34.898 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:05:34.899 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c040 - 1,2,3 [ CSSD]2013-05-23 16:05:34.899 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f20) proc(0x267c040) pid(6968) version 11:1:1:4 [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x267c040), client(1/0x267c490) [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c490) [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c490 with con 0x267bf80, requested num -1 [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:05:34.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:34.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c490) [ CSSD]2013-05-23 16:05:34.912 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:05:34.912 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9b90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:34.913 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9b90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:05:34.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:35.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c040 [ CSSD]2013-05-23 16:05:35.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c040) con(0x2690f20) skgpid ospid 6968 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:35.869 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:35.869 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:36.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:36.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:36.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:37.972 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:38.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0470002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:38.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:38.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:38.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:39.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0471002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:39.568 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:05:39.568 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:05:39.568 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:05:39.569 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:39.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0472002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:39.576 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:05:39.576 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:05:40.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:40.872 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:40.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:40.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:40.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:42.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:42.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:42.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:44.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:44.874 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:05:45.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:45.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:45.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:47.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:47.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:47.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:47.996 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:48.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0473002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:49.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:49.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:49.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:49.877 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:49.877 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:50.149 [1199044928] >TRACE: clssgmAllocProc: (0x267c040) allocated [ CSSD]2013-05-23 16:05:50.150 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:05:50.151 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c040 - 1,2,3 [ CSSD]2013-05-23 16:05:50.151 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f20) proc(0x267c040) pid(7130) version 11:1:1:4 [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x267c040), client(1/0x267c490) [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c490) [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c490 with con 0x267bf80, requested num -1 [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9890/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:05:50.158 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:50.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c490) [ CSSD]2013-05-23 16:05:50.165 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:05:50.165 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9b90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:05:50.165 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9b90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:05:50.368 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c040 [ CSSD]2013-05-23 16:05:50.368 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c040) con(0x2690f20) skgpid ospid 7130 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:05:51.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:51.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:51.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:53.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:53.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:53.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:54.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0474002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:54.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:05:54.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:05:54.817 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:05:54.818 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:05:54.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0475002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:54.824 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:05:54.824 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:05:54.880 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:54.880 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:05:55.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:55.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:55.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:57.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:57.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:57.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:58.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:05:58.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0476002c) incarnation(174631051) [ CSSD]2013-05-23 16:05:59.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:05:59.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:05:59.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:05:59.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:05:59.883 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:01.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:01.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:01.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:03.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:03.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:03.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:04.619 [1199044928] >TRACE: clssgmAllocProc: (0x267c040) allocated [ CSSD]2013-05-23 16:06:04.620 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:06:04.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267c040 - 1,2,3 [ CSSD]2013-05-23 16:06:04.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690f20) proc(0x267c040) pid(6819/6819) version 11:1:1:4 [ CSSD]2013-05-23 16:06:04.637 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x267c040), client(1/0x267c540) [ CSSD]2013-05-23 16:06:04.637 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267c540) [ CSSD]2013-05-23 16:06:04.637 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:06:04.637 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:06:04.886 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:04.886 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:05.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:05.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:05.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:05.402 [1199044928] >TRACE: clssgmAllocProc: (0x26ed470) allocated [ CSSD]2013-05-23 16:06:05.403 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:06:05.403 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed470 - 1,2,3 [ CSSD]2013-05-23 16:06:05.403 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9720) proc(0x26ed470) pid(7274) version 11:1:1:4 [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26ed470), client(1/0x26eda50) [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eda50) [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eda50 with con 0x267c490, requested num -1 [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edbc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:06:05.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:05.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eda50) [ CSSD]2013-05-23 16:06:05.417 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eda50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:06:05.417 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edec0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:05.417 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edec0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:06:05.619 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed470 [ CSSD]2013-05-23 16:06:05.619 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed470) con(0x26b9720) skgpid ospid 7274 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:07.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:07.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:07.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:08.038 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:08.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0477002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:08.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:08.889 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:06:09.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:09.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:09.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:10.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0478002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:10.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:10.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:10.067 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:06:10.067 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:10.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0479002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:10.074 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:10.074 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:11.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:11.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:11.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:11.622 [1199044928] >TRACE: clssgmAllocProc: (0x26ed470) allocated [ CSSD]2013-05-23 16:06:11.623 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:06:11.624 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed470 - 1,2,3 [ CSSD]2013-05-23 16:06:11.624 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9720) proc(0x26ed470) pid(7357) version 11:1:1:4 [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26ed470), client(1/0x26eda50) [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26eda50) [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26eda50 with con 0x267c490, requested num -1 [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edbc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:06:11.630 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:11.637 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26eda50) [ CSSD]2013-05-23 16:06:11.637 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26eda50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:06:11.637 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26edec0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:11.637 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26edec0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:06:11.839 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed470 [ CSSD]2013-05-23 16:06:11.839 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed470) con(0x26b9720) skgpid ospid 7357 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:13.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:13.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:13.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:13.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:13.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:14.648 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x267c040), client(2/0x267c480) [ CSSD]2013-05-23 16:06:14.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x267c480) [ CSSD]2013-05-23 16:06:14.648 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:06:14.648 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 16:06:15.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:15.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:15.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:15.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047a002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:15.437 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:15.437 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:15.437 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:06:15.437 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:15.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047b002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:15.444 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:15.444 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:15.954 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:06:15.955 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:06:15.955 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:06:15.955 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(7392/7392) version 11:1:1:4 [ CSSD]2013-05-23 16:06:15.971 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb6e0) [ CSSD]2013-05-23 16:06:15.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bb6e0) [ CSSD]2013-05-23 16:06:15.971 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:06:15.971 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:06:15.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bb6e0) [ CSSD]2013-05-23 16:06:15.989 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bb6e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:06:15.989 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bb6e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:06:15.989 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:06:15.990 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:06:15.990 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid 7392 ospid 7392 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:16.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047c002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:16.297 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:16.297 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:16.297 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:06:16.297 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:16.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047d002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:16.304 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:16.304 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:16.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:06:16.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:06:16.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:06:16.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:06:17.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:17.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:17.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:18.059 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:18.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047e002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:18.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:18.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:19.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:19.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:19.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:20.653 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:06:20.654 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:06:20.654 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:06:20.654 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(7427) version 11:1:1:4 [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:06:20.660 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:20.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:20.667 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:06:20.667 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:20.668 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:06:20.870 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:06:20.870 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 7427 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:21.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:21.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:21.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:23.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:23.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:23.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:23.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:23.899 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:25.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047f002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:25.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:25.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:25.317 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:06:25.317 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:25.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0480002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:25.324 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:25.324 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:25.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:25.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:25.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:27.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:27.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:27.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:27.901 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:27.902 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:06:28.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:28.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0481002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:29.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:29.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:29.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:31.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:31.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:31.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:32.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:32.905 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:33.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:33.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:33.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:35.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:35.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:35.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:35.904 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:06:35.905 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:06:35.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:06:35.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(7570) version 11:1:1:4 [ CSSD]2013-05-23 16:06:35.911 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:06:35.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:35.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:06:35.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:35.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:06:35.912 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:06:35.912 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:35.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:35.919 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:06:35.919 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:35.919 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:06:36.122 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:06:36.122 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 7570 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:37.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:37.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:37.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:37.908 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:37.908 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:38.104 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:38.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0482002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:39.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:39.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:39.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:40.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0483002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:40.577 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:40.577 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:40.577 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:06:40.577 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:40.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0484002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:40.584 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:40.584 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:41.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:41.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:41.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:42.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:42.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:43.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:43.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:43.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:45.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:45.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:45.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:46.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:46.914 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:06:47.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:47.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:47.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:48.135 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:48.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0485002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:49.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:49.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:49.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:51.156 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:06:51.157 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:06:51.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:06:51.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(7746) version 11:1:1:4 [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:06:51.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:51.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:06:51.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:06:51.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:06:51.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:06:51.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:06:51.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 7746 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:06:51.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:51.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:51.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:51.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:51.917 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:53.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:53.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:53.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:55.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:55.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:55.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:55.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0486002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:55.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:06:55.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:06:55.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:06:55.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:06:55.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0487002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:55.845 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:06:55.845 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:06:56.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:06:56.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:06:57.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:57.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:57.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:06:58.172 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:06:58.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0488002c) incarnation(174631051) [ CSSD]2013-05-23 16:06:59.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:06:59.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:06:59.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:01.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:01.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:01.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:01.923 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:01.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:03.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:03.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:03.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:05.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:05.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:05.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:05.926 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:05.926 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:07:06.416 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:06.417 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:07:06.417 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:06.417 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(7897) version 11:1:1:4 [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:06.434 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:06.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:06.442 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:06.442 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:06.442 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:06.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:06.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 7897 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:07.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:07.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:07.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:08.194 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:08.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0489002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:09.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:09.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:09.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:10.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:10.929 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:11.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048a002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:11.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:11.087 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:11.087 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:07:11.087 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:11.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048b002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:11.094 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:11.095 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:11.518 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:11.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:07:11.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:11.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(8021) version 11:1:1:4 [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb850) [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb850) [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb850 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:11.525 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:11.531 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb850) [ CSSD]2013-05-23 16:07:11.531 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb850), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:11.531 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:11.532 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:11.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:11.734 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:11.734 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 8021 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:11.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:11.877 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:11.883 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:11.884 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:07:11.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:11.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(8065) version 11:1:1:4 [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb7c0) [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb7c0) [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb7c0 with con 0x269b390, requested num -1 [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb930/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:11.891 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:11.892 [1199044928] >TRACE: clssgmAllocProc: (0x26edec0) allocated [ CSSD]2013-05-23 16:07:11.892 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:07:11.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edec0 - 1,2,3 [ CSSD]2013-05-23 16:07:11.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26baf80) proc(0x26edec0) pid(8018) version 11:1:1:4 [ CSSD]2013-05-23 16:07:11.899 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb7c0) [ CSSD]2013-05-23 16:07:11.899 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb7c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:11.899 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbc30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:11.899 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbc30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:12.102 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:12.102 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 8065 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:13.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:13.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:13.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:14.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edec0 [ CSSD]2013-05-23 16:07:14.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edec0) con(0x26baf80) skgpid ospid 8018 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:14.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:07:14.872 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:07:14.873 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:07:14.874 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:07:15.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048c002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:15.038 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:15.038 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:15.038 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:07:15.038 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:07:15.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048d002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:15.045 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:15.045 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:15.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048e002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:15.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:15.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:15.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:07:15.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:15.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048f002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:15.702 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:15.702 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:15.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:15.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:15.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:15.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:15.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:17.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:17.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:17.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:18.216 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:18.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0490002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:19.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:19.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:19.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:20.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:20.936 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:21.684 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:21.686 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:07:21.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:21.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(8421) version 11:1:1:4 [ CSSD]2013-05-23 16:07:21.703 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:07:21.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:21.703 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:07:21.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:21.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:21.704 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:21.704 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:21.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:21.710 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:21.710 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:21.710 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:21.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:21.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:21.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 8421 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:21.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:21.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:23.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:23.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:23.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:24.939 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:24.940 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:07:25.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:26.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:26.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:26.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0491002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:26.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:26.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:26.345 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:07:26.345 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:26.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0492002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:26.351 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:26.352 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:27.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:28.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:28.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:28.238 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:28.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0493002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:29.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:29.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:29.943 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:30.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:30.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:31.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:32.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:32.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:33.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:34.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:34.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:34.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:34.946 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:35.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:36.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:36.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:36.946 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:36.947 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:07:36.948 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:36.948 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(8574) version 11:1:1:4 [ CSSD]2013-05-23 16:07:36.953 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:07:36.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:36.953 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:07:36.953 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:36.953 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:36.954 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:36.954 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:36.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:36.960 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:36.960 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:36.960 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:37.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:37.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 8574 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:37.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:38.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:38.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:38.260 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:38.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0494002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:39.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:39.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:39.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:40.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:40.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:41.047 [1199044928] >TRACE: clssgmAllocProc: (0x26bb100) allocated [ CSSD]2013-05-23 16:07:41.048 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:07:41.049 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb100 - 1,2,3 [ CSSD]2013-05-23 16:07:41.049 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x26bb100) pid(8654) version 11:1:1:4 [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26bb100), client(1/0x26bb870) [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb870 with con 0x26bb030, requested num -1 [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb9e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:41.055 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:41.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb870) [ CSSD]2013-05-23 16:07:41.062 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:41.062 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26baeb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:41.062 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26baeb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:41.264 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb100 [ CSSD]2013-05-23 16:07:41.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb100) con(0x26b98b0) skgpid ospid 8654 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:41.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0495002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:41.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:41.594 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:41.594 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:07:41.594 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:41.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0496002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:41.602 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:41.602 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:41.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:42.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:42.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:43.952 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:43.952 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:07:44.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:44.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:44.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:46.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:46.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:46.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:48.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:48.280 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:48.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:48.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:48.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0497002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:48.938 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4282940) [ CSSD]2013-05-23 16:07:48.938 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4282940), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:07:48.938 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4282940), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42d8550) skgpid 2722 ospid 2722 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26e8a80) [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26e8a80), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26e8a80), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:07:48.939 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a69a0 [ CSSD]2013-05-23 16:07:48.941 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a69a0) con(0x26ef170) skgpid 2720 ospid 2720 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:48.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:48.956 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:50.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:50.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:50.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:52.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:52.198 [1199044928] >TRACE: clssgmAllocProc: (0x261bac0) allocated [ CSSD]2013-05-23 16:07:52.198 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:07:52.199 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bac0 - 1,2,3 [ CSSD]2013-05-23 16:07:52.199 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x261bac0) pid(8744) version 11:1:1:4 [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bac0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26a6a10, requested num -1 [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:07:52.205 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:52.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:07:52.212 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:07:52.212 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fa40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:07:52.212 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fa40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:07:52.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:52.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:52.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bac0 [ CSSD]2013-05-23 16:07:52.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bac0) con(0x26b98b0) skgpid ospid 8744 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:07:53.959 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:53.959 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:07:54.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:54.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:54.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:56.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:56.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:56.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:56.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0498002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:56.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:07:56.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:07:56.846 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:07:56.846 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:07:56.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0499002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:56.852 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:07:56.852 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:07:58.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:07:58.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:07:58.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:07:58.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:07:58.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049a002c) incarnation(174631051) [ CSSD]2013-05-23 16:07:58.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:07:58.963 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:00.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:00.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:00.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:01.258 [1199044928] >TRACE: clssgmAllocProc: (0x261bac0) allocated [ CSSD]2013-05-23 16:08:01.258 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:01.259 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bac0 - 1,2,3 [ CSSD]2013-05-23 16:08:01.259 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b98b0) proc(0x261bac0) pid(8943/8943) version 11:1:1:4 [ CSSD]2013-05-23 16:08:01.275 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bac0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:08:01.275 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:08:01.275 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:08:01.275 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:08:02.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:02.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:02.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:02.965 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:02.965 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:08:04.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:04.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:04.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:06.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:06.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:06.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:07.448 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 16:08:07.449 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:08:07.450 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 16:08:07.450 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x269b300) pid(8990) version 11:1:1:4 [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b300), client(1/0x26e8e90) [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8e90 with con 0x269b240, requested num -1 [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb3f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:07.456 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:07.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:07.462 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8e90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:08:07.462 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bb6f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:07.462 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bb6f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:07.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 16:08:07.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26a6a20) skgpid ospid 8990 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:07.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:07.968 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:08.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:08.322 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:08.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:08.510 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:08.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049b002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:10.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:10.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:10.516 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:12.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049c002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:12.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:08:12.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:08:12.094 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:08:12.094 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:12.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049d002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:12.100 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:08:12.101 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:08:12.138 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 16:08:12.139 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:12.140 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 16:08:12.140 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x269b300) pid(9074) version 11:1:1:4 [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b300), client(1/0x26e8e90) [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8e90 with con 0x269b240, requested num -1 [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb3f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:12.146 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:12.153 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:12.153 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8e90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:08:12.153 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bb6f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:12.154 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bb6f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:12.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:12.356 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 16:08:12.356 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26a6a20) skgpid ospid 9074 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:12.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:12.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:12.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:12.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:14.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:14.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:14.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:15.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049e002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:15.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:08:15.954 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:08:15.954 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:08:15.954 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:15.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049f002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:15.960 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:08:15.960 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:08:16.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:16.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:16.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:17.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:17.975 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:18.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:18.345 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:18.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:18.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:18.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a0002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:20.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:20.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:20.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:21.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:21.978 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:08:22.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:22.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:22.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:22.699 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 16:08:22.700 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:08:22.700 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 16:08:22.700 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x269b300) pid(9147) version 11:1:1:4 [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b300), client(1/0x26e8e90) [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8e90 with con 0x269b240, requested num -1 [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb3f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:22.707 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:22.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:22.714 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8e90), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:08:22.714 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bb6f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:22.714 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bb6f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:22.917 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 16:08:22.917 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26a6a20) skgpid ospid 9147 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:24.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:24.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:24.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:26.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:26.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:26.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:26.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:26.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:27.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a1002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:27.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:08:27.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:08:27.355 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:08:27.355 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:27.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a2002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:27.362 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:08:27.363 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:08:28.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:28.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:28.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:28.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:28.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a3002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:30.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:30.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:30.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:31.984 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:31.985 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:32.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:32.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:32.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:34.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:34.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:34.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:36.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:36.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:36.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:36.987 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:36.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:37.450 [1199044928] >TRACE: clssgmAllocProc: (0x269b300) allocated [ CSSD]2013-05-23 16:08:37.451 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:37.451 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b300 - 1,2,3 [ CSSD]2013-05-23 16:08:37.451 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x269b300) pid(9299) version 11:1:1:4 [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b300), client(1/0x26e8e90) [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26e8e90 with con 0x269b240, requested num -1 [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26bb3f0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:37.458 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:37.464 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8e90) [ CSSD]2013-05-23 16:08:37.464 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8e90), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:08:37.464 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bb6f0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:08:37.464 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26bb6f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:37.571 [1199044928] >TRACE: clssgmAllocProc: (0x26edda0) allocated [ CSSD]2013-05-23 16:08:37.572 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:37.572 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edda0 - 1,2,3 [ CSSD]2013-05-23 16:08:37.572 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb350) proc(0x26edda0) pid(9304) version 11:1:1:4 [ CSSD]2013-05-23 16:08:37.588 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:08:37.590 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:08:37.591 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:08:37.593 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edda0 [ CSSD]2013-05-23 16:08:37.593 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edda0) con(0x26bb350) skgpid ospid 9304 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:37.667 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b300 [ CSSD]2013-05-23 16:08:37.667 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b300) con(0x26a6a20) skgpid ospid 9299 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:37.950 [1199044928] >TRACE: clssgmAllocProc: (0x26bb730) allocated [ CSSD]2013-05-23 16:08:37.951 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:08:37.952 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb730 - 1,2,3 [ CSSD]2013-05-23 16:08:37.952 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x26bb730) pid(9310) version 11:1:1:4 [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb730), client(1/0x269acf0) [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269acf0) [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269acf0 with con 0x26bb670, requested num -1 [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269ae60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:37.958 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:37.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269acf0) [ CSSD]2013-05-23 16:08:37.965 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269acf0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:08:37.965 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b160) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:37.965 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b160) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:38.167 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb730 [ CSSD]2013-05-23 16:08:38.167 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb730) con(0x26a6a20) skgpid ospid 9310 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:38.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:38.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:38.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:38.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:38.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a4002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:40.255 [1199044928] >TRACE: clssgmAllocProc: (0x269b270) allocated [ CSSD]2013-05-23 16:08:40.256 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:40.257 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b270 - 1,2,3 [ CSSD]2013-05-23 16:08:40.257 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x269b270) pid(9381/9381) version 11:1:1:4 [ CSSD]2013-05-23 16:08:40.272 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b270), client(1/0x269b3a0) [ CSSD]2013-05-23 16:08:40.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269b3a0) [ CSSD]2013-05-23 16:08:40.272 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:08:40.272 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:08:40.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269b3a0) [ CSSD]2013-05-23 16:08:40.285 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269b3a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:08:40.285 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269b3a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:08:40.285 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:08:40.286 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b270 [ CSSD]2013-05-23 16:08:40.286 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b270) con(0x26a6a20) skgpid 9381 ospid 9381 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:40.431 [1199044928] >TRACE: clssgmAllocProc: (0x26e8de0) allocated [ CSSD]2013-05-23 16:08:40.431 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:40.432 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8de0 - 1,2,3 [ CSSD]2013-05-23 16:08:40.432 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a6a20) proc(0x26e8de0) pid(9425/9425) version 11:1:1:4 [ CSSD]2013-05-23 16:08:40.437 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e8de0), client(1/0x26bb150) [ CSSD]2013-05-23 16:08:40.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bb150) [ CSSD]2013-05-23 16:08:40.437 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:08:40.437 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:08:40.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:40.625 [1199044928] >TRACE: clssgmAllocProc: (0x26ede70) allocated [ CSSD]2013-05-23 16:08:40.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:40.626 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ede70 - 1,2,3 [ CSSD]2013-05-23 16:08:40.626 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb980) proc(0x26ede70) pid(9397) version 11:1:1:4 [ CSSD]2013-05-23 16:08:40.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:40.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:41.223 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ede70 [ CSSD]2013-05-23 16:08:41.223 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ede70) con(0x26bb980) skgpid ospid 9397 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:41.990 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:41.990 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:42.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:42.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a5002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:42.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:08:42.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:08:42.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:08:42.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:42.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a6002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:42.635 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:08:42.635 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:08:42.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:42.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:44.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:44.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:44.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:45.993 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:45.993 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:08:46.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:46.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:46.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:48.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:48.558 [1199044928] >TRACE: clssgmAllocProc: (0x26edda0) allocated [ CSSD]2013-05-23 16:08:48.559 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:08:48.560 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edda0 - 1,2,3 [ CSSD]2013-05-23 16:08:48.560 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb850) proc(0x26edda0) pid(8720/8720) version 11:1:1:4 [ CSSD]2013-05-23 16:08:48.565 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26edda0), client(1/0x26ee270) [ CSSD]2013-05-23 16:08:48.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:08:48.565 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:08:48.565 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:08:48.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:48.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:48.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:49.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a7002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:50.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:50.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:50.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:50.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:50.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:52.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:52.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:52.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:53.210 [1199044928] >TRACE: clssgmAllocProc: (0x26aabf0) allocated [ CSSD]2013-05-23 16:08:53.211 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:08:53.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aabf0 - 1,2,3 [ CSSD]2013-05-23 16:08:53.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a97d0) proc(0x26aabf0) pid(9670) version 11:1:1:4 [ CSSD]2013-05-23 16:08:53.217 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aabf0), client(1/0x2681800) [ CSSD]2013-05-23 16:08:53.217 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2681800) [ CSSD]2013-05-23 16:08:53.217 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2681800 with con 0x26aaac0, requested num -1 [ CSSD]2013-05-23 16:08:53.217 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:53.217 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681970/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:08:53.218 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:08:53.218 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:53.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2681800) [ CSSD]2013-05-23 16:08:53.223 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2681800), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:08:53.223 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681c70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:08:53.224 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681c70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:08:53.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x268b340) [ CSSD]2013-05-23 16:08:53.261 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x268b340), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:08:53.261 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x268b340), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:08:53.261 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e87b0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e87b0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:08:53.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x266f0d0) skgpid 3387 ospid 3387 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:53.426 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aabf0 [ CSSD]2013-05-23 16:08:53.426 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aabf0) con(0x26a97d0) skgpid ospid 9670 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:08:54.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:54.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:54.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:55.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:08:56.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:08:56.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:56.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:56.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:57.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a8002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:57.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:08:57.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:08:57.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:08:57.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:08:57.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a9002c) incarnation(174631051) [ CSSD]2013-05-23 16:08:57.900 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:08:57.900 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:08:58.423 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:08:58.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:08:59.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:08:59.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:08:59.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04aa002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:00.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:01.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:01.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:01.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:01.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:02.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:03.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:03.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:04.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:05.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:05.005 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:09:05.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:05.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:06.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:07.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:07.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:08.459 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 16:09:08.460 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:09:08.461 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 16:09:08.461 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e4d00) pid(9843) version 11:1:1:4 [ CSSD]2013-05-23 16:09:08.467 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e4d00), client(1/0x268b410) [ CSSD]2013-05-23 16:09:08.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:08.467 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:08.467 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:08.468 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:09:08.468 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:08.468 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:08.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:08.475 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:09:08.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:08.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:08.484 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:08.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 16:09:08.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x266f0d0) skgpid ospid 9843 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:08.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:09.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ab002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:09.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:09.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:10.008 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:10.008 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:10.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:11.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:11.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:12.401 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 16:09:12.403 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:09:12.403 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 16:09:12.403 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e4d00) pid(9914) version 11:1:1:4 [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e4d00), client(1/0x268b410) [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:12.410 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:12.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:12.416 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:09:12.416 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:12.417 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:12.619 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 16:09:12.619 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x266f0d0) skgpid ospid 9914 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:12.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:13.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:13.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:13.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ac002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:13.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:09:13.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:09:13.149 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:09:13.149 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:13.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ad002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:13.156 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:09:13.156 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:09:14.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:15.011 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:15.011 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:15.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:15.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:16.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ae002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:16.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:09:16.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:09:16.224 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:09:16.224 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:16.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04af002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:16.232 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:09:16.232 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:09:16.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:17.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:17.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:18.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:18.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:19.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b0002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:19.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:19.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:20.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:20.015 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:20.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:21.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:21.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:22.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:23.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:23.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:23.712 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 16:09:23.712 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:09:23.713 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 16:09:23.713 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e4d00) pid(10000) version 11:1:1:4 [ CSSD]2013-05-23 16:09:23.718 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e4d00), client(1/0x268b410) [ CSSD]2013-05-23 16:09:23.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:23.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:23.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:23.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:09:23.719 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:23.719 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:23.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:23.724 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:09:23.724 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:23.724 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:23.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 16:09:23.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x266f0d0) skgpid ospid 10000 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:24.017 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:24.017 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:09:24.309 [1199044928] >TRACE: clssgmAllocProc: (0x26b6a30) allocated [ CSSD]2013-05-23 16:09:24.310 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:09:24.311 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6a30 - 1,2,3 [ CSSD]2013-05-23 16:09:24.311 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26b6a30) pid(10044) version 11:1:1:4 [ CSSD]2013-05-23 16:09:24.428 [1199044928] >TRACE: clssgmAllocProc: (0x26a98a0) allocated [ CSSD]2013-05-23 16:09:24.429 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:09:24.430 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a98a0 - 1,2,3 [ CSSD]2013-05-23 16:09:24.430 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e87a0) proc(0x26a98a0) pid(10058) version 11:1:1:4 [ CSSD]2013-05-23 16:09:24.446 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:09:24.448 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:09:24.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a98a0 [ CSSD]2013-05-23 16:09:24.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a98a0) con(0x26e87a0) skgpid ospid 10058 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5342/0x268b410) [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5342 (0x268b410) [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26a97d0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:24.534 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:09:24.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5342 (0x268b410) [ CSSD]2013-05-23 16:09:24.541 [1199044928] >TRACE: clssgmExitGrock: client 5342 (0x268b410), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:09:24.541 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:09:24.541 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:24.543 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6a30 [ CSSD]2013-05-23 16:09:24.543 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6a30) con(0x266f0d0) skgpid ospid 10044 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:24.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:25.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:25.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:26.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:27.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:27.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:28.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b1002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:28.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:09:28.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:09:28.397 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:09:28.397 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:28.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b2002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:28.404 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:09:28.404 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:09:28.525 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:29.020 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:29.020 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:29.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:29.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b3002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:29.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:29.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:31.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:31.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:31.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:33.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:33.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:33.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:34.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:34.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:35.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:35.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:35.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:37.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:37.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:37.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:38.544 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:38.967 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:09:38.968 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:09:38.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:09:38.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10197) version 11:1:1:4 [ CSSD]2013-05-23 16:09:38.984 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x268c1a0), client(1/0x268b410) [ CSSD]2013-05-23 16:09:38.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:38.984 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:38.984 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:38.984 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:09:38.985 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:38.985 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:38.991 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:38.991 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:09:38.991 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:38.991 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:39.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:39.027 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:39.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b4002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:39.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:39.193 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:09:39.193 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid ospid 10197 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:39.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:39.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:41.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:41.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:41.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:43.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:43.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:43.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:43.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b5002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:43.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:09:43.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:09:43.652 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:09:43.652 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:43.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b6002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:43.660 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:09:43.660 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:09:44.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:44.030 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:45.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:45.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:45.410 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:47.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:47.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:47.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:48.564 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:49.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:49.032 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:49.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b7002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:49.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:49.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:49.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:51.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:51.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:51.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:53.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:53.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:53.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:54.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:54.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:54.227 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:09:54.228 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:09:54.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:09:54.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10365) version 11:1:1:4 [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x268c1a0), client(1/0x268b410) [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a97d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:09:54.235 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:54.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:09:54.241 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:09:54.241 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:09:54.241 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:09:54.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:09:54.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid ospid 10365 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:09:55.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:55.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:55.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:57.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:57.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:57.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:09:58.585 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:09:58.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b8002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:58.907 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:09:58.907 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:09:58.907 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:09:58.907 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:09:58.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b9002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:58.914 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:09:58.914 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:09:59.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:09:59.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:09:59.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ba002c) incarnation(174631051) [ CSSD]2013-05-23 16:09:59.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:09:59.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:09:59.518 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:01.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:01.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:01.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:03.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:03.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:03.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:04.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:04.043 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:04.523 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:10:04.524 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:10:04.525 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:10:04.525 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10672/10672) version 11:1:1:4 [ CSSD]2013-05-23 16:10:04.541 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x268c1a0), client(1/0x268b410) [ CSSD]2013-05-23 16:10:04.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:04.541 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:10:04.541 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b410), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b410), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:10:04.836 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid 10672 ospid 10672 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:05.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:05.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:05.540 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bb150) [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bb150), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bb150), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8de0 [ CSSD]2013-05-23 16:10:05.693 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8de0) con(0x26a6a20) skgpid 9425 ospid 9425 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:07.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:07.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:07.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:08.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:09.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:09.046 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:09.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bb002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:09.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:09.477 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:10:09.478 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:10:09.479 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:10:09.479 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10711) version 11:1:1:4 [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x268c1a0), client(1/0x268b410) [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26e87a0, requested num -1 [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9b00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:10:09.484 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:09.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:09.491 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:10:09.491 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2659a90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:09.492 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2659a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:10:09.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:09.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:09.694 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:10:09.694 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid ospid 10711 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:11.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:11.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:11.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:12.657 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:10:12.658 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:10:12.659 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:10:12.659 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10774) version 11:1:1:4 [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x268c1a0), client(1/0x268b410) [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b410 with con 0x26a6a20, requested num -1 [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9b00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:10:12.665 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:12.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b410) [ CSSD]2013-05-23 16:10:12.671 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:10:12.671 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2659a90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:12.671 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2659a90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:10:12.874 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:10:12.874 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid ospid 10774 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:13.413 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:13.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:13.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:14.049 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:14.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:14.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04bc002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:14.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:14.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:14.162 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:14.162 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:14.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04bd002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:14.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:14.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:15.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:15.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:15.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:16.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04be002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:16.485 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:16.485 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:16.485 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:16.485 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:16.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04bf002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:16.492 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:16.492 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:17.471 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:17.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:17.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:18.626 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:18.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x261ca20) [ CSSD]2013-05-23 16:10:18.978 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x261ca20), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:10:18.978 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x261ca20), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:10:18.978 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:10:18.980 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x269b690) [ CSSD]2013-05-23 16:10:18.980 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x269b690), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:10:18.980 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x269b690), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:10:18.980 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261cb90) [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261cb90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261cb90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e370 [ CSSD]2013-05-23 16:10:18.984 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e370) con(0x269dcf0) skgpid 4769 ospid 4769 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c5a0) [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c5a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c5a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmDeadProc: proc 0x2698d00 [ CSSD]2013-05-23 16:10:18.986 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2698d00) con(0x26595a0) skgpid 4771 ospid 4771 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:19.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:19.053 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:19.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c0002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:19.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:19.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:19.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:21.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:21.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:21.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:22.599 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:10:22.600 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:10:22.600 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:10:22.600 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268c1a0) pid(10836/10836) version 11:1:1:4 [ CSSD]2013-05-23 16:10:22.617 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268c1a0), client(1/0x26e87a0) [ CSSD]2013-05-23 16:10:22.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e87a0) [ CSSD]2013-05-23 16:10:22.617 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:10:22.617 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:10:23.231 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268c1a0), client(2/0x268c740) [ CSSD]2013-05-23 16:10:23.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x268c740) [ CSSD]2013-05-23 16:10:23.231 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:10:23.231 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 16:10:23.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:23.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:23.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:24.056 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:24.056 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:24.727 [1199044928] >TRACE: clssgmAllocProc: (0x26e8c00) allocated [ CSSD]2013-05-23 16:10:24.727 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:10:24.728 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e8c00 - 1,2,3 [ CSSD]2013-05-23 16:10:24.728 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fc90) proc(0x26e8c00) pid(10868) version 11:1:1:4 [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e8c00), client(1/0x2659880) [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2659880) [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2659880 with con 0x26e8b40, requested num -1 [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261ed00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:10:24.734 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:24.741 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2659880) [ CSSD]2013-05-23 16:10:24.741 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2659880), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:10:24.741 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26599f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:24.741 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26599f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:10:24.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e8c00 [ CSSD]2013-05-23 16:10:24.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e8c00) con(0x267fc90) skgpid ospid 10868 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:25.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:25.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:25.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:26.538 [1199044928] >TRACE: clssgmAllocProc: (0x26b9d40) allocated [ CSSD]2013-05-23 16:10:26.539 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:10:26.539 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9d40 - 1,2,3 [ CSSD]2013-05-23 16:10:26.539 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fc90) proc(0x26b9d40) pid(9722/9722) version 11:1:1:4 [ CSSD]2013-05-23 16:10:26.556 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9d40), client(1/0x26b9c90) [ CSSD]2013-05-23 16:10:26.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9c90) [ CSSD]2013-05-23 16:10:26.556 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:10:26.556 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:10:26.568 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9d40), client(2/0x2659b90) [ CSSD]2013-05-23 16:10:26.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2659b90) [ CSSD]2013-05-23 16:10:26.568 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:10:26.568 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:10:27.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:27.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:27.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:28.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:28.059 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:10:28.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:29.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c1002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:29.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c2002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:29.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:29.416 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:29.416 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:29.416 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:29.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c3002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:29.423 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:29.423 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:29.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:29.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:29.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:31.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:31.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:31.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:33.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:33.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:33.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:33.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:33.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:35.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:35.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:35.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:37.691 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:37.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:37.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:38.065 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:38.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:38.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:39.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c4002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:39.763 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:39.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:39.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:39.987 [1199044928] >TRACE: clssgmAllocProc: (0x26ba380) allocated [ CSSD]2013-05-23 16:10:39.988 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:10:39.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba380 - 1,2,3 [ CSSD]2013-05-23 16:10:39.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659ae0) proc(0x26ba380) pid(11039) version 11:1:1:4 [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26ba380), client(1/0x261f680) [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f680 with con 0x261cb20, requested num -1 [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26baa20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:10:39.995 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:40.001 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:10:40.001 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:10:40.001 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bad20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:40.002 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bad20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:10:40.204 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba380 [ CSSD]2013-05-23 16:10:40.204 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba380) con(0x2659ae0) skgpid ospid 11039 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:41.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:41.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:41.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:43.069 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:43.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:43.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:43.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:43.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:44.091 [1199044928] >TRACE: clssgmAllocProc: (0x26bada0) allocated [ CSSD]2013-05-23 16:10:44.092 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:10:44.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bada0 - 1,2,3 [ CSSD]2013-05-23 16:10:44.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659ae0) proc(0x26bada0) pid(9720/9720) version 11:1:1:4 [ CSSD]2013-05-23 16:10:44.098 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bada0), client(1/0x261f680) [ CSSD]2013-05-23 16:10:44.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:10:44.098 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:10:44.098 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:10:44.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c5002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:44.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:44.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:44.671 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:44.671 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:44.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c6002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:44.678 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:44.678 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:45.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:45.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:45.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:47.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:47.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:47.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:48.072 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:48.073 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:48.716 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:49.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04c7002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:49.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:49.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:49.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:51.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:51.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:51.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:53.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:53.076 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:53.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:54.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:54.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:55.236 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 16:10:55.237 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:10:55.237 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 16:10:55.237 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1610) proc(0x269a790) pid(11188) version 11:1:1:4 [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x269ae30) [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ae30) [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ae30 with con 0x26e1490, requested num -1 [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269afa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:10:55.244 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:55.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ae30) [ CSSD]2013-05-23 16:10:55.250 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ae30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:10:55.250 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:10:55.250 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:10:55.453 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 16:10:55.453 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x26e1610) skgpid ospid 11188 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:10:55.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:56.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:56.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:56.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04c8002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:56.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:56.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:56.291 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:56.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:56.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04c9002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:56.299 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:56.299 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:57.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:10:58.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:10:58.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:10:58.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:10:58.079 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:10:58.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:10:59.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ca002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:59.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04cb002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:59.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:10:59.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:10:59.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:10:59.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:10:59.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04cc002c) incarnation(174631051) [ CSSD]2013-05-23 16:10:59.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:10:59.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:10:59.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:00.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:00.060 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:02.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:02.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:02.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:03.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:03.082 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:04.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:04.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:04.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:06.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:06.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:06.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:08.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:08.085 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:08.085 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:08.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:08.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:08.756 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:09.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04cd002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:10.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:10.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:10.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:10.485 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 16:11:10.486 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:11:10.486 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 16:11:10.486 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1610) proc(0x269a790) pid(11357) version 11:1:1:4 [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x269ae30) [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ae30) [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ae30 with con 0x26e1490, requested num -1 [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269afa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:11:10.493 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:10.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ae30) [ CSSD]2013-05-23 16:11:10.499 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ae30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:11:10.499 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:10.500 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:11:10.702 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 16:11:10.702 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x26e1610) skgpid ospid 11357 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:12.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:12.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:12.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:12.914 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 16:11:12.915 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:11:12.916 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 16:11:12.916 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a97d0) proc(0x269a790) pid(11411) version 11:1:1:4 [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x269ad60) [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ad60) [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ad60 with con 0x26e1490, requested num -1 [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269aed0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:11:12.923 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:12.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ad60) [ CSSD]2013-05-23 16:11:12.930 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ad60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:11:12.930 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b1d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:12.930 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:11:13.089 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:13.089 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:13.132 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 16:11:13.132 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x26a97d0) skgpid ospid 11411 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:14.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:14.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:14.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:15.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ce002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:15.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:11:15.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:11:15.182 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:11:15.182 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:15.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04cf002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:15.190 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:11:15.190 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:11:15.443 [1199044928] >TRACE: clssgmAllocProc: (0x269a790) allocated [ CSSD]2013-05-23 16:11:15.444 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:11:15.444 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269a790 - 1,2,3 [ CSSD]2013-05-23 16:11:15.444 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1490) proc(0x269a790) pid(11440/11440) version 11:1:1:4 [ CSSD]2013-05-23 16:11:15.450 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x269a790), client(1/0x269aca0) [ CSSD]2013-05-23 16:11:15.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269aca0) [ CSSD]2013-05-23 16:11:15.450 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:11:15.450 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:11:15.467 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269aca0) [ CSSD]2013-05-23 16:11:15.467 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269aca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:11:15.467 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269aca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:11:15.467 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:11:15.468 [1199044928] >TRACE: clssgmDeadProc: proc 0x269a790 [ CSSD]2013-05-23 16:11:15.468 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269a790) con(0x26e1490) skgpid 11440 ospid 11440 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:16.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:16.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:16.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:16.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d0002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:16.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:11:16.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:11:16.698 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:11:16.698 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:16.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d1002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:16.705 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:11:16.705 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:11:16.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d2002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:16.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:11:16.746 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:11:16.746 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:11:16.746 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:16.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d3002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:16.753 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:11:16.754 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:11:16.835 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:11:16.835 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:11:16.837 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:11:16.837 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:11:18.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:18.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:18.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:18.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:18.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:18.777 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:19.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d4002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:20.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:20.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:20.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:22.095 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:22.095 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:11:22.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:22.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:22.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:23.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x261bd80) [ CSSD]2013-05-23 16:11:23.288 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x261bd80), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:11:23.288 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x261bd80), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:11:23.288 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:11:23.296 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid 7564 ospid 7564 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:24.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:24.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:24.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:25.735 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:11:25.736 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:11:25.737 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:11:25.737 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x26e1090) pid(11515) version 11:1:1:4 [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e1090), client(1/0x2660e70) [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2660e70 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:11:25.743 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:25.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2660e70) [ CSSD]2013-05-23 16:11:25.750 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2660e70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:11:25.750 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:25.750 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:11:25.953 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:11:25.953 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26e4ea0) skgpid ospid 11515 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:26.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:26.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:26.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:27.098 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:27.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:28.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:28.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:28.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:28.797 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:29.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d5002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:30.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:30.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:30.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:30.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d6002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:30.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:11:30.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:11:30.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:11:30.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:30.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04d7002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:30.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:11:30.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:11:32.101 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:32.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:32.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:32.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:32.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:34.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:34.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:34.299 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:36.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:36.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:36.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:37.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:37.105 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:38.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:38.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:38.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:38.817 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:39.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04d8002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:40.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:40.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:40.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:40.996 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:11:40.997 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:11:40.997 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:11:40.997 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4ea0) proc(0x26e1090) pid(11681) version 11:1:1:4 [ CSSD]2013-05-23 16:11:41.003 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26e1090), client(1/0x26ee500) [ CSSD]2013-05-23 16:11:41.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 16:11:41.003 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee500 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 16:11:41.003 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:41.003 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e1610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:11:41.004 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:11:41.004 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:41.010 [1199044928] >TRACE: clssgmAllocProc: (0x26a9a20) allocated [ CSSD]2013-05-23 16:11:41.011 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 16:11:41.011 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee500), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:11:41.011 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268bc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:41.011 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268bc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:11:41.011 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:11:41.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9a20 - 1,2,3 [ CSSD]2013-05-23 16:11:41.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268be50) proc(0x26a9a20) pid(11501/11501) version 11:1:1:4 [ CSSD]2013-05-23 16:11:41.017 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26a9a20), client(1/0x26ee500) [ CSSD]2013-05-23 16:11:41.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 16:11:41.017 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:11:41.017 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:11:41.213 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:11:41.213 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26e4ea0) skgpid ospid 11681 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:42.108 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:42.108 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:42.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:42.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:42.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:44.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:44.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:44.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:45.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04d9002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:45.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:11:45.691 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:11:45.691 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:11:45.691 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:45.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04da002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:45.698 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:11:45.698 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:11:46.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:46.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:46.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:47.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:47.111 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:48.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:48.431 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:11:48.431 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:11:48.432 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:11:48.432 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1ca0) proc(0x26e1090) pid(11499/11499) version 11:1:1:4 [ CSSD]2013-05-23 16:11:48.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:48.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:48.447 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1090), client(1/0x26ba140) [ CSSD]2013-05-23 16:11:48.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ba140) [ CSSD]2013-05-23 16:11:48.447 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:11:48.447 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:11:48.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:49.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04db002c) incarnation(174631051) [ CSSD]2013-05-23 16:11:50.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:50.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:50.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:52.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:52.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:52.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:52.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:52.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:54.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:54.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:54.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:56.246 [1199044928] >TRACE: clssgmAllocProc: (0x26aade0) allocated [ CSSD]2013-05-23 16:11:56.247 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:11:56.247 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aade0 - 1,2,3 [ CSSD]2013-05-23 16:11:56.247 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1960) proc(0x26aade0) pid(11840) version 11:1:1:4 [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aade0), client(1/0x26818e0) [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26818e0) [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26818e0 with con 0x26aad10, requested num -1 [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681a50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:11:56.254 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:11:56.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26818e0) [ CSSD]2013-05-23 16:11:56.261 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26818e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:11:56.261 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681d50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:11:56.261 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:11:56.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aade0 [ CSSD]2013-05-23 16:11:56.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aade0) con(0x26e1960) skgpid ospid 11840 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:11:56.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:56.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:56.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:57.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:11:57.119 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:11:58.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:11:58.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:11:58.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:11:58.878 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:11:59.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04dc002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:00.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:00.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:00.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:00.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04dd002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:00.945 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:00.945 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:00.946 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:00.946 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:00.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04de002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:00.953 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:00.953 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:01.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:01.121 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:12:02.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:02.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:02.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:04.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:04.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:04.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:06.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:06.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:06.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04df002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:06.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:06.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:06.342 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:06.343 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:06.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e0002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:06.350 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:06.350 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:06.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:06.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:06.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:08.618 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:08.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:08.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:08.898 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:09.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e1002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:10.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:10.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:10.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:11.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:11.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:11.248 [1199044928] >TRACE: clssgmAllocProc: (0x26aade0) allocated [ CSSD]2013-05-23 16:12:11.249 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:12:11.250 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aade0 - 1,2,3 [ CSSD]2013-05-23 16:12:11.250 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1960) proc(0x26aade0) pid(12028) version 11:1:1:4 [ CSSD]2013-05-23 16:12:11.496 [1199044928] >TRACE: clssgmAllocProc: (0x26de280) allocated [ CSSD]2013-05-23 16:12:11.497 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:12:11.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de280 - 1,2,3 [ CSSD]2013-05-23 16:12:11.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681910) proc(0x26de280) pid(12080) version 11:1:1:4 [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26de280), client(1/0x26dea20) [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dea20) [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dea20 with con 0x26de140, requested num -1 [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26deb90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:12:11.503 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:11.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dea20) [ CSSD]2013-05-23 16:12:11.509 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dea20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:12:11.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ddfc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:11.509 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ddfc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:12:11.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de280 [ CSSD]2013-05-23 16:12:11.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de280) con(0x2681910) skgpid ospid 12080 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:12.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:12.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:12.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:13.173 [1199044928] >TRACE: clssgmAllocProc: (0x26de150) allocated [ CSSD]2013-05-23 16:12:13.174 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:12:13.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de150 - 1,2,3 [ CSSD]2013-05-23 16:12:13.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e16e0) proc(0x26de150) pid(12308) version 11:1:1:4 [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26de150), client(1/0x26de8f0) [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26de8f0) [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26de8f0 with con 0x26de070, requested num -1 [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dea60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:12:13.192 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:13.199 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26de8f0) [ CSSD]2013-05-23 16:12:13.199 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26de8f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:12:13.199 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ded60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:13.199 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ded60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:12:13.401 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de150 [ CSSD]2013-05-23 16:12:13.401 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de150) con(0x26e16e0) skgpid ospid 12308 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:13.969 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aade0 [ CSSD]2013-05-23 16:12:13.969 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aade0) con(0x26e1960) skgpid ospid 12028 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:14.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:14.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:14.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:15.272 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:12:15.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:12:15.275 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:12:15.275 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:12:15.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e2002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:15.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:15.352 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:15.352 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:12:15.352 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:12:15.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e3002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:15.359 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:15.359 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:16.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:16.131 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:16.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e4002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:16.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:16.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:16.191 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:16.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:16.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e5002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:16.199 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:16.199 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:16.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:16.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:16.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:17.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04e6002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:17.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:17.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:17.004 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:17.004 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:17.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04e7002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:17.012 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:17.012 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:18.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:18.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:18.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:18.918 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:19.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e8002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:20.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:20.134 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:12:20.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:20.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:20.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:22.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:22.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:22.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:24.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:24.762 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:24.762 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:25.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:25.138 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:26.743 [1199044928] >TRACE: clssgmAllocProc: (0x26aac60) allocated [ CSSD]2013-05-23 16:12:26.744 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:12:26.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aac60 - 1,2,3 [ CSSD]2013-05-23 16:12:26.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e16e0) proc(0x26aac60) pid(12477) version 11:1:1:4 [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aac60), client(1/0x26816b0) [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26816b0) [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26816b0 with con 0x26aae60, requested num -1 [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681820/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:12:26.751 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:26.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26816b0) [ CSSD]2013-05-23 16:12:26.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26816b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:12:26.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681b20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:26.758 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681b20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:12:26.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:26.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:26.768 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:26.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aac60 [ CSSD]2013-05-23 16:12:26.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aac60) con(0x26e16e0) skgpid ospid 12477 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:28.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:28.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:28.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:28.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:29.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04e9002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:30.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:30.141 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:30.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:30.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:30.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:31.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ea002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:31.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:31.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:31.449 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:31.449 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:31.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04eb002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:31.458 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:31.458 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:32.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:32.804 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:32.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:34.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:34.811 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:34.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:35.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:35.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:36.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:36.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:36.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:38.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:38.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:38.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:38.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:39.148 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:39.148 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:12:39.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ec002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:40.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:40.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:40.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:42.004 [1199044928] >TRACE: clssgmAllocProc: (0x26aade0) allocated [ CSSD]2013-05-23 16:12:42.005 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:12:42.005 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aade0 - 1,2,3 [ CSSD]2013-05-23 16:12:42.005 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1960) proc(0x26aade0) pid(12640) version 11:1:1:4 [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26aade0), client(1/0x26818e0) [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26818e0) [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26818e0 with con 0x26aad10, requested num -1 [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681a50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:12:42.012 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:42.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26818e0) [ CSSD]2013-05-23 16:12:42.018 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26818e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:12:42.018 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681d50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:42.018 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:12:42.221 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aade0 [ CSSD]2013-05-23 16:12:42.221 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aade0) con(0x26e1960) skgpid ospid 12640 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:42.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:42.866 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:42.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:44.151 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:44.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:44.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:44.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:44.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:46.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ed002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:46.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:12:46.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:12:46.706 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:12:46.706 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:46.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ee002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:46.713 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:12:46.713 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:12:46.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:46.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:46.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:48.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:48.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:48.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:48.979 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:49.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x267c480) [ CSSD]2013-05-23 16:12:49.010 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x267c480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:12:49.010 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x267c480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:12:49.010 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 16:12:49.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267c540) [ CSSD]2013-05-23 16:12:49.017 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267c540), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:12:49.017 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267c540), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:12:49.017 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:12:49.018 [1199044928] >TRACE: clssgmDeadProc: proc 0x267c040 [ CSSD]2013-05-23 16:12:49.018 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267c040) con(0x2690f20) skgpid 6819 ospid 6819 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:49.154 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:49.154 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:49.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ef002c) incarnation(174631051) [ CSSD]2013-05-23 16:12:50.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:50.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:50.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:52.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:52.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:52.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:54.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:54.158 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:12:54.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:54.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:55.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:56.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:56.982 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:57.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:57.255 [1199044928] >TRACE: clssgmAllocProc: (0x2678cb0) allocated [ CSSD]2013-05-23 16:12:57.256 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:12:57.256 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678cb0 - 1,2,3 [ CSSD]2013-05-23 16:12:57.256 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9890) proc(0x2678cb0) pid(12806) version 11:1:1:4 [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2678cb0), client(1/0x267c540) [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267c540) [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267c540 with con 0x2678be0, requested num -1 [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267bf40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:12:57.262 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:12:57.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267c540) [ CSSD]2013-05-23 16:12:57.269 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267c540), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:12:57.269 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267c240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:12:57.269 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267c240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:12:57.471 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678cb0 [ CSSD]2013-05-23 16:12:57.472 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678cb0) con(0x26a9890) skgpid ospid 12806 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:12:58.160 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:12:58.160 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:12:58.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:12:58.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:12:58.999 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:12:59.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:12:59.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f0002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:01.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:01.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:01.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bac0 [ CSSD]2013-05-23 16:13:01.395 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bac0) con(0x26b98b0) skgpid 8943 ospid 8943 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:01.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f1002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:01.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:13:01.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:13:01.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:13:01.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:01.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f2002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:01.978 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:13:01.978 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:13:03.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:03.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:03.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:03.164 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:03.164 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:05.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:05.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:05.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:07.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:07.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:07.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:08.167 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:08.167 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:09.020 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:09.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:09.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:09.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:09.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f3002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:11.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:11.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:11.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:12.504 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:13:12.505 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:13:12.505 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:13:12.505 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fa40) proc(0x261b8e0) pid(12951) version 11:1:1:4 [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261b8e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26ef0a0, requested num -1 [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:12.522 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:12.528 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:12.528 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:13:12.528 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:12.529 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:12.731 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:13:12.731 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x267fa40) skgpid ospid 12951 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:13.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:13.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:13.170 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:13.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:13.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:13.443 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:13:13.444 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:13.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:13:13.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a97d0) proc(0x261b8e0) pid(12998) version 11:1:1:4 [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261b8e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26ef0a0, requested num -1 [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26908d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:13.451 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:13.457 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:13.457 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:13:13.457 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:13.457 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:13.660 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:13:13.660 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x26a97d0) skgpid ospid 12998 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:15.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:15.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:15.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:17.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:17.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f4002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:17.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:13:17.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:13:17.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:13:17.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:17.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f5002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:17.236 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:13:17.236 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:13:17.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:17.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:17.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04f6002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:17.264 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:13:17.264 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:13:17.264 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:13:17.264 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:17.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04f7002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:17.270 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:13:17.270 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:13:18.172 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:18.173 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:19.040 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:19.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:19.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:19.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:19.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f8002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:21.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:21.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:21.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:23.176 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:23.176 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:23.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:23.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:23.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:25.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:25.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:25.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:27.148 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:13:27.148 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:27.149 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:13:27.149 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fa40) proc(0x261b8e0) pid(12739/12739) version 11:1:1:4 [ CSSD]2013-05-23 16:13:27.155 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261b8e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:13:27.155 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:13:27.155 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:13:27.155 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:13:27.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:27.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:27.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:27.776 [1199044928] >TRACE: clssgmAllocProc: (0x26b8d00) allocated [ CSSD]2013-05-23 16:13:27.777 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:13:27.778 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b8d00 - 1,2,3 [ CSSD]2013-05-23 16:13:27.778 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ef170) proc(0x26b8d00) pid(13098) version 11:1:1:4 [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b8d00), client(1/0x26b9450) [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9450) [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9450 with con 0x2679000, requested num -1 [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b95c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:27.785 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:27.792 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9450) [ CSSD]2013-05-23 16:13:27.792 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9450), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:13:27.792 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b98c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:27.792 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b98c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:27.995 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b8d00 [ CSSD]2013-05-23 16:13:27.995 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b8d00) con(0x26ef170) skgpid ospid 13098 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:28.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:28.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:29.060 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:29.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:29.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:29.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:29.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04f9002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:29.847 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261b8e0), client(2/0x26ce930) [ CSSD]2013-05-23 16:13:29.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ce930) [ CSSD]2013-05-23 16:13:29.847 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:13:29.847 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 16:13:31.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:31.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:31.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:32.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04fa002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:32.487 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:13:32.487 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:13:32.487 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:13:32.487 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:32.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fb002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:32.494 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:13:32.494 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:13:33.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:33.182 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:33.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:33.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:33.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:34.689 [1199044928] >TRACE: clssgmAllocProc: (0x26b9970) allocated [ CSSD]2013-05-23 16:13:34.690 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:34.691 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9970 - 1,2,3 [ CSSD]2013-05-23 16:13:34.691 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ceaa0) proc(0x26b9970) pid(12737/12737) version 11:1:1:4 [ CSSD]2013-05-23 16:13:34.696 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9970), client(1/0x2650790) [ CSSD]2013-05-23 16:13:34.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2650790) [ CSSD]2013-05-23 16:13:34.696 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:13:34.696 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:13:35.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:35.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:35.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:35.811 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1090), client(2/0x2650b60) [ CSSD]2013-05-23 16:13:35.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2650b60) [ CSSD]2013-05-23 16:13:35.811 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:13:35.811 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:13:37.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:37.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:37.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:37.747 [1199044928] >TRACE: clssgmAllocProc: (0x2681600) allocated [ CSSD]2013-05-23 16:13:37.748 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:37.748 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681600 - 1,2,3 [ CSSD]2013-05-23 16:13:37.748 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa310) proc(0x2681600) pid(13219) version 11:1:1:4 [ CSSD]2013-05-23 16:13:37.755 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681600), client(1/0x2681d70) [ CSSD]2013-05-23 16:13:37.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2681d70) [ CSSD]2013-05-23 16:13:37.755 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2681d70 with con 0x2681530, requested num -1 [ CSSD]2013-05-23 16:13:37.755 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:13:37.755 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681ee0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:13:37.756 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:37.756 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:37.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2681d70) [ CSSD]2013-05-23 16:13:37.762 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2681d70), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:13:37.762 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dc850) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:13:37.762 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26dc850) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:37.869 [1199044928] >TRACE: clssgmAllocProc: (0x26deb60) allocated [ CSSD]2013-05-23 16:13:37.869 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:37.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26deb60 - 1,2,3 [ CSSD]2013-05-23 16:13:37.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681cb0) proc(0x26deb60) pid(13224) version 11:1:1:4 [ CSSD]2013-05-23 16:13:37.885 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:13:37.887 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:13:37.889 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:13:37.890 [1199044928] >TRACE: clssgmDeadProc: proc 0x26deb60 [ CSSD]2013-05-23 16:13:37.890 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26deb60) con(0x2681cb0) skgpid ospid 13224 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:37.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681600 [ CSSD]2013-05-23 16:13:37.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681600) con(0x26aa310) skgpid ospid 13219 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:38.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:38.185 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:39.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:39.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:39.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:39.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:39.744 [1199044928] >TRACE: clssgmAllocProc: (0x2681600) allocated [ CSSD]2013-05-23 16:13:39.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:39.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681600 - 1,2,3 [ CSSD]2013-05-23 16:13:39.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26aa310) proc(0x2681600) pid(11497/11497) version 11:1:1:4 [ CSSD]2013-05-23 16:13:39.760 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681600), client(1/0x2681be0) [ CSSD]2013-05-23 16:13:39.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681be0) [ CSSD]2013-05-23 16:13:39.761 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:13:39.761 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:13:39.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04fc002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:41.015 [1199044928] >TRACE: clssgmAllocProc: (0x26deb80) allocated [ CSSD]2013-05-23 16:13:41.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:41.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26deb80 - 1,2,3 [ CSSD]2013-05-23 16:13:41.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dc850) proc(0x26deb80) pid(13269) version 11:1:1:4 [ CSSD]2013-05-23 16:13:41.283 [1199044928] >TRACE: clssgmAllocProc: (0x26b6280) allocated [ CSSD]2013-05-23 16:13:41.283 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:13:41.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b6280 - 1,2,3 [ CSSD]2013-05-23 16:13:41.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b3f50) proc(0x26b6280) pid(11495/11495) version 11:1:1:4 [ CSSD]2013-05-23 16:13:41.288 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26b6280), client(1/0x26def20) [ CSSD]2013-05-23 16:13:41.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26def20) [ CSSD]2013-05-23 16:13:41.288 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:13:41.288 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:13:41.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:41.468 [1199044928] >TRACE: clssgmDeadProc: proc 0x26deb80 [ CSSD]2013-05-23 16:13:41.468 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26deb80) con(0x26dc850) skgpid ospid 13269 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:41.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:41.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:42.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:42.187 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:13:43.023 [1199044928] >TRACE: clssgmAllocProc: (0x26de680) allocated [ CSSD]2013-05-23 16:13:43.024 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:13:43.024 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de680 - 1,2,3 [ CSSD]2013-05-23 16:13:43.024 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26deb80) proc(0x26de680) pid(13440) version 11:1:1:4 [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26de680), client(1/0x2693f00) [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2693f00) [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2693f00 with con 0x26939a0, requested num -1 [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694070/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:43.029 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:43.034 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2693f00) [ CSSD]2013-05-23 16:13:43.034 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2693f00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:13:43.034 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694370) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:43.035 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694370) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:43.237 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de680 [ CSSD]2013-05-23 16:13:43.237 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de680) con(0x26deb80) skgpid ospid 13440 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:43.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:43.507 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26b6280), client(2/0x26ded00) [ CSSD]2013-05-23 16:13:43.507 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ded00) [ CSSD]2013-05-23 16:13:43.507 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:13:43.507 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:13:43.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:43.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:44.437 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681600), client(2/0x2681990) [ CSSD]2013-05-23 16:13:44.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x2681990) [ CSSD]2013-05-23 16:13:44.437 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:13:44.437 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 16:13:45.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:45.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:45.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:47.190 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:47.191 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:47.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:47.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:47.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:47.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04fd002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:47.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:13:47.740 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:13:47.740 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:13:47.740 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:47.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04fe002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:47.748 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:13:47.748 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:13:49.101 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:49.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:49.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:49.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:49.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ff002c) incarnation(174631051) [ CSSD]2013-05-23 16:13:51.454 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:51.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:51.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:52.194 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:52.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:53.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:53.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:53.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:55.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:55.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:55.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:57.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:13:57.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:13:57.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:57.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:57.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:58.269 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:13:58.270 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:13:58.270 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:13:58.270 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(13593) version 11:1:1:4 [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:13:58.277 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:13:58.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:13:58.284 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:13:58.284 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:13:58.284 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:13:58.487 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:13:58.487 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 13593 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:13:59.121 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:13:59.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:13:59.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:13:59.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:13:59.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0500002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:01.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:01.200 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:14:01.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:01.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:01.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:02.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0501002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:02.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:14:02.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:14:02.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:14:02.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:02.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0502002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:02.999 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:14:02.999 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:14:03.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:03.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:03.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:05.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:05.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:05.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:06.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:06.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:07.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:07.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:07.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:09.141 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:09.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:09.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:09.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:09.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0503002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:11.207 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:11.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:11.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:11.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:11.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:13.529 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:14:13.530 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:14:13.531 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:14:13.531 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(13751) version 11:1:1:4 [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:13.537 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:13.544 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:13.544 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:14:13.544 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:13.544 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:13.710 [1199044928] >TRACE: clssgmAllocProc: (0x2696490) allocated [ CSSD]2013-05-23 16:14:13.711 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:14:13.711 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2696490 - 1,2,3 [ CSSD]2013-05-23 16:14:13.711 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2694890) proc(0x2696490) pid(13792) version 11:1:1:4 [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmRegisterClient: proc(73/0x2696490), client(1/0x26bee40) [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bee40) [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bee40 with con 0x2694d30, requested num -1 [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26befb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:13.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:13.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bee40) [ CSSD]2013-05-23 16:14:13.735 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bee40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:14:13.735 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bf2b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:13.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bf2b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:13.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:13.746 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:14:13.746 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 13751 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:13.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:13.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:13.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x2696490 [ CSSD]2013-05-23 16:14:13.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2696490) con(0x2694890) skgpid ospid 13792 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:15.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:15.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:15.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:16.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:16.210 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:17.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0504002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:17.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:14:17.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:14:17.527 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:14:17.527 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:17.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0505002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:17.534 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:14:17.534 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:14:17.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:17.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:17.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:18.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0506002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:18.250 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:14:18.250 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:14:18.250 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:14:18.250 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:18.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0507002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:18.257 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:14:18.257 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:14:19.171 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:19.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:19.866 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0508002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:19.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:19.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:20.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:20.213 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:14:21.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:21.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:21.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:23.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:23.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:23.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:24.620 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:14:24.621 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:14:24.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:14:24.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(13873) version 11:1:1:4 [ CSSD]2013-05-23 16:14:24.743 [1199044928] >TRACE: clssgmAllocProc: (0x2696140) allocated [ CSSD]2013-05-23 16:14:24.743 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:14:24.744 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2696140 - 1,2,3 [ CSSD]2013-05-23 16:14:24.744 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26947b0) proc(0x2696140) pid(13883) version 11:1:1:4 [ CSSD]2013-05-23 16:14:24.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:14:24.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:14:24.765 [1199044928] >TRACE: clssgmDeadProc: proc 0x2696140 [ CSSD]2013-05-23 16:14:24.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2696140) con(0x26947b0) skgpid ospid 13883 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5343/0x26de7f0) [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5343 (0x26de7f0) [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26de7f0 with con 0x2696590, requested num -1 [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x2694700/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:24.844 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:14:24.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5343 (0x26de7f0) [ CSSD]2013-05-23 16:14:24.851 [1199044928] >TRACE: clssgmExitGrock: client 5343 (0x26de7f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:14:24.851 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694af0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:14:24.851 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2694af0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:24.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:14:24.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 13873 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:25.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:25.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:25.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:25.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:25.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:27.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:27.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:27.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:28.775 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:14:28.775 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:14:28.776 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:14:28.776 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(13923) version 11:1:1:4 [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:28.782 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:28.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:28.788 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:14:28.788 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:28.788 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:28.991 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:14:28.991 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 13923 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:29.192 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:29.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0509002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:29.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:29.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:29.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:30.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:30.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:31.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:31.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:31.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:33.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050a002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:33.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:14:33.516 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:14:33.516 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:14:33.516 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:33.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050b002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:33.523 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:14:33.524 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:14:33.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:34.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:34.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:35.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:35.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:35.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:36.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:36.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:37.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:38.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:38.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:39.212 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:39.226 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:39.226 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:14:39.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050c002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:40.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:40.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:40.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:42.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:42.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:42.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:44.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:44.034 [1199044928] >TRACE: clssgmAllocProc: (0x26de6d0) allocated [ CSSD]2013-05-23 16:14:44.034 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:14:44.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de6d0 - 1,2,3 [ CSSD]2013-05-23 16:14:44.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dcfb0) proc(0x26de6d0) pid(14070) version 11:1:1:4 [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x26de6d0), client(1/0x26948d0) [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26948d0) [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26948d0 with con 0x26942f0, requested num -1 [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694a40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:44.041 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:44.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26948d0) [ CSSD]2013-05-23 16:14:44.048 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26948d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:14:44.048 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694d40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:44.048 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694d40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:44.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:44.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:44.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:44.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:44.250 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de6d0 [ CSSD]2013-05-23 16:14:44.250 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de6d0) con(0x26dcfb0) skgpid ospid 14070 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:46.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:46.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:46.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:48.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:48.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:48.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:48.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(050d002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:48.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:14:48.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:14:48.771 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:14:48.771 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:48.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(050e002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:48.778 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:14:48.778 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:14:49.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:49.233 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:49.233 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:49.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(050f002c) incarnation(174631051) [ CSSD]2013-05-23 16:14:50.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:50.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:50.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:52.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:52.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:52.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:54.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:54.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:54.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:54.236 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:54.236 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:14:56.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:56.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:56.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:58.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:14:58.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:14:58.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:14:58.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:14:58.238 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:14:59.253 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:14:59.284 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:14:59.289 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:14:59.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:14:59.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(14225) version 11:1:1:4 [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:14:59.295 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:14:59.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:14:59.302 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:14:59.302 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:14:59.302 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:14:59.504 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:14:59.504 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 14225 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:14:59.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0510002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:00.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:00.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:00.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:02.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:02.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:02.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:03.241 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:03.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:04.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0511002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:04.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:15:04.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:15:04.020 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:15:04.020 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:04.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0512002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:04.027 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:15:04.027 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:15:04.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:04.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:04.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:04.932 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:15:04.933 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:15:04.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:15:04.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(14318/14318) version 11:1:1:4 [ CSSD]2013-05-23 16:15:04.940 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x2694630) [ CSSD]2013-05-23 16:15:04.940 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2694630) [ CSSD]2013-05-23 16:15:04.940 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:15:04.940 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2694630) [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2694630), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2694630), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:15:05.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid 14318 ospid 14318 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:06.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:06.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:06.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:08.245 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:08.245 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:08.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:08.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:08.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:09.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:15:09.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0513002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:10.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:10.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:10.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:12.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:12.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:12.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:13.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:13.248 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:13.977 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:15:13.978 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:15:13.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:15:13.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(14380) version 11:1:1:4 [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:15:13.985 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:13.991 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:15:13.991 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:15:13.991 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:13.991 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:15:14.194 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:15:14.194 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 14380 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:14.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:14.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:14.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:14.536 [1199044928] >TRACE: clssgmAllocProc: (0x2694170) allocated [ CSSD]2013-05-23 16:15:14.537 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:15:14.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2694170 - 1,2,3 [ CSSD]2013-05-23 16:15:14.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dce80) proc(0x2694170) pid(14389) version 11:1:1:4 [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x2694170), client(1/0x26947b0) [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26947b0 with con 0x26de720, requested num -1 [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2694920/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:15:14.544 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:14.550 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26947b0) [ CSSD]2013-05-23 16:15:14.550 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26947b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:15:14.550 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2694c20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:14.550 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2694c20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:15:14.753 [1199044928] >TRACE: clssgmDeadProc: proc 0x2694170 [ CSSD]2013-05-23 16:15:14.753 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2694170) con(0x26dce80) skgpid ospid 14389 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:16.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:16.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:16.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:17.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0514002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:17.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:15:17.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:15:17.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:15:17.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:17.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0515002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:17.792 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:15:17.792 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:15:18.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:18.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:18.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:18.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:18.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edda0 [ CSSD]2013-05-23 16:15:19.024 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edda0) con(0x26bb850) skgpid 8720 ospid 8720 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:19.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0516002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:19.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:15:19.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:15:19.282 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:15:19.282 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:19.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0517002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:19.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:15:19.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:15:19.293 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:15:20.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0518002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:20.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:20.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:20.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:22.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:22.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:22.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:23.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:23.254 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:24.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:24.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:24.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:26.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:26.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:26.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:28.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:28.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:28.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:28.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:28.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:29.324 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:15:29.786 [1199044928] >TRACE: clssgmAllocProc: (0x26edcc0) allocated [ CSSD]2013-05-23 16:15:29.787 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:15:29.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edcc0 - 1,2,3 [ CSSD]2013-05-23 16:15:29.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9250) proc(0x26edcc0) pid(14532) version 11:1:1:4 [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26edcc0), client(1/0x26ee270) [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26bbc20, requested num -1 [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcb80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:15:29.793 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:29.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:15:29.799 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:15:29.799 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dce80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:29.799 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dce80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:15:30.002 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edcc0 [ CSSD]2013-05-23 16:15:30.002 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edcc0) con(0x26a9250) skgpid ospid 14532 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:30.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0519002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:30.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:30.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:30.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:32.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:32.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:32.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:33.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:33.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:34.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:34.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:34.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:34.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051a002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:34.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:15:34.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:15:34.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:15:34.532 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:34.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051b002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:34.539 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:15:34.539 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:15:36.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:36.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:36.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:37.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:37.264 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:15:38.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:38.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:38.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:39.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:15:40.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051c002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:40.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:40.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:40.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:42.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:42.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:42.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:42.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:42.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:44.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:44.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:44.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:45.035 [1199044928] >TRACE: clssgmAllocProc: (0x26edcc0) allocated [ CSSD]2013-05-23 16:15:45.036 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:15:45.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edcc0 - 1,2,3 [ CSSD]2013-05-23 16:15:45.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9250) proc(0x26edcc0) pid(14687) version 11:1:1:4 [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26edcc0), client(1/0x26ee270) [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26bbc20, requested num -1 [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcb80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:15:45.043 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:45.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:15:45.050 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:15:45.050 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dce80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:15:45.050 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dce80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:15:45.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edcc0 [ CSSD]2013-05-23 16:15:45.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edcc0) con(0x26a9250) skgpid ospid 14687 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:15:46.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:46.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:46.747 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:47.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:47.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:48.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:48.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:48.753 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:49.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:15:49.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(051d002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:49.782 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:15:49.782 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:15:49.782 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:15:49.782 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:15:49.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(051e002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:49.789 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:15:49.789 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:15:50.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(051f002c) incarnation(174631051) [ CSSD]2013-05-23 16:15:50.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:50.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:50.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:52.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:52.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:15:52.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:52.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:52.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:54.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:54.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:54.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:56.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:15:56.277 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:15:56.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:56.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:56.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:58.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:15:58.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:15:58.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:15:59.404 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:00.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0520002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:00.285 [1199044928] >TRACE: clssgmAllocProc: (0x26bb8c0) allocated [ CSSD]2013-05-23 16:16:00.286 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:16:00.286 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb8c0 - 1,2,3 [ CSSD]2013-05-23 16:16:00.286 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9190) proc(0x26bb8c0) pid(14846) version 11:1:1:4 [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26bb8c0), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26edf10, requested num -1 [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcab0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:16:00.292 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:00.299 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:00.299 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:16:00.299 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dcdb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:00.299 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dcdb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:16:00.502 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb8c0 [ CSSD]2013-05-23 16:16:00.502 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb8c0) con(0x26a9190) skgpid ospid 14846 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:00.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:00.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:00.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:01.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:01.280 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:02.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:02.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:02.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:04.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:04.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:04.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:05.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0521002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:05.043 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:05.043 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:05.043 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:16:05.043 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:05.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0522002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:05.051 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:05.051 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:06.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:06.283 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:06.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:06.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:06.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:08.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:08.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:09.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:09.425 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:10.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0523002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:10.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:10.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:11.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:11.287 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:11.287 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:12.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:12.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:13.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:14.234 [1199044928] >TRACE: clssgmAllocProc: (0x26edcc0) allocated [ CSSD]2013-05-23 16:16:14.235 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:16:14.235 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edcc0 - 1,2,3 [ CSSD]2013-05-23 16:16:14.235 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9250) proc(0x26edcc0) pid(14979) version 11:1:1:4 [ CSSD]2013-05-23 16:16:14.241 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26edcc0), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:14.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:14.241 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26edf70, requested num -1 [ CSSD]2013-05-23 16:16:14.241 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:14.241 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcb80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:16:14.242 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:16:14.242 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:14.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:14.248 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:16:14.248 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dce80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:14.248 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dce80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:16:14.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edcc0 [ CSSD]2013-05-23 16:16:14.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edcc0) con(0x26a9250) skgpid ospid 14979 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:14.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:14.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:15.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:15.533 [1199044928] >TRACE: clssgmAllocProc: (0x26edcc0) allocated [ CSSD]2013-05-23 16:16:15.534 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:16:15.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edcc0 - 1,2,3 [ CSSD]2013-05-23 16:16:15.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a9250) proc(0x26edcc0) pid(15000) version 11:1:1:4 [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26edcc0), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26edf70, requested num -1 [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dcb80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:16:15.541 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:15.547 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:15.547 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:16:15.547 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dce80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:15.547 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dce80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:16:15.750 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edcc0 [ CSSD]2013-05-23 16:16:15.750 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edcc0) con(0x26a9250) skgpid ospid 15000 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:15.926 [1199044928] >TRACE: clssgmAllocProc: (0x26de020) allocated [ CSSD]2013-05-23 16:16:15.927 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:16:15.928 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26de020 - 1,2,3 [ CSSD]2013-05-23 16:16:15.928 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26dccf0) proc(0x26de020) pid(15043/15043) version 11:1:1:4 [ CSSD]2013-05-23 16:16:15.933 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26de020), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:15.933 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:15.933 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:16:15.933 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmDeadProc: proc 0x26de020 [ CSSD]2013-05-23 16:16:15.952 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26de020) con(0x26dccf0) skgpid 15043 ospid 15043 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:16.290 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:16.290 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:16.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:16.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:16.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0524002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:16.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:16.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:16.994 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:16:16.994 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:17.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0525002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:17.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:17.001 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:17.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:17.114 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:16:17.114 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:16:17.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:16:17.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:16:18.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0526002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:18.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:18.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:18.050 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:16:18.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:18.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0527002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:18.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:18.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:18.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:18.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:19.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:19.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:20.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0528002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:20.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0529002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:20.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:20.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:20.290 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:16:20.290 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:20.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052a002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:20.297 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:20.297 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:20.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:20.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:21.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:21.293 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:21.293 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:23.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:23.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:23.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261f680), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261f680), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bada0 [ CSSD]2013-05-23 16:16:23.357 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bada0) con(0x2659ae0) skgpid 9720 ospid 9720 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:23.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2659b90) [ CSSD]2013-05-23 16:16:23.364 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2659b90), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:16:23.364 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2659b90), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:16:23.364 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 16:16:23.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9c90) [ CSSD]2013-05-23 16:16:23.371 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9c90), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:16:23.371 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9c90), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:16:23.371 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:16:23.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9d40 [ CSSD]2013-05-23 16:16:23.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9d40) con(0x267fc90) skgpid 9722 ospid 9722 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:25.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:25.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:25.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:26.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:26.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:27.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:27.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:27.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:29.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:29.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:29.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:29.466 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:30.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052b002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:30.795 [1199044928] >TRACE: clssgmAllocProc: (0x26e89c0) allocated [ CSSD]2013-05-23 16:16:30.796 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:16:30.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e89c0 - 1,2,3 [ CSSD]2013-05-23 16:16:30.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fd50) proc(0x26e89c0) pid(15152) version 11:1:1:4 [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e89c0), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ee270 with con 0x26b9e60, requested num -1 [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2659710/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:16:30.802 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:30.808 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:30.808 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ee270), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:16:30.808 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:30.808 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:16:31.011 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e89c0 [ CSSD]2013-05-23 16:16:31.011 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e89c0) con(0x267fd50) skgpid ospid 15152 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:31.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:31.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:31.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:31.299 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:31.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:33.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:33.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:33.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:35.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:35.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:35.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:35.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(052c002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:35.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:35.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:35.543 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:16:35.543 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:35.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(052d002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:35.550 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:35.550 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:36.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:36.302 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:37.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:37.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:37.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:39.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:39.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:39.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:39.487 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:40.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052e002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:40.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:40.305 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:16:41.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:41.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:41.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:43.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:43.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:43.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:44.907 [1199044928] >TRACE: clssgmAllocProc: (0x26b9db0) allocated [ CSSD]2013-05-23 16:16:44.908 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:16:44.908 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9db0 - 1,2,3 [ CSSD]2013-05-23 16:16:44.908 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267fe20) proc(0x26b9db0) pid(15101/15101) version 11:1:1:4 [ CSSD]2013-05-23 16:16:44.926 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9db0), client(1/0x26ee270) [ CSSD]2013-05-23 16:16:44.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:16:44.926 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:16:44.926 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:16:45.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:45.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:45.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:45.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:45.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:46.044 [1199044928] >TRACE: clssgmAllocProc: (0x261f550) allocated [ CSSD]2013-05-23 16:16:46.045 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:16:46.046 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f550 - 1,2,3 [ CSSD]2013-05-23 16:16:46.046 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659a50) proc(0x261f550) pid(15330) version 11:1:1:4 [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f550), client(1/0x261f680) [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f680 with con 0x26a9110, requested num -1 [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cb90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:16:46.062 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:46.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:16:46.069 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:16:46.069 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267ce90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:16:46.069 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267ce90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:16:46.271 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f550 [ CSSD]2013-05-23 16:16:46.271 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f550) con(0x2659a50) skgpid ospid 15330 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:16:47.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:47.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:47.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:49.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:49.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:49.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:49.519 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:16:50.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(052f002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:50.312 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:50.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:50.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0530002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:50.793 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:16:50.793 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:16:50.793 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:16:50.793 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:16:50.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0531002c) incarnation(174631051) [ CSSD]2013-05-23 16:16:50.800 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:16:50.800 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:16:51.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:51.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:51.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:53.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:53.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:53.403 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:55.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:55.315 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:16:55.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:55.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:55.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:57.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:57.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:57.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:59.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:16:59.318 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:16:59.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:16:59.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:16:59.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:16:59.539 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:00.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0532002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:01.315 [1199044928] >TRACE: clssgmAllocProc: (0x261c410) allocated [ CSSD]2013-05-23 16:17:01.316 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:17:01.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c410 - 1,2,3 [ CSSD]2013-05-23 16:17:01.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681ee0) proc(0x261c410) pid(15479) version 11:1:1:4 [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261c410), client(1/0x261ca40) [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca40 with con 0x26a9720, requested num -1 [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:01.323 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:01.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:01.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:01.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267cdc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:01.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267cdc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:01.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:01.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:01.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:01.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c410 [ CSSD]2013-05-23 16:17:01.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c410) con(0x2681ee0) skgpid ospid 15479 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:03.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:03.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:03.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:04.322 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:04.322 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:05.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:05.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:05.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:06.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0533002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:06.045 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:06.045 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:06.045 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:17:06.045 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:06.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0534002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:06.051 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:06.051 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:07.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:07.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:07.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:09.325 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:09.325 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:09.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:09.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:09.559 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:09.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:10.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0535002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:11.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:11.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:11.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:11.715 [1199044928] >TRACE: clssgmAllocProc: (0x26a9600) allocated [ CSSD]2013-05-23 16:17:11.715 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:11.716 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9600 - 1,2,3 [ CSSD]2013-05-23 16:17:11.716 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659a50) proc(0x26a9600) pid(15630) version 11:1:1:4 [ CSSD]2013-05-23 16:17:11.865 [1199044928] >TRACE: clssgmAllocProc: (0x26ed480) allocated [ CSSD]2013-05-23 16:17:11.866 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:11.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ed480 - 1,2,3 [ CSSD]2013-05-23 16:17:11.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267cba0) proc(0x26ed480) pid(15688) version 11:1:1:4 [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ed480), client(1/0x26a9730) [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9730) [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9730 with con 0x267d570, requested num -1 [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26edc20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:11.883 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:11.889 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9730) [ CSSD]2013-05-23 16:17:11.889 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9730), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:11.889 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed220) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:11.889 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed220) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:12.091 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ed480 [ CSSD]2013-05-23 16:17:12.091 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ed480) con(0x267cba0) skgpid ospid 15688 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:13.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:13.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:13.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:14.328 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:14.328 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:14.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9600 [ CSSD]2013-05-23 16:17:14.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9600) con(0x2659a50) skgpid ospid 15630 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:14.493 [1199044928] >TRACE: clssgmAllocProc: (0x261f550) allocated [ CSSD]2013-05-23 16:17:14.494 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:14.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f550 - 1,2,3 [ CSSD]2013-05-23 16:17:14.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659a50) proc(0x261f550) pid(15958) version 11:1:1:4 [ CSSD]2013-05-23 16:17:14.500 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f550), client(1/0x261f680) [ CSSD]2013-05-23 16:17:14.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:17:14.500 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261f680 with con 0x26a9110, requested num -1 [ CSSD]2013-05-23 16:17:14.500 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:14.500 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cd10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:14.501 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:14.501 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:14.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261f680) [ CSSD]2013-05-23 16:17:14.508 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261f680), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:14.508 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a8f90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:14.508 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a8f90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:14.710 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f550 [ CSSD]2013-05-23 16:17:14.710 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f550) con(0x2659a50) skgpid ospid 15958 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:15.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:15.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:15.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:17:15.597 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:17:15.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:17:15.599 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:17:15.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:15.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0536002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:15.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:15.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:15.670 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:17:15.670 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:17:15.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0537002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:15.677 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:15.677 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:16.563 [1199044928] >TRACE: clssgmAllocProc: (0x261c410) allocated [ CSSD]2013-05-23 16:17:16.564 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:17:16.564 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c410 - 1,2,3 [ CSSD]2013-05-23 16:17:16.564 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681ee0) proc(0x261c410) pid(15985) version 11:1:1:4 [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261c410), client(1/0x261ca40) [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca40 with con 0x26a9720, requested num -1 [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:16.570 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:16.577 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:16.577 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:16.577 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267cdc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:16.577 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267cdc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:16.780 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c410 [ CSSD]2013-05-23 16:17:16.780 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c410) con(0x2681ee0) skgpid ospid 15985 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:17.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:17.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:17.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:18.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0538002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:18.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:18.314 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:18.314 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:17:18.314 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:18.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0539002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:18.322 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:18.322 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:18.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:18.330 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:17:19.579 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:19.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:19.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:19.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:20.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053a002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:21.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(053b002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:21.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:21.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:21.311 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:17:21.311 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:21.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053c002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:21.317 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:21.317 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:21.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:21.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:21.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:23.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:23.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:23.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:23.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:23.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:25.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:25.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:25.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:27.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:27.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:27.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:28.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:28.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:29.045 [1199044928] >TRACE: clssgmAllocProc: (0x26a9600) allocated [ CSSD]2013-05-23 16:17:29.045 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:29.046 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9600 - 1,2,3 [ CSSD]2013-05-23 16:17:29.046 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659a50) proc(0x26a9600) pid(16129/16129) version 11:1:1:4 [ CSSD]2013-05-23 16:17:29.062 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26a9600), client(1/0x26a9730) [ CSSD]2013-05-23 16:17:29.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26a9730) [ CSSD]2013-05-23 16:17:29.062 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:17:29.062 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:17:29.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:29.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:29.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:29.754 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:30.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(053d002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:31.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:31.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:31.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:31.812 [1199044928] >TRACE: clssgmAllocProc: (0x26ba980) allocated [ CSSD]2013-05-23 16:17:31.813 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:17:31.813 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba980 - 1,2,3 [ CSSD]2013-05-23 16:17:31.813 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d050) proc(0x26ba980) pid(16167) version 11:1:1:4 [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26ba980), client(1/0x26dc850) [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26dc850) [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26dc850 with con 0x26edf10, requested num -1 [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dc9c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:31.819 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:31.820 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:31.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26dc850) [ CSSD]2013-05-23 16:17:31.826 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26dc850), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:31.826 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26dccc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:31.826 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26dccc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:32.029 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba980 [ CSSD]2013-05-23 16:17:32.029 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba980) con(0x267d050) skgpid ospid 16167 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:32.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26a9730) [ CSSD]2013-05-23 16:17:32.525 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26a9730), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:17:32.525 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26a9730), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:17:32.525 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:17:32.526 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9600 [ CSSD]2013-05-23 16:17:32.526 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9600) con(0x2659a50) skgpid 16129 ospid 16129 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:33.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:33.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:33.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:33.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:33.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:35.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:35.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:35.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:36.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(053e002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:36.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:36.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:36.556 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:17:36.556 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:36.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(053f002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:36.561 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:36.561 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:37.342 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:37.343 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:17:37.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:37.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:37.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:39.631 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:39.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:39.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:39.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:40.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0540002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:41.383 [1199044928] >TRACE: clssgmAllocProc: (0x261c410) allocated [ CSSD]2013-05-23 16:17:41.384 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:41.384 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c410 - 1,2,3 [ CSSD]2013-05-23 16:17:41.384 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681ee0) proc(0x261c410) pid(16273) version 11:1:1:4 [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261c410), client(1/0x261ca40) [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca40 with con 0x261f670, requested num -1 [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:41.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:41.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca40) [ CSSD]2013-05-23 16:17:41.397 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:41.397 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267cdc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:41.397 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267cdc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:41.599 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c410 [ CSSD]2013-05-23 16:17:41.599 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c410) con(0x2681ee0) skgpid ospid 16273 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:41.760 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26b9db0), client(2/0x26e8d80) [ CSSD]2013-05-23 16:17:41.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26e8d80) [ CSSD]2013-05-23 16:17:41.760 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:17:41.760 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 16:17:41.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:41.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:41.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:42.346 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:42.346 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:43.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:43.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:43.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:45.848 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:45.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:45.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:47.072 [1199044928] >TRACE: clssgmAllocProc: (0x26a9660) allocated [ CSSD]2013-05-23 16:17:47.073 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:17:47.074 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26a9660 - 1,2,3 [ CSSD]2013-05-23 16:17:47.074 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261ef70) proc(0x26a9660) pid(16325) version 11:1:1:4 [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26a9660), client(1/0x267cdd0) [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267cdd0) [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267cdd0 with con 0x261f270, requested num -1 [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267cf40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:17:47.080 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:47.087 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267cdd0) [ CSSD]2013-05-23 16:17:47.087 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267cdd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:17:47.087 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267d240) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:17:47.087 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267d240) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:17:47.289 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9660 [ CSSD]2013-05-23 16:17:47.289 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9660) con(0x261ef70) skgpid ospid 16325 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:47.349 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:47.349 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:47.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:47.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:47.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:49.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x268c740) [ CSSD]2013-05-23 16:17:49.090 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x268c740), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:17:49.090 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x268c740), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:17:49.090 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e87a0) [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e87a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e87a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:17:49.101 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x266f0d0) skgpid 10836 ospid 10836 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:17:49.651 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:17:49.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:49.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:49.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:50.305 [1199044928] >TRACE: clssgmAllocProc: (0x26e4d00) allocated [ CSSD]2013-05-23 16:17:50.306 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:17:50.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e4d00 - 1,2,3 [ CSSD]2013-05-23 16:17:50.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e4d00) pid(16392/16392) version 11:1:1:4 [ CSSD]2013-05-23 16:17:50.323 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e4d00), client(1/0x26e87a0) [ CSSD]2013-05-23 16:17:50.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e87a0) [ CSSD]2013-05-23 16:17:50.323 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:17:50.323 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:17:50.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0541002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:51.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0542002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:51.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:17:51.803 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:17:51.803 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:17:51.803 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:17:51.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0543002c) incarnation(174631051) [ CSSD]2013-05-23 16:17:51.810 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:17:51.810 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:17:51.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:51.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:51.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:52.352 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:52.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:17:53.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:53.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:53.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:55.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:55.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:55.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:56.017 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e4d00), client(2/0x26a8db0) [ CSSD]2013-05-23 16:17:56.017 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26a8db0) [ CSSD]2013-05-23 16:17:56.017 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:17:56.017 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 16:17:56.355 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:17:56.356 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:17:57.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:17:57.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:17:57.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:17:59.671 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:00.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:00.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:00.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:00.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0544002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:01.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:01.359 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:02.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:02.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:02.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:02.322 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:02.323 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:18:02.323 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:02.323 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a93e0) proc(0x261f4e0) pid(16497) version 11:1:1:4 [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x267d190) [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d190 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d300/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:02.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:02.336 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:02.336 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d190), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:18:02.336 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:02.336 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:02.539 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:02.539 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x26a93e0) skgpid ospid 16497 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:04.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:04.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:04.063 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:06.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:06.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:06.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:06.362 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:06.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:07.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0545002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:07.051 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:18:07.051 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:18:07.051 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:18:07.052 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:07.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0546002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:07.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:18:07.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:18:08.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:08.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:08.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:09.693 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:10.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:10.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:10.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:10.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0547002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:11.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:11.366 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:12.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:12.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:12.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:14.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:14.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:14.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:14.753 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:14.754 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:14.754 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:14.754 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a93e0) proc(0x261f4e0) pid(16619) version 11:1:1:4 [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x267d190) [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d190 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d300/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:14.760 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:14.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:14.767 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d190), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:18:14.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:14.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:14.969 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:14.969 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x26a93e0) skgpid ospid 16619 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:15.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:15.369 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:18:16.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:16.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:16.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:17.575 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:17.576 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:18:17.576 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:17.576 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a93e0) proc(0x261f4e0) pid(16647) version 11:1:1:4 [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x267d190) [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d190 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d300/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:17.593 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:17.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d190) [ CSSD]2013-05-23 16:18:17.599 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d190), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:18:17.599 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:17.599 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:17.801 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:17.801 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x26a93e0) skgpid ospid 16647 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:18.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:18.128 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:18.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:18.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0548002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:18.571 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:18:18.571 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:18:18.571 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:18:18.571 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:18.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0549002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:18.577 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:18:18.577 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:18:19.714 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:20.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:20.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:20.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:20.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:20.372 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:20.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054a002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:22.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:22.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:22.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:22.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(054b002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:22.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:18:22.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:18:22.303 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:18:22.303 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:22.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(054c002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:22.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:18:22.310 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:18:24.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:24.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:24.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:25.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:25.375 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:26.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:26.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:26.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:28.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:28.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:28.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:29.124 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:29.125 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:29.125 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:29.125 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a93e0) proc(0x261f4e0) pid(16768/16768) version 11:1:1:4 [ CSSD]2013-05-23 16:18:29.131 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x267d010) [ CSSD]2013-05-23 16:18:29.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d010) [ CSSD]2013-05-23 16:18:29.131 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:18:29.131 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:18:29.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d010) [ CSSD]2013-05-23 16:18:29.169 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d010), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:29.169 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d010), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:29.169 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:18:29.169 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:29.169 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x26a93e0) skgpid 16768 ospid 16768 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:29.358 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:29.359 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:29.359 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:29.359 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a93c0) proc(0x261f4e0) pid(16777/16777) version 11:1:1:4 [ CSSD]2013-05-23 16:18:29.375 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x267d010) [ CSSD]2013-05-23 16:18:29.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d010) [ CSSD]2013-05-23 16:18:29.375 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:18:29.375 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:18:29.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d010) [ CSSD]2013-05-23 16:18:29.429 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d010), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:29.429 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d010), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:29.429 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:18:29.430 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:29.430 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x26a93c0) skgpid 16777 ospid 16777 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:29.733 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:30.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:30.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:30.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:30.378 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:30.378 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:30.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(054d002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:32.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:32.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:32.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:32.835 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:32.836 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:18:32.836 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:32.836 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659660) proc(0x261f4e0) pid(16802) version 11:1:1:4 [ CSSD]2013-05-23 16:18:32.842 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x261cb10) [ CSSD]2013-05-23 16:18:32.842 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:32.842 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:32.842 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:32.842 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d260/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:18:32.843 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:32.843 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:32.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:32.848 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:18:32.848 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:32.849 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:33.051 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:33.051 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x2659660) skgpid ospid 16802 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:34.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:34.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:34.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:34.381 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:34.381 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:18:36.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:36.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:36.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:37.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(054e002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:37.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:18:37.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:18:37.557 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:18:37.557 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:37.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(054f002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:37.564 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:18:37.564 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:18:38.044 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:38.045 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:38.045 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:38.045 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659660) proc(0x261f4e0) pid(16875) version 11:1:1:4 [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x261cb10) [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x261cb10 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d260/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:38.052 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:38.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:38.058 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:18:38.058 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:18:38.059 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:38.166 [1199044928] >TRACE: clssgmAllocProc: (0x26edcc0) allocated [ CSSD]2013-05-23 16:18:38.167 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:38.168 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26edcc0 - 1,2,3 [ CSSD]2013-05-23 16:18:38.168 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26baec0) proc(0x26edcc0) pid(16880) version 11:1:1:4 [ CSSD]2013-05-23 16:18:38.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:18:38.186 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:18:38.188 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:18:38.189 [1199044928] >TRACE: clssgmDeadProc: proc 0x26edcc0 [ CSSD]2013-05-23 16:18:38.189 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26edcc0) con(0x26baec0) skgpid ospid 16880 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:38.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:38.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x2659660) skgpid ospid 16875 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:38.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:38.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:38.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:39.384 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:39.384 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:39.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:40.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:40.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:40.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:40.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0550002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:40.596 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:40.597 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:18:40.597 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:40.597 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659660) proc(0x261f4e0) pid(16923) version 11:1:1:4 [ CSSD]2013-05-23 16:18:41.178 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:41.178 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x2659660) skgpid ospid 16923 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:42.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:42.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:42.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:44.364 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:44.387 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:44.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:44.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:44.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:46.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:46.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:46.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:48.084 [1199044928] >TRACE: clssgmAllocProc: (0x261f4e0) allocated [ CSSD]2013-05-23 16:18:48.084 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:18:48.085 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f4e0 - 1,2,3 [ CSSD]2013-05-23 16:18:48.085 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659660) proc(0x261f4e0) pid(17133) version 11:1:1:4 [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261f4e0), client(1/0x261cb10) [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261cb10 with con 0x267cc40, requested num -1 [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x267d260/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:18:48.091 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:48.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261cb10) [ CSSD]2013-05-23 16:18:48.097 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261cb10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:18:48.097 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:18:48.097 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:18:48.299 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f4e0 [ CSSD]2013-05-23 16:18:48.299 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f4e0) con(0x2659660) skgpid ospid 17133 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:48.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:48.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:48.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:49.391 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:49.391 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:49.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:18:50.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:50.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:50.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:50.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0551002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:52.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:52.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:52.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:52.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0552002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:52.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:18:52.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:18:52.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:18:52.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:18:52.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0553002c) incarnation(174631051) [ CSSD]2013-05-23 16:18:52.820 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:18:52.820 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:18:53.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2650b60) [ CSSD]2013-05-23 16:18:53.380 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2650b60), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:18:53.380 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2650b60), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.380 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 16:18:53.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x2681990) [ CSSD]2013-05-23 16:18:53.382 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x2681990), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:18:53.382 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x2681990), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.382 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ba140) [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ba140), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ba140), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:18:53.384 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26e1ca0) skgpid 11499 ospid 11499 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee500) [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee500), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmDeadProc: proc 0x26a9a20 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26a9a20) con(0x268be50) skgpid 11501 ospid 11501 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ded00) [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ded00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ded00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.385 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26def20) [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26def20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26def20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b6280 [ CSSD]2013-05-23 16:18:53.388 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b6280) con(0x26b3f50) skgpid 11495 ospid 11495 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:53.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681be0) [ CSSD]2013-05-23 16:18:53.391 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681be0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:18:53.391 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681be0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:18:53.391 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:18:53.391 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681600 [ CSSD]2013-05-23 16:18:53.391 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681600) con(0x26aa310) skgpid 11497 ospid 11497 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:18:53.394 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:53.394 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:18:54.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:54.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:54.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:56.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:56.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:56.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:58.397 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:18:58.398 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:18:58.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:18:58.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:18:58.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:18:59.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:00.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:00.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:00.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0554002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:00.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:02.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:02.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:02.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:03.342 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:19:03.343 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:19:03.343 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:19:03.343 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26e1090) pid(17296) version 11:1:1:4 [ CSSD]2013-05-23 16:19:03.349 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x26e91b0) [ CSSD]2013-05-23 16:19:03.349 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e91b0) [ CSSD]2013-05-23 16:19:03.349 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e91b0 with con 0x26ce610, requested num -1 [ CSSD]2013-05-23 16:19:03.349 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:03.349 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681be0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:19:03.350 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:03.350 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:03.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e91b0) [ CSSD]2013-05-23 16:19:03.356 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e91b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:19:03.356 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:03.356 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:03.401 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:03.401 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:03.558 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:19:03.558 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26ee500) skgpid ospid 17296 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:04.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:04.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:04.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:06.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:06.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:06.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:08.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0555002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:08.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:19:08.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:19:08.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:19:08.063 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:08.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0556002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:08.070 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:19:08.070 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:19:08.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:08.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:08.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:08.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:08.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:09.827 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:10.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0557002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:10.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:10.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:10.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:12.407 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:12.407 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:19:12.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:12.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:12.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:14.038 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:19:14.039 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:19:14.039 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:19:14.039 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(17288/17288) version 11:1:1:4 [ CSSD]2013-05-23 16:19:14.045 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x268c0d0) [ CSSD]2013-05-23 16:19:14.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268c0d0) [ CSSD]2013-05-23 16:19:14.045 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:19:14.045 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:19:14.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:14.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:14.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:15.011 [1199044928] >TRACE: clssgmAllocProc: (0x267d410) allocated [ CSSD]2013-05-23 16:19:15.012 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:19:15.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d410 - 1,2,3 [ CSSD]2013-05-23 16:19:15.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4f00) proc(0x267d410) pid(17422) version 11:1:1:4 [ CSSD]2013-05-23 16:19:15.018 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d410), client(1/0x26821f0) [ CSSD]2013-05-23 16:19:15.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:15.018 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26821f0 with con 0x26e1c40, requested num -1 [ CSSD]2013-05-23 16:19:15.018 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:15.018 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:19:15.019 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:15.019 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:15.025 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:15.025 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26821f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:19:15.025 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:15.025 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:15.228 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d410 [ CSSD]2013-05-23 16:19:15.228 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d410) con(0x26e4f00) skgpid ospid 17422 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:16.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:16.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:16.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:17.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:17.411 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:18.591 [1199044928] >TRACE: clssgmAllocProc: (0x267d410) allocated [ CSSD]2013-05-23 16:19:18.592 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:19:18.592 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d410 - 1,2,3 [ CSSD]2013-05-23 16:19:18.592 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e4f00) proc(0x267d410) pid(17451) version 11:1:1:4 [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d410), client(1/0x26821f0) [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26821f0 with con 0x26e1c40, requested num -1 [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650900/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:18.598 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:18.604 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:18.604 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26821f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:19:18.604 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681cb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:18.604 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:18.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:18.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:18.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:18.807 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d410 [ CSSD]2013-05-23 16:19:18.807 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d410) con(0x26e4f00) skgpid ospid 17451 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:18.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0558002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:18.841 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:19:18.841 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:19:18.841 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:19:18.841 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:18.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0559002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:18.848 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:19:18.848 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:19:19.851 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:20.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055a002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:20.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:20.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:20.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:22.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:22.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:22.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:22.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:22.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:23.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(055b002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:23.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:19:23.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:19:23.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:19:23.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:23.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(055c002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:23.333 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:19:23.333 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:19:24.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:24.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:24.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:24.935 [1199044928] >TRACE: clssgmAllocProc: (0x267d410) allocated [ CSSD]2013-05-23 16:19:24.936 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:19:24.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d410 - 1,2,3 [ CSSD]2013-05-23 16:19:24.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba140) proc(0x267d410) pid(17560) version 11:1:1:4 [ CSSD]2013-05-23 16:19:25.054 [1199044928] >TRACE: clssgmAllocProc: (0x269e3f0) allocated [ CSSD]2013-05-23 16:19:25.055 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:19:25.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e3f0 - 1,2,3 [ CSSD]2013-05-23 16:19:25.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26a96d0) proc(0x269e3f0) pid(17570) version 11:1:1:4 [ CSSD]2013-05-23 16:19:25.072 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:19:25.074 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:19:25.078 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e3f0 [ CSSD]2013-05-23 16:19:25.078 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e3f0) con(0x26a96d0) skgpid ospid 17570 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:25.158 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5344/0x26821f0) [ CSSD]2013-05-23 16:19:25.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5344 (0x26821f0) [ CSSD]2013-05-23 16:19:25.158 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26821f0 with con 0x26a96d0, requested num -1 [ CSSD]2013-05-23 16:19:25.158 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:19:25.158 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x2650900/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:19:25.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:25.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:19:25.164 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5344 (0x26821f0) [ CSSD]2013-05-23 16:19:25.164 [1199044928] >TRACE: clssgmExitGrock: client 5344 (0x26821f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:19:25.164 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681cb0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:19:25.164 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x2681cb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:25.166 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d410 [ CSSD]2013-05-23 16:19:25.166 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d410) con(0x26ba140) skgpid ospid 17560 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:26.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:26.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:26.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:27.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:27.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:28.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:28.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:28.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:29.875 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:30.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(055d002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:30.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:30.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:30.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:31.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:31.420 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:19:32.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:32.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:32.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:33.848 [1199044928] >TRACE: clssgmAllocProc: (0x267d410) allocated [ CSSD]2013-05-23 16:19:33.849 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:19:33.849 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d410 - 1,2,3 [ CSSD]2013-05-23 16:19:33.849 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e9440) proc(0x267d410) pid(17637) version 11:1:1:4 [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d410), client(1/0x26821f0) [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26821f0 with con 0x26e4f00, requested num -1 [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681be0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:33.855 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:33.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26821f0) [ CSSD]2013-05-23 16:19:33.861 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26821f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:19:33.861 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650900) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:33.861 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650900) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:34.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d410 [ CSSD]2013-05-23 16:19:34.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d410) con(0x26e9440) skgpid ospid 17637 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:34.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:34.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:34.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:36.424 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:36.424 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:36.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:36.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:36.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:38.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(055e002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:38.592 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:19:38.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:19:38.593 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:19:38.593 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:38.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(055f002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:38.600 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:19:38.600 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:19:38.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:39.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:39.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:39.897 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:40.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0560002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:40.981 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:41.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:41.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:41.427 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:41.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:42.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:43.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:43.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268c0d0) [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268c0d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268c0d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:19:44.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid 17288 ospid 17288 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:44.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:45.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:45.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:46.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:46.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:47.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:47.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:47.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:49.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:49.096 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:19:49.097 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:19:49.097 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:19:49.097 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(17816) version 11:1:1:4 [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x26e91b0) [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e91b0) [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e91b0 with con 0x2679110, requested num -1 [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681be0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:19:49.114 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:49.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e91b0) [ CSSD]2013-05-23 16:19:49.121 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e91b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:19:49.121 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e4e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:19:49.121 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e4e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:19:49.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:49.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:49.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:19:49.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid ospid 17816 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:19:49.930 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:19:50.434 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:50.434 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:19:50.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0561002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:51.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:51.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:51.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:53.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:53.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:53.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:53.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0562002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:53.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:19:53.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:19:53.849 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:19:53.849 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:19:53.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0563002c) incarnation(174631051) [ CSSD]2013-05-23 16:19:53.856 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:19:53.856 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:19:55.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:55.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:55.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:55.438 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:19:55.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:19:57.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:57.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:57.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:59.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:19:59.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:19:59.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:19:59.953 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:00.442 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:00.442 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:00.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0564002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:00.881 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:20:00.882 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:20:00.882 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:20:00.882 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26e1090) pid(17235/17235) version 11:1:1:4 [ CSSD]2013-05-23 16:20:00.898 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x2660680) [ CSSD]2013-05-23 16:20:00.898 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2660680) [ CSSD]2013-05-23 16:20:00.898 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:20:00.898 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:20:00.916 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(2/0x26e4f00) [ CSSD]2013-05-23 16:20:00.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26e4f00) [ CSSD]2013-05-23 16:20:00.916 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:20:00.916 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:20:01.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:01.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:01.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:03.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:03.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:03.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:04.361 [1199044928] >TRACE: clssgmAllocProc: (0x26e1b90) allocated [ CSSD]2013-05-23 16:20:04.362 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:20:04.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1b90 - 1,2,3 [ CSSD]2013-05-23 16:20:04.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bc80) proc(0x26e1b90) pid(18151) version 11:1:1:4 [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1b90), client(1/0x26821e0) [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26821e0) [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26821e0 with con 0x2682130, requested num -1 [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c7c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:20:04.369 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:04.377 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26821e0) [ CSSD]2013-05-23 16:20:04.377 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26821e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:20:04.377 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681d60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:04.377 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681d60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:20:04.464 [1199044928] >TRACE: clssgmAllocProc: (0x269e4a0) allocated [ CSSD]2013-05-23 16:20:04.465 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:20:04.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e4a0 - 1,2,3 [ CSSD]2013-05-23 16:20:04.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681be0) proc(0x269e4a0) pid(18188/18188) version 11:1:1:4 [ CSSD]2013-05-23 16:20:04.481 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e4a0), client(1/0x26bafd0) [ CSSD]2013-05-23 16:20:04.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26bafd0) [ CSSD]2013-05-23 16:20:04.481 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:20:04.481 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:20:04.580 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1b90 [ CSSD]2013-05-23 16:20:04.580 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1b90) con(0x261bc80) skgpid ospid 18151 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:05.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:05.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:05.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:05.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:05.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:07.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:07.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26bafd0) [ CSSD]2013-05-23 16:20:07.190 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26bafd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:20:07.190 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26bafd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:20:07.190 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:20:07.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e4a0 [ CSSD]2013-05-23 16:20:07.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e4a0) con(0x2681be0) skgpid 18188 ospid 18188 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:07.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:07.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:07.330 [1199044928] >TRACE: clssgmAllocProc: (0x268bda0) allocated [ CSSD]2013-05-23 16:20:07.331 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:20:07.332 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268bda0 - 1,2,3 [ CSSD]2013-05-23 16:20:07.332 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26599a0) proc(0x268bda0) pid(17233/17233) version 11:1:1:4 [ CSSD]2013-05-23 16:20:07.347 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268bda0), client(1/0x2681e20) [ CSSD]2013-05-23 16:20:07.347 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681e20) [ CSSD]2013-05-23 16:20:07.347 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:20:07.347 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:20:09.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0565002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:09.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:09.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:09.125 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:09.125 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:09.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0566002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:09.132 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:09.132 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:09.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:09.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:09.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:09.973 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:10.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:10.449 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:10.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0567002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:11.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:11.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:11.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:13.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:13.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:13.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:15.272 [1199044928] >TRACE: clssgmAllocProc: (0x268b580) allocated [ CSSD]2013-05-23 16:20:15.273 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:20:15.274 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268b580 - 1,2,3 [ CSSD]2013-05-23 16:20:15.274 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681d70) proc(0x268b580) pid(18269) version 11:1:1:4 [ CSSD]2013-05-23 16:20:15.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x268b580), client(1/0x269e570) [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269e570) [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269e570 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9af0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:20:15.280 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:15.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269e570) [ CSSD]2013-05-23 16:20:15.286 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269e570), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:20:15.286 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9df0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:15.287 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a9df0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:20:15.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:15.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:15.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:15.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:15.489 [1199044928] >TRACE: clssgmDeadProc: proc 0x268b580 [ CSSD]2013-05-23 16:20:15.489 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268b580) con(0x2681d70) skgpid ospid 18269 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:17.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:17.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:17.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:19.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0568002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:19.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:19.106 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:19.106 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:19.107 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:19.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0569002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:19.115 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:19.115 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2650790) [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2650790), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2650790), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9970 [ CSSD]2013-05-23 16:20:19.137 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9970) con(0x26ceaa0) skgpid 12737 ospid 12737 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:19.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ce930) [ CSSD]2013-05-23 16:20:19.138 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ce930), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:20:19.138 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ce930), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:20:19.138 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:20:19.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:20:19.146 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:20:19.146 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:20:19.146 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:20:19.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:20:19.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x267fa40) skgpid 12739 ospid 12739 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:19.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:19.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:19.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:19.612 [1199044928] >TRACE: clssgmAllocProc: (0x261b9b0) allocated [ CSSD]2013-05-23 16:20:19.613 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:20:19.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b9b0 - 1,2,3 [ CSSD]2013-05-23 16:20:19.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681ca0) proc(0x261b9b0) pid(18309) version 11:1:1:4 [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261b9b0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26ef0a0, requested num -1 [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce6e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:20:19.629 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:19.635 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:20:19.635 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:20:19.635 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26eef20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:19.636 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26eef20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:20:19.838 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b9b0 [ CSSD]2013-05-23 16:20:19.838 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b9b0) con(0x2681ca0) skgpid ospid 18309 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:19.996 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:20.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:20.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:20.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056a002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:21.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:21.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:21.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:23.062 [1199044928] >TRACE: clssgmAllocProc: (0x261b9b0) allocated [ CSSD]2013-05-23 16:20:23.063 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:20:23.064 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b9b0 - 1,2,3 [ CSSD]2013-05-23 16:20:23.064 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681ca0) proc(0x261b9b0) pid(18307/18307) version 11:1:1:4 [ CSSD]2013-05-23 16:20:23.079 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261b9b0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:20:23.079 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:20:23.079 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:20:23.080 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:20:23.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:23.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:23.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:24.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056b002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:24.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:24.403 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:24.403 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:24.403 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:24.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056c002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:24.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:24.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:24.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:24.458 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:20:25.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:25.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:25.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:27.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:27.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:27.460 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:27.509 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261b9b0), client(2/0x26ef0b0) [ CSSD]2013-05-23 16:20:27.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ef0b0) [ CSSD]2013-05-23 16:20:27.509 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:20:27.509 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:20:29.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:29.461 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:29.461 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:29.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:29.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:30.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:30.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(056d002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:31.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:31.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:31.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:33.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:33.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:33.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:34.464 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:34.465 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:34.870 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:20:34.871 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:20:34.872 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:20:34.872 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18468) version 11:1:1:4 [ CSSD]2013-05-23 16:20:34.877 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:20:34.877 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:20:34.877 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:20:34.877 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:34.877 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:20:34.878 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:20:34.878 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:34.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:20:34.884 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:20:34.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:34.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:20:35.087 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:20:35.087 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 18468 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:35.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:35.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:35.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:37.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:37.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:37.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:39.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:39.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:39.468 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:39.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:39.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:39.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(056e002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:39.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:39.654 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:39.654 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:39.654 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:39.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(056f002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:39.661 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:39.661 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:40.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:40.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0570002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:41.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:41.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:41.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:43.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:43.471 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:20:43.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:43.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:43.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:45.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:45.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:45.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:47.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:47.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:47.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:48.475 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:48.475 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:49.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:49.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:49.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:50.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:20:50.130 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:20:50.131 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:20:50.132 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:20:50.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18613) version 11:1:1:4 [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:20:50.137 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:50.144 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:20:50.144 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:20:50.144 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:20:50.144 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:20:50.346 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:20:50.346 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 18613 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:20:50.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0571002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:51.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:51.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:51.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:53.478 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:53.478 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:53.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:53.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:53.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:54.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0572002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:54.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:54.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:54.916 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:54.916 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:54.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0573002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:54.924 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:54.924 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:55.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:55.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:55.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:56.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0574002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:56.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:20:56.652 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:20:56.652 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:20:56.652 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:20:56.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0575002c) incarnation(174631051) [ CSSD]2013-05-23 16:20:56.659 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:20:56.659 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:20:57.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:57.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:57.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:20:58.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:20:58.482 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:20:59.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:20:59.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:20:59.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:00.103 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:00.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0576002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:01.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:01.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:01.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:02.484 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:02.484 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:21:03.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:03.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:03.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:05.385 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:21:05.386 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:21:05.386 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:21:05.387 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18771) version 11:1:1:4 [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:21:05.392 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:05.399 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:05.399 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:21:05.399 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:05.399 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:21:05.601 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:21:05.601 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 18771 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:05.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:05.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:05.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:07.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:07.488 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:07.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:07.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:07.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:09.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:09.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:09.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:10.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:10.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0577002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:10.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:10.173 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:10.173 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:21:10.173 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:10.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0578002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:10.180 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:10.180 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:10.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0579002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:11.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:11.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:11.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:12.491 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:12.491 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:13.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:13.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:13.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:15.429 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:21:15.430 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:21:15.430 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:21:15.430 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18896/18896) version 11:1:1:4 [ CSSD]2013-05-23 16:21:15.446 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:21:15.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:15.446 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:21:15.446 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2679070), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2679070), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:21:15.466 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid 18896 ospid 18896 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:15.534 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:21:15.535 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:21:15.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:21:15.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18898) version 11:1:1:4 [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:21:15.541 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:15.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:15.546 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:21:15.546 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:15.547 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:21:15.749 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:21:15.749 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 18898 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:15.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:15.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:15.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:17.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057a002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:17.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:17.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:17.294 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:21:17.295 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:17.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057b002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:17.301 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:17.301 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:17.435 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:21:17.436 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:21:17.438 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:21:17.438 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:21:17.494 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:17.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:17.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:17.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:17.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:19.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057c002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:19.376 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:19.376 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:19.376 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:21:19.376 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:19.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(057d002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:19.383 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:19.383 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:19.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:19.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:19.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:20.146 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:20.641 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:21:20.642 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:21:20.642 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:21:20.642 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(18940) version 11:1:1:4 [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:21:20.648 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:20.654 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:20.654 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:21:20.654 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:20.654 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:21:20.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:21:20.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 18940 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:20.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(057e002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:21.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:21.497 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:21:21.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:21.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:21.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:23.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:23.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:23.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:25.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(057f002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:25.431 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:25.431 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:25.431 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:21:25.432 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:25.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0580002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:25.439 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:25.439 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:25.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:25.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:25.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:26.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:26.501 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:27.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:27.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:27.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:29.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:30.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:30.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:30.167 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:30.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0581002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:31.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:31.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:31.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:32.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:32.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:33.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:34.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:34.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:35.890 [1199044928] >TRACE: clssgmAllocProc: (0x2678f40) allocated [ CSSD]2013-05-23 16:21:35.891 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:21:35.891 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f40 - 1,2,3 [ CSSD]2013-05-23 16:21:35.891 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650a00) proc(0x2678f40) pid(19079) version 11:1:1:4 [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f40), client(1/0x2679070) [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2679070 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b9570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:21:35.897 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:35.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2679070) [ CSSD]2013-05-23 16:21:35.903 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2679070), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:21:35.903 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:35.903 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:21:35.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:36.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:36.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:36.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f40 [ CSSD]2013-05-23 16:21:36.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f40) con(0x2650a00) skgpid ospid 19079 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:36.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:36.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:37.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:38.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:38.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:40.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:40.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:40.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:40.186 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:40.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:40.510 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:21:40.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0582002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:40.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:40.683 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:40.683 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:21:40.683 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:40.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0583002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:40.690 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:40.690 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:41.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0584002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:42.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:42.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:42.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:44.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:44.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:44.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:45.513 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:45.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:46.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:46.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:46.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:46.328 [1199044928] >TRACE: clssgmAllocProc: (0x267d5f0) allocated [ CSSD]2013-05-23 16:21:46.328 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:21:46.329 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d5f0 - 1,2,3 [ CSSD]2013-05-23 16:21:46.329 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650ad0) proc(0x267d5f0) pid(18305/18305) version 11:1:1:4 [ CSSD]2013-05-23 16:21:46.344 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d5f0), client(1/0x26b9310) [ CSSD]2013-05-23 16:21:46.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9310) [ CSSD]2013-05-23 16:21:46.344 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:21:46.344 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:21:48.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:48.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:48.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:50.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:50.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:50.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:50.220 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:21:50.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:50.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:51.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0585002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:51.138 [1199044928] >TRACE: clssgmAllocProc: (0x26baf30) allocated [ CSSD]2013-05-23 16:21:51.139 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:21:51.139 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26baf30 - 1,2,3 [ CSSD]2013-05-23 16:21:51.139 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650430) proc(0x26baf30) pid(19237) version 11:1:1:4 [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26baf30), client(1/0x26bb220) [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb220 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:21:51.145 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:51.151 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:21:51.151 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb220), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:21:51.151 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:21:51.151 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:21:51.354 [1199044928] >TRACE: clssgmDeadProc: proc 0x26baf30 [ CSSD]2013-05-23 16:21:51.354 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26baf30) con(0x2650430) skgpid ospid 19237 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:21:52.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:52.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:52.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:54.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:54.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:54.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:55.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:55.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:21:55.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0586002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:55.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:21:55.932 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:21:55.932 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:21:55.932 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:21:55.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0587002c) incarnation(174631051) [ CSSD]2013-05-23 16:21:55.939 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:21:55.939 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:21:56.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:56.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:56.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:58.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:21:58.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:21:58.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:21:59.524 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:21:59.524 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:22:00.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:00.244 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:00.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:00.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:01.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0588002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:02.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:02.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:02.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:04.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:04.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:04.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:04.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:04.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:06.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:06.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:06.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:06.387 [1199044928] >TRACE: clssgmAllocProc: (0x26baf30) allocated [ CSSD]2013-05-23 16:22:06.388 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:22:06.388 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26baf30 - 1,2,3 [ CSSD]2013-05-23 16:22:06.388 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b99f0) proc(0x26baf30) pid(19400) version 11:1:1:4 [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26baf30), client(1/0x26bb220) [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb220 with con 0x26bae70, requested num -1 [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:22:06.395 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:06.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:06.402 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb220), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:22:06.402 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:06.402 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:22:06.604 [1199044928] >TRACE: clssgmDeadProc: proc 0x26baf30 [ CSSD]2013-05-23 16:22:06.604 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26baf30) con(0x26b99f0) skgpid ospid 19400 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:06.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0589002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:06.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:06.696 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:06.696 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:06.697 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:06.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058a002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:06.705 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:06.705 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:08.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:08.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:08.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:09.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:09.532 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:10.265 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:10.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:10.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:10.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:11.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(058b002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:11.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058c002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:11.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:11.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:11.199 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:11.199 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:11.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058d002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:11.205 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:11.206 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:11.209 [1199044928] >TRACE: clssgmAllocProc: (0x26bb010) allocated [ CSSD]2013-05-23 16:22:11.210 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:22:11.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb010 - 1,2,3 [ CSSD]2013-05-23 16:22:11.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650430) proc(0x26bb010) pid(19515) version 11:1:1:4 [ CSSD]2013-05-23 16:22:12.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:12.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:12.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:13.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:13.534 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:22:13.954 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb010 [ CSSD]2013-05-23 16:22:13.954 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb010) con(0x2650430) skgpid ospid 19515 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:14.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:14.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:14.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:15.789 [1199044928] >TRACE: clssgmAllocProc: (0x26baf30) allocated [ CSSD]2013-05-23 16:22:15.790 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:22:15.790 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26baf30 - 1,2,3 [ CSSD]2013-05-23 16:22:15.790 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650430) proc(0x26baf30) pid(19838) version 11:1:1:4 [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26baf30), client(1/0x26bb220) [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb220 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:22:15.797 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:15.805 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:15.805 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb220), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:22:15.805 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:15.805 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:22:15.924 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:22:15.924 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:22:15.926 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:22:15.926 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:22:15.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(058e002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:15.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:15.994 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:15.994 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:22:15.994 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:22:16.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(058f002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:16.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:16.001 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:16.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x26baf30 [ CSSD]2013-05-23 16:22:16.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26baf30) con(0x2650430) skgpid ospid 19838 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:16.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:16.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:16.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:18.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:18.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:18.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:18.538 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:18.538 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:19.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0590002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:19.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:19.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:19.636 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:19.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:19.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0591002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:19.643 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:19.643 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:20.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:20.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:20.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:20.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:21.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0592002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:21.640 [1199044928] >TRACE: clssgmAllocProc: (0x26baf30) allocated [ CSSD]2013-05-23 16:22:21.641 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:22:21.642 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26baf30 - 1,2,3 [ CSSD]2013-05-23 16:22:21.642 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2650430) proc(0x26baf30) pid(19891) version 11:1:1:4 [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26baf30), client(1/0x26bb220) [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bb220 with con 0x26b99f0, requested num -1 [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:22:21.648 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:21.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bb220) [ CSSD]2013-05-23 16:22:21.655 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bb220), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:22:21.655 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:21.655 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:22:21.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x26baf30 [ CSSD]2013-05-23 16:22:21.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26baf30) con(0x2650430) skgpid ospid 19891 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:22.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:22.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:22.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:23.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:23.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:24.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:24.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:24.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:26.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:26.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0593002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:26.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:26.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:26.462 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:26.462 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:26.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0594002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:26.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:26.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:26.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:26.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:28.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:28.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:28.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:28.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:28.546 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:28.743 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d5f0), client(2/0x26b9260) [ CSSD]2013-05-23 16:22:28.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b9260) [ CSSD]2013-05-23 16:22:28.743 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:22:28.743 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:22:30.309 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:30.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:30.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:30.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:31.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0595002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:32.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:32.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:32.549 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:22:32.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:32.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:34.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:34.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:34.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:36.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:36.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:36.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:36.891 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:22:36.892 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:22:36.892 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:22:36.892 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(20055) version 11:1:1:4 [ CSSD]2013-05-23 16:22:36.908 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:22:36.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:22:36.908 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:22:36.908 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:36.908 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:22:36.909 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:22:36.909 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:36.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:22:36.915 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:22:36.915 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:36.915 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:22:37.118 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:22:37.118 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 20055 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:37.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:37.552 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:38.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:38.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:38.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:40.331 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:40.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:40.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:40.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:41.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0596002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:41.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0597002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:41.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:41.742 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:41.742 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:41.742 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:41.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0598002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:41.748 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:41.748 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:42.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:42.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:42.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:42.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:42.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:44.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:44.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:44.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:46.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:46.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:46.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:47.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:47.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:48.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:48.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:48.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:50.371 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:22:50.665 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:50.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:50.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:51.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0599002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:51.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:51.562 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:22:52.153 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:22:52.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:22:52.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:22:52.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(20225) version 11:1:1:4 [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:22:52.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:52.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:22:52.167 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:22:52.167 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:22:52.168 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:22:52.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:22:52.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 20225 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:22:52.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:52.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:52.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:54.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:54.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:54.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:56.566 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:22:56.566 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:22:56.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:56.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:56.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:22:56.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059a002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:56.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:22:56.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:22:56.997 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:22:56.997 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:22:57.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059b002c) incarnation(174631051) [ CSSD]2013-05-23 16:22:57.005 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:22:57.005 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:22:58.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:22:58.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:22:58.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:00.392 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:00.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:00.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:00.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:01.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(059c002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:01.570 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:01.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:02.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:02.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:02.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:04.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:04.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:04.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:05.573 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:05.573 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:23:06.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:06.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:06.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:07.403 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:23:07.404 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:23:07.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:23:07.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b99f0) proc(0x2699fb0) pid(20364) version 11:1:1:4 [ CSSD]2013-05-23 16:23:07.410 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x269a560) [ CSSD]2013-05-23 16:23:07.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269a560) [ CSSD]2013-05-23 16:23:07.410 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269a560 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:07.410 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:07.410 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:23:07.411 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:07.411 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:07.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269a560) [ CSSD]2013-05-23 16:23:07.417 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269a560), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:23:07.417 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a9d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:07.417 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a9d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:07.619 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:23:07.619 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b99f0) skgpid ospid 20364 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:08.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:08.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:08.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:10.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:10.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:10.576 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:10.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:10.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:10.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:11.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(059d002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:12.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(059e002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:12.271 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:23:12.271 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:23:12.271 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:23:12.271 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:12.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(059f002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:12.278 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:23:12.278 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:23:12.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:12.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:12.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:14.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:14.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:14.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:15.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:15.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:16.053 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:23:16.054 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:23:16.054 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:23:16.054 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(20459) version 11:1:1:4 [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:16.071 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:16.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:16.078 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:23:16.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:16.078 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:16.281 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:23:16.281 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 20459 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:16.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:16.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:16.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:18.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:18.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:18.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:19.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a0002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:19.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:23:19.892 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:23:19.892 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:23:19.892 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:19.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a1002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:19.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:23:19.899 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:23:20.433 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:20.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:20.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:20.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:20.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:20.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:21.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a2002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:22.654 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:23:22.655 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:23:22.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:23:22.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(20513) version 11:1:1:4 [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:22.662 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:22.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:22.668 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:23:22.668 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:22.668 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:22.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:23:22.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 20513 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:22.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:23.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:23.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:24.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:24.586 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:23:25.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:25.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:25.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:27.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:27.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:27.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:27.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a3002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:27.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:23:27.527 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:23:27.527 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:23:27.527 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:27.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a4002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:27.534 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:23:27.534 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:23:29.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:29.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:29.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:29.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:29.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:30.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:31.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:31.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:31.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:31.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a5002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:33.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:33.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:33.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:34.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:34.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:35.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:35.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:35.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:37.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:37.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:37.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:37.904 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:23:37.904 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:23:37.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:23:37.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(20677) version 11:1:1:4 [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:37.911 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:37.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:37.919 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:23:37.919 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:37.919 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:38.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:23:38.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 20677 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:38.343 [1199044928] >TRACE: clssgmAllocProc: (0x26baed0) allocated [ CSSD]2013-05-23 16:23:38.344 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:23:38.345 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26baed0 - 1,2,3 [ CSSD]2013-05-23 16:23:38.345 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x26baed0) pid(20718) version 11:1:1:4 [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26baed0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269e480/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:38.362 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:38.369 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:38.369 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:23:38.369 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e780) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:23:38.369 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x269e780) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:38.475 [1199044928] >TRACE: clssgmAllocProc: (0x26aab80) allocated [ CSSD]2013-05-23 16:23:38.476 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:23:38.476 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab80 - 1,2,3 [ CSSD]2013-05-23 16:23:38.476 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b96d0) proc(0x26aab80) pid(20729) version 11:1:1:4 [ CSSD]2013-05-23 16:23:38.503 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:23:38.505 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:23:38.508 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:23:38.509 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab80 [ CSSD]2013-05-23 16:23:38.509 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab80) con(0x26b96d0) skgpid ospid 20729 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:38.671 [1199044928] >TRACE: clssgmDeadProc: proc 0x26baed0 [ CSSD]2013-05-23 16:23:38.671 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26baed0) con(0x26b9850) skgpid ospid 20718 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:39.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:39.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:39.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:39.596 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:39.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:40.476 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:40.890 [1199044928] >TRACE: clssgmAllocProc: (0x26bb0d0) allocated [ CSSD]2013-05-23 16:23:40.890 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:23:40.891 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb0d0 - 1,2,3 [ CSSD]2013-05-23 16:23:40.891 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b96d0) proc(0x26bb0d0) pid(20767) version 11:1:1:4 [ CSSD]2013-05-23 16:23:41.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:41.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:41.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:41.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a6002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:41.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb0d0 [ CSSD]2013-05-23 16:23:41.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb0d0) con(0x26b96d0) skgpid ospid 20767 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:42.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05a7002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:42.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:23:42.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:23:42.778 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:23:42.778 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:42.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05a8002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:42.786 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:23:42.786 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:23:43.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:43.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:43.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:44.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:44.600 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:45.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:45.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:45.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:47.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:47.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:47.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:49.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:49.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:49.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:49.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:49.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:50.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:23:51.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:51.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:51.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:51.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05a9002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:53.153 [1199044928] >TRACE: clssgmAllocProc: (0x2699fb0) allocated [ CSSD]2013-05-23 16:23:53.154 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:23:53.154 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699fb0 - 1,2,3 [ CSSD]2013-05-23 16:23:53.154 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9850) proc(0x2699fb0) pid(21007) version 11:1:1:4 [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x2699fb0), client(1/0x26b99f0) [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b99f0 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:23:53.161 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:53.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b99f0) [ CSSD]2013-05-23 16:23:53.168 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b99f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:23:53.168 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:23:53.169 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:23:53.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:53.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:53.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:53.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699fb0 [ CSSD]2013-05-23 16:23:53.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699fb0) con(0x26b9850) skgpid ospid 21007 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:53.775 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26e8d80) [ CSSD]2013-05-23 16:23:53.775 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26e8d80), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:23:53.775 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26e8d80), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:23:53.775 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:23:53.781 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ee270) [ CSSD]2013-05-23 16:23:53.781 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:23:53.781 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ee270), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:23:53.781 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:23:53.782 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9db0 [ CSSD]2013-05-23 16:23:53.782 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9db0) con(0x267fe20) skgpid 15101 ospid 15101 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:23:54.607 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:54.607 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:23:55.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:55.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:55.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:57.311 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:57.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:57.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:23:58.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05aa002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:58.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:23:58.034 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:23:58.034 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:23:58.034 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:23:58.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ab002c) incarnation(174631051) [ CSSD]2013-05-23 16:23:58.040 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:23:58.040 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:23:58.610 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:23:58.610 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:23:59.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:23:59.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:23:59.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:00.517 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:01.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ac002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:01.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:01.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:01.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:01.777 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:24:01.778 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:24:01.778 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:24:01.778 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(20997/20997) version 11:1:1:4 [ CSSD]2013-05-23 16:24:01.784 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8c00) [ CSSD]2013-05-23 16:24:01.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:24:01.784 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:24:01.784 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:24:03.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:03.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:03.410 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:03.613 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:03.614 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:05.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:05.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:05.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:07.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:07.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:07.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:08.404 [1199044928] >TRACE: clssgmAllocProc: (0x26bb190) allocated [ CSSD]2013-05-23 16:24:08.405 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:24:08.405 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb190 - 1,2,3 [ CSSD]2013-05-23 16:24:08.405 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8d70) proc(0x26bb190) pid(21171) version 11:1:1:4 [ CSSD]2013-05-23 16:24:08.411 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb190), client(1/0x26a9e60) [ CSSD]2013-05-23 16:24:08.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9e60) [ CSSD]2013-05-23 16:24:08.411 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9e60 with con 0x26e8b50, requested num -1 [ CSSD]2013-05-23 16:24:08.411 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:08.411 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9fd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:24:08.412 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:08.412 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:08.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9e60) [ CSSD]2013-05-23 16:24:08.418 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9e60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:24:08.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:08.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:08.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:08.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:08.620 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb190 [ CSSD]2013-05-23 16:24:08.620 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb190) con(0x26e8d70) skgpid ospid 21171 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:09.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:09.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:09.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:10.540 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:11.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ad002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:11.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:11.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:11.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:13.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ae002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:13.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:24:13.290 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:24:13.290 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:24:13.290 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:13.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05af002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:13.298 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:24:13.298 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:24:13.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:13.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:13.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:13.619 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:13.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:15.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:15.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:15.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:16.323 [1199044928] >TRACE: clssgmAllocProc: (0x26bb190) allocated [ CSSD]2013-05-23 16:24:16.323 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:24:16.324 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb190 - 1,2,3 [ CSSD]2013-05-23 16:24:16.324 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8d70) proc(0x26bb190) pid(21266) version 11:1:1:4 [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb190), client(1/0x26a9e60) [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9e60) [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9e60 with con 0x26e8b50, requested num -1 [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a9fd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:16.330 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:16.336 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9e60) [ CSSD]2013-05-23 16:24:16.336 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9e60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:24:16.336 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:16.336 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:16.539 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb190 [ CSSD]2013-05-23 16:24:16.539 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb190) con(0x26e8d70) skgpid ospid 21266 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:17.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:17.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:17.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:18.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:18.623 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:19.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:19.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:19.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:20.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b0002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:20.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:24:20.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:24:20.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:24:20.151 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:20.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b1002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:20.157 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:24:20.157 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:24:20.560 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:21.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b2002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:21.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:21.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:21.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:23.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:23.626 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:23.626 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:23.662 [1199044928] >TRACE: clssgmAllocProc: (0x26bb190) allocated [ CSSD]2013-05-23 16:24:23.662 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:24:23.663 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb190 - 1,2,3 [ CSSD]2013-05-23 16:24:23.663 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x26bb190) pid(21324) version 11:1:1:4 [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb190), client(1/0x26a9f20) [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26a9f20) [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26a9f20 with con 0x26a9830, requested num -1 [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:23.669 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:23.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26a9f20) [ CSSD]2013-05-23 16:24:23.675 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26a9f20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:24:23.675 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:23.675 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:23.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:23.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:23.878 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb190 [ CSSD]2013-05-23 16:24:23.878 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb190) con(0x26e8b50) skgpid ospid 21324 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:25.251 [1199044928] >TRACE: clssgmAllocProc: (0x26bb190) allocated [ CSSD]2013-05-23 16:24:25.252 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:24:25.253 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb190 - 1,2,3 [ CSSD]2013-05-23 16:24:25.253 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8d70) proc(0x26bb190) pid(21377) version 11:1:1:4 [ CSSD]2013-05-23 16:24:25.371 [1199044928] >TRACE: clssgmAllocProc: (0x269b160) allocated [ CSSD]2013-05-23 16:24:25.372 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:24:25.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b160 - 1,2,3 [ CSSD]2013-05-23 16:24:25.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e8b50) proc(0x269b160) pid(21387) version 11:1:1:4 [ CSSD]2013-05-23 16:24:25.388 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:24:25.390 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:24:25.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b160 [ CSSD]2013-05-23 16:24:25.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b160) con(0x26e8b50) skgpid ospid 21387 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5345/0x269b510) [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5345 (0x269b510) [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x269b510 with con 0x26e8b50, requested num -1 [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26a9cd0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:25.474 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:24:25.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5345 (0x269b510) [ CSSD]2013-05-23 16:24:25.480 [1199044928] >TRACE: clssgmExitGrock: client 5345 (0x269b510), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:24:25.480 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a9fd0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:24:25.480 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26a9fd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:25.481 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb190 [ CSSD]2013-05-23 16:24:25.481 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb190) con(0x26e8d70) skgpid ospid 21377 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:25.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:25.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:25.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:27.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:27.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:27.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:28.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b3002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:28.561 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:24:28.561 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:24:28.561 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:24:28.561 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:28.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b4002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:28.567 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:24:28.567 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:24:28.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:28.630 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:29.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:29.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:29.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:30.581 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:31.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b5002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:31.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e8c00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e8c00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:24:31.834 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid 20997 ospid 20997 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:31.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:31.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:33.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:33.633 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:33.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:33.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:33.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:35.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:35.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:35.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:37.661 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:37.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:37.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:38.636 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:38.636 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:38.914 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:24:38.915 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:24:38.915 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:24:38.915 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(21490) version 11:1:1:4 [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8d80) [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8d80 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:38.921 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:38.928 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:24:38.928 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:24:38.928 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:38.928 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:39.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:24:39.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid ospid 21490 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:39.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:39.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:39.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:40.604 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:41.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b6002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:41.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:41.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:41.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:43.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:43.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:43.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:43.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05b7002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:43.808 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:24:43.808 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:24:43.808 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:24:43.808 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:43.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05b8002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:43.815 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:24:43.815 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:24:43.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:43.972 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:45.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:45.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:45.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:47.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:47.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:47.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:48.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:48.643 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:49.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:49.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:49.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:50.628 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:24:51.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05b9002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:51.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:51.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:51.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:53.646 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:53.647 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:24:53.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:53.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:53.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:54.164 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:24:54.165 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:24:54.165 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:24:54.165 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(21646) version 11:1:1:4 [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8d80) [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8d80 with con 0x267fe20, requested num -1 [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:24:54.172 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:54.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:24:54.180 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:24:54.180 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:24:54.180 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:24:54.382 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:24:54.382 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid ospid 21646 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:24:55.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:55.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:55.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:57.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:24:57.650 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:24:57.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:57.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:57.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:24:59.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ba002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:59.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:24:59.058 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:24:59.058 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:24:59.058 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:24:59.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05bb002c) incarnation(174631051) [ CSSD]2013-05-23 16:24:59.065 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:24:59.065 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:24:59.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:24:59.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:24:59.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:00.648 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:01.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05bc002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:01.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:01.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:01.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:02.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:02.653 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:03.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:04.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:04.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:04.929 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:25:04.929 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:25:04.930 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:25:04.930 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(21793/21793) version 11:1:1:4 [ CSSD]2013-05-23 16:25:04.935 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8c00) [ CSSD]2013-05-23 16:25:04.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:25:04.935 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:25:04.935 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e8c00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e8c00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:25:05.215 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid 21793 ospid 21793 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:05.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:06.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:06.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:07.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:07.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:07.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:08.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:08.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:09.415 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:25:09.416 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:25:09.417 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:25:09.417 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(21825) version 11:1:1:4 [ CSSD]2013-05-23 16:25:09.432 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8d80) [ CSSD]2013-05-23 16:25:09.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:25:09.432 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8d80 with con 0x26b96d0, requested num -1 [ CSSD]2013-05-23 16:25:09.433 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:09.433 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:25:09.433 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:25:09.433 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:09.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:25:09.439 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:25:09.439 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:09.439 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:25:09.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:25:09.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid ospid 21825 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:10.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:10.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:10.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:10.668 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:11.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05bd002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:12.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:12.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:12.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:12.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:12.660 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:14.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:14.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:14.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:14.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05be002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:14.307 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:25:14.307 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:25:14.307 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:25:14.307 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:14.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05bf002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:14.314 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:25:14.314 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:25:16.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:16.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:16.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:16.574 [1199044928] >TRACE: clssgmAllocProc: (0x261be20) allocated [ CSSD]2013-05-23 16:25:16.575 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:25:16.575 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261be20 - 1,2,3 [ CSSD]2013-05-23 16:25:16.575 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e14f0) proc(0x261be20) pid(21914) version 11:1:1:4 [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261be20), client(1/0x26e8d80) [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8d80 with con 0x267fe20, requested num -1 [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ba1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:25:16.593 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:16.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8d80) [ CSSD]2013-05-23 16:25:16.600 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8d80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:25:16.600 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:16.600 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:25:16.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:16.663 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:25:16.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x261be20 [ CSSD]2013-05-23 16:25:16.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261be20) con(0x26e14f0) skgpid ospid 21914 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:18.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:18.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:18.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:19.208 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26a8db0) [ CSSD]2013-05-23 16:25:19.208 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26a8db0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:25:19.208 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26a8db0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:25:19.208 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:25:19.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e87a0) [ CSSD]2013-05-23 16:25:19.218 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e87a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:25:19.218 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e87a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:25:19.218 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:25:19.219 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e4d00 [ CSSD]2013-05-23 16:25:19.219 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e4d00) con(0x266f0d0) skgpid 16392 ospid 16392 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:20.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:20.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:20.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:20.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c0002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:20.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:25:20.415 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:25:20.415 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:25:20.415 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:20.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c1002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:20.422 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:25:20.422 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:25:20.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:20.841 [1199044928] >TRACE: clssgmAllocProc: (0x268f960) allocated [ CSSD]2013-05-23 16:25:20.842 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:25:20.842 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268f960 - 1,2,3 [ CSSD]2013-05-23 16:25:20.842 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x268f960) pid(21957/21957) version 11:1:1:4 [ CSSD]2013-05-23 16:25:20.858 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268f960), client(1/0x26eeb30) [ CSSD]2013-05-23 16:25:20.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eeb30) [ CSSD]2013-05-23 16:25:20.858 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:25:20.858 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:25:21.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c2002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:21.666 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:21.666 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:22.049 [1199044928] >TRACE: clssgmAllocProc: (0x26b9850) allocated [ CSSD]2013-05-23 16:25:22.050 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:25:22.050 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9850 - 1,2,3 [ CSSD]2013-05-23 16:25:22.050 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c280) proc(0x26b9850) pid(21975/21975) version 11:1:1:4 [ CSSD]2013-05-23 16:25:22.056 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9850), client(1/0x261bee0) [ CSSD]2013-05-23 16:25:22.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261bee0) [ CSSD]2013-05-23 16:25:22.056 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:25:22.056 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:25:22.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:22.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:22.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:23.325 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x268f960), client(2/0x26ba1f0) [ CSSD]2013-05-23 16:25:23.325 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ba1f0) [ CSSD]2013-05-23 16:25:23.325 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:25:23.325 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:25:24.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:24.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:24.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:24.675 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 16:25:24.675 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:25:24.676 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 16:25:24.676 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba830) proc(0x269e7b0) pid(21995) version 11:1:1:4 [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e7b0), client(1/0x269ec10) [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec10) [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec10 with con 0x26bb200, requested num -1 [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:25:24.682 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:24.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec10) [ CSSD]2013-05-23 16:25:24.688 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:25:24.688 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:24.689 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:25:24.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261bee0) [ CSSD]2013-05-23 16:25:24.727 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261bee0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:25:24.727 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261bee0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:25:24.727 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:25:24.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9850 [ CSSD]2013-05-23 16:25:24.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9850) con(0x268c280) skgpid 21975 ospid 21975 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:24.891 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 16:25:24.891 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x26ba830) skgpid ospid 21995 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:25.381 [1199044928] >TRACE: clssgmAllocProc: (0x26b9850) allocated [ CSSD]2013-05-23 16:25:25.382 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:25:25.383 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b9850 - 1,2,3 [ CSSD]2013-05-23 16:25:25.383 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2659580) proc(0x26b9850) pid(21955/21955) version 11:1:1:4 [ CSSD]2013-05-23 16:25:25.398 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9850), client(1/0x268c680) [ CSSD]2013-05-23 16:25:25.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268c680) [ CSSD]2013-05-23 16:25:25.398 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:25:25.398 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:25:26.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:26.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:26.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:26.670 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:26.670 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:28.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:28.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:28.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:29.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c3002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:29.555 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:25:29.555 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:25:29.555 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:25:29.555 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:29.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c4002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:29.562 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:25:29.562 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:25:30.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:30.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:30.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:30.714 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:31.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c5002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:31.673 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:31.673 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:32.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:32.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:32.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:34.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:34.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:34.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:35.676 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:35.676 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:25:36.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:36.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:36.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:38.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:38.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:38.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:39.928 [1199044928] >TRACE: clssgmAllocProc: (0x269e6e0) allocated [ CSSD]2013-05-23 16:25:39.929 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:25:39.930 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e6e0 - 1,2,3 [ CSSD]2013-05-23 16:25:39.930 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba820) proc(0x269e6e0) pid(22171) version 11:1:1:4 [ CSSD]2013-05-23 16:25:39.936 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e6e0), client(1/0x269ec00) [ CSSD]2013-05-23 16:25:39.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:25:39.936 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec00 with con 0x269e620, requested num -1 [ CSSD]2013-05-23 16:25:39.936 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:39.936 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:25:39.937 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:25:39.937 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:39.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:25:39.943 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:25:39.943 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:39.944 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:25:40.146 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e6e0 [ CSSD]2013-05-23 16:25:40.146 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e6e0) con(0x26ba820) skgpid ospid 22171 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:40.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:40.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:40.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:40.679 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:40.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:40.736 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:41.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c6002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:42.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:42.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:42.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:44.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:44.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:44.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:44.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05c7002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:44.818 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:25:44.818 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:25:44.818 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:25:44.818 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:44.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05c8002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:44.825 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:25:44.825 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:25:45.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:45.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:46.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:46.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:46.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:48.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:48.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:48.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:50.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:50.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:50.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:50.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:50.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:25:50.757 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:25:51.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05c9002c) incarnation(174631051) [ CSSD]2013-05-23 16:25:52.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:52.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:52.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:54.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:54.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:54.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:54.689 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:54.689 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:25:55.179 [1199044928] >TRACE: clssgmAllocProc: (0x269e6e0) allocated [ CSSD]2013-05-23 16:25:55.180 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:25:55.180 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e6e0 - 1,2,3 [ CSSD]2013-05-23 16:25:55.180 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba820) proc(0x269e6e0) pid(22329) version 11:1:1:4 [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e6e0), client(1/0x269ec00) [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec00 with con 0x269e620, requested num -1 [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:25:55.186 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:25:55.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:25:55.193 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:25:55.193 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:25:55.193 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:25:55.395 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e6e0 [ CSSD]2013-05-23 16:25:55.395 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e6e0) con(0x26ba820) skgpid ospid 22329 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:25:56.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:56.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:56.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:58.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:25:58.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:25:58.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:25:59.693 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:25:59.693 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:00.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ca002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:00.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:00.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:00.068 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:26:00.068 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:00.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05cb002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:00.075 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:00.075 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:00.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:00.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:00.606 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:00.777 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:01.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05cc002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:02.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:02.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:02.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:04.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:04.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:04.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:04.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:04.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:06.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:06.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:06.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:08.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:08.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:08.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:09.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:09.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:10.443 [1199044928] >TRACE: clssgmAllocProc: (0x269e6e0) allocated [ CSSD]2013-05-23 16:26:10.444 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:26:10.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e6e0 - 1,2,3 [ CSSD]2013-05-23 16:26:10.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba820) proc(0x269e6e0) pid(22473) version 11:1:1:4 [ CSSD]2013-05-23 16:26:10.451 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e6e0), client(1/0x269ec00) [ CSSD]2013-05-23 16:26:10.451 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:26:10.451 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269ec00 with con 0x269e620, requested num -1 [ CSSD]2013-05-23 16:26:10.451 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:10.451 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:26:10.452 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:26:10.452 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:10.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269ec00) [ CSSD]2013-05-23 16:26:10.458 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269ec00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:26:10.458 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:10.458 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:26:10.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:10.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:10.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:10.661 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e6e0 [ CSSD]2013-05-23 16:26:10.661 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e6e0) con(0x26ba820) skgpid ospid 22473 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:10.797 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:11.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05cd002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:12.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:12.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:12.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:14.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:14.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:14.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:14.703 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:14.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:15.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ce002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:15.327 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:15.327 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:15.327 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:26:15.328 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:15.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05cf002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:15.335 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:15.335 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:15.933 [1199044928] >TRACE: clssgmAllocProc: (0x269e6e0) allocated [ CSSD]2013-05-23 16:26:15.934 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:26:15.934 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e6e0 - 1,2,3 [ CSSD]2013-05-23 16:26:15.934 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba820) proc(0x269e6e0) pid(22558/22558) version 11:1:1:4 [ CSSD]2013-05-23 16:26:15.950 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e6e0), client(1/0x26aa000) [ CSSD]2013-05-23 16:26:15.950 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26aa000) [ CSSD]2013-05-23 16:26:15.950 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:26:15.950 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:26:15.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26aa000) [ CSSD]2013-05-23 16:26:15.967 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26aa000), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:26:15.968 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26aa000), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:26:15.968 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:26:15.968 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e6e0 [ CSSD]2013-05-23 16:26:15.968 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e6e0) con(0x26ba820) skgpid 22558 ospid 22558 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:16.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:16.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:16.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:16.844 [1199044928] >TRACE: clssgmAllocProc: (0x269e7b0) allocated [ CSSD]2013-05-23 16:26:16.845 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:26:16.845 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269e7b0 - 1,2,3 [ CSSD]2013-05-23 16:26:16.845 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba8d0) proc(0x269e7b0) pid(22567) version 11:1:1:4 [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269e7b0), client(1/0x26aa240) [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aa240) [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aa240 with con 0x269e6f0, requested num -1 [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26aa3b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:26:16.851 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:16.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aa240) [ CSSD]2013-05-23 16:26:16.857 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aa240), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:26:16.857 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aa6b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:16.857 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aa6b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:26:17.060 [1199044928] >TRACE: clssgmDeadProc: proc 0x269e7b0 [ CSSD]2013-05-23 16:26:17.060 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269e7b0) con(0x26ba8d0) skgpid ospid 22567 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:17.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d0002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:17.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:17.598 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:17.598 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:26:17.598 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:17.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d1002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:17.606 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:17.606 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:17.742 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:26:17.743 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:26:17.744 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:26:17.745 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:26:18.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:18.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:18.758 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:19.706 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:19.706 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:20.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d2002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:20.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:20.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:20.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:26:20.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:20.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d3002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:20.675 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:20.675 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:20.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:20.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:20.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:20.818 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:21.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d4002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:22.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:22.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:22.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:23.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26e4f00) [ CSSD]2013-05-23 16:26:23.800 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26e4f00), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:26:23.800 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26e4f00), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:26:23.800 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:26:23.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681e20) [ CSSD]2013-05-23 16:26:23.801 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681e20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:26:23.801 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681e20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:26:23.801 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:26:23.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x268bda0 [ CSSD]2013-05-23 16:26:23.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268bda0) con(0x26599a0) skgpid 17233 ospid 17233 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2660680) [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2660680), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2660680), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:26:23.811 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x2660e70) skgpid 17235 ospid 17235 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:24.451 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:26:24.451 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:26:24.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:26:24.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26e1090) pid(22624/22624) version 11:1:1:4 [ CSSD]2013-05-23 16:26:24.457 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x2681e20) [ CSSD]2013-05-23 16:26:24.457 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681e20) [ CSSD]2013-05-23 16:26:24.457 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:26:24.457 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:26:24.709 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:24.709 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:24.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:24.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:24.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:25.696 [1199044928] >TRACE: clssgmAllocProc: (0x2650610) allocated [ CSSD]2013-05-23 16:26:25.697 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:26:25.698 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650610 - 1,2,3 [ CSSD]2013-05-23 16:26:25.698 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba140) proc(0x2650610) pid(22638) version 11:1:1:4 [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2650610), client(1/0x2682130) [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2682130) [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2682130 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699d70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:26:25.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:25.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2682130) [ CSSD]2013-05-23 16:26:25.710 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2682130), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:26:25.710 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e1280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:25.710 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e1280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:26:25.912 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650610 [ CSSD]2013-05-23 16:26:25.912 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650610) con(0x26ba140) skgpid ospid 22638 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:26.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:26.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:26.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:28.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:28.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:28.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:29.712 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:29.712 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:30.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d5002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:30.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:30.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:30.587 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:26:30.587 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:30.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05d6002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:30.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:30.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:30.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:30.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:30.840 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:30.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:31.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d7002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:32.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:32.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:32.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:33.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:33.715 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:26:34.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:34.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:34.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:36.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:36.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:36.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:38.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:38.719 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:38.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:38.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:38.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:40.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:40.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:40.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:40.945 [1199044928] >TRACE: clssgmAllocProc: (0x2650610) allocated [ CSSD]2013-05-23 16:26:40.946 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:26:40.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650610 - 1,2,3 [ CSSD]2013-05-23 16:26:40.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x2650610) pid(22804) version 11:1:1:4 [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2650610), client(1/0x261ca00) [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca00) [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca00 with con 0x26ba140, requested num -1 [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699d70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:26:40.953 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:40.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca00) [ CSSD]2013-05-23 16:26:40.960 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:26:40.960 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682070) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:40.960 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682070) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:26:40.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:41.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650610 [ CSSD]2013-05-23 16:26:41.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650610) con(0x26b9a50) skgpid ospid 22804 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:41.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05d8002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:42.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:42.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:42.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:43.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:43.722 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:44.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:44.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:44.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:45.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05d9002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:45.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:26:45.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:26:45.846 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:26:45.846 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:45.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05da002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:45.853 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:26:45.853 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:26:46.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:46.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:47.003 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:48.726 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:48.726 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:48.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:48.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:49.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:50.885 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:26:50.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:50.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:51.041 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:51.327 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(2/0x26e4dd0) [ CSSD]2013-05-23 16:26:51.327 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26e4dd0) [ CSSD]2013-05-23 16:26:51.327 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:26:51.327 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:26:51.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05db002c) incarnation(174631051) [ CSSD]2013-05-23 16:26:52.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:52.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:53.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:53.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:53.729 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:54.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:54.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:55.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:56.210 [1199044928] >TRACE: clssgmAllocProc: (0x26e1350) allocated [ CSSD]2013-05-23 16:26:56.211 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:26:56.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1350 - 1,2,3 [ CSSD]2013-05-23 16:26:56.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x26e1350) pid(22946) version 11:1:1:4 [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26e1350), client(1/0x261ca70) [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261ca70) [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261ca70 with con 0x26e1ca0, requested num -1 [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2699fb0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:26:56.218 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:26:56.224 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261ca70) [ CSSD]2013-05-23 16:26:56.224 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261ca70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:26:56.224 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a2b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:26:56.225 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a2b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:26:56.427 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1350 [ CSSD]2013-05-23 16:26:56.427 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1350) con(0x261bfd0) skgpid ospid 22946 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:26:57.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:57.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:57.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:26:58.152 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b9850), client(2/0x26598b0) [ CSSD]2013-05-23 16:26:58.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26598b0) [ CSSD]2013-05-23 16:26:58.152 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:26:58.152 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:26:58.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:26:58.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:26:59.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:26:59.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:26:59.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:00.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:01.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05dc002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:01.096 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:01.096 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:01.096 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:27:01.096 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:01.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:01.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:01.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05dd002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:01.104 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:01.104 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:01.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:01.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05de002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:03.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:03.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:03.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:03.736 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:03.736 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:05.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:05.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:05.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:07.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:07.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:07.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:07.739 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:07.739 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:27:09.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:09.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:09.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:10.934 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:11.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:11.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:11.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:11.466 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:27:11.466 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:27:11.467 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:27:11.467 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2682140) pid(23172) version 11:1:1:4 [ CSSD]2013-05-23 16:27:11.473 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:11.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:11.473 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261cb20, requested num -1 [ CSSD]2013-05-23 16:27:11.473 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:11.473 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a3a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:11.474 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:11.474 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:11.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:11.481 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:11.481 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:11.481 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:11.683 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:27:11.683 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x261bfd0) skgpid ospid 23172 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:11.768 [1199044928] >TRACE: clssgmAllocProc: (0x269b580) allocated [ CSSD]2013-05-23 16:27:11.769 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:27:11.769 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b580 - 1,2,3 [ CSSD]2013-05-23 16:27:11.769 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x269b580) pid(23145) version 11:1:1:4 [ CSSD]2013-05-23 16:27:11.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05df002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:12.217 [1199044928] >TRACE: clssgmAllocProc: (0x26bba60) allocated [ CSSD]2013-05-23 16:27:12.217 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:27:12.218 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bba60 - 1,2,3 [ CSSD]2013-05-23 16:27:12.218 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x26bba60) pid(23280) version 11:1:1:4 [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bba60), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261cb30, requested num -1 [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269e970/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:12.224 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:12.231 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:12.231 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:12.231 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x267fc90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:12.231 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x267fc90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:12.434 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bba60 [ CSSD]2013-05-23 16:27:12.434 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bba60) con(0x26b9a50) skgpid ospid 23280 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:12.743 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:12.743 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:13.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:13.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:13.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:14.390 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b580 [ CSSD]2013-05-23 16:27:14.390 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b580) con(0x261bfd0) skgpid ospid 23145 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:15.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:15.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:15.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:16.228 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:27:16.229 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:27:16.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:27:16.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:27:16.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e0002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:16.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:16.301 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:16.301 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:27:16.301 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:27:16.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e1002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:16.308 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:16.308 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:16.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e2002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:16.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:16.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:16.358 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:27:16.358 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:16.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e3002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:16.365 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:16.365 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:17.107 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:27:17.108 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:27:17.109 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:27:17.109 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x2682140) pid(23536) version 11:1:1:4 [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261bfd0, requested num -1 [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a2e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:17.115 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:17.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:17.121 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:17.121 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a5e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:17.121 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a5e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:17.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:17.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:17.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:17.323 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:27:17.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x26b9a50) skgpid ospid 23536 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:17.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:17.747 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:19.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:19.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:19.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:20.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e4002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:20.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:20.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:20.928 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:27:20.928 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:20.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e5002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:20.935 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:20.935 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:20.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:21.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:21.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:21.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:21.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e6002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:22.750 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:22.750 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:23.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:23.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:23.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:25.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:25.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:25.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:26.717 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:27:26.718 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:27:26.718 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:27:26.718 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2682140) pid(23606) version 11:1:1:4 [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261cb20, requested num -1 [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a3a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:26.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:26.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:26.730 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:26.730 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:26.730 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:26.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:26.753 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:27:26.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:27:26.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x261bfd0) skgpid ospid 23606 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:27.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:27.245 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:27.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:29.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:29.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:29.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:30.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:31.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:31.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:31.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:31.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05e7002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:31.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:31.609 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:31.609 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:27:31.609 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:31.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05e8002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:31.617 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:31.617 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:31.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:31.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:31.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05e9002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:33.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:33.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:33.491 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:35.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:35.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:35.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:36.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:36.760 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:37.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:37.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:37.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:39.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:39.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:39.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:41.012 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:41.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:41.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:41.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:41.725 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:27:41.726 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:27:41.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:27:41.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x2682140) pid(23754) version 11:1:1:4 [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261cb20, requested num -1 [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a3a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:41.733 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:41.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:41.740 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:41.740 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a6a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:41.740 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a6a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:41.764 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:41.764 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:41.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:27:41.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x261bfd0) skgpid ospid 23754 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:41.967 [1199044928] >TRACE: clssgmAllocProc: (0x269b580) allocated [ CSSD]2013-05-23 16:27:41.968 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:27:41.969 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b580 - 1,2,3 [ CSSD]2013-05-23 16:27:41.969 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261bfd0) proc(0x269b580) pid(23761) version 11:1:1:4 [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x269b580), client(1/0x26e1410) [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x261cb20, requested num -1 [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269de50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:41.974 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:41.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:27:41.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:41.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269e150) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:41.981 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269e150) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:41.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ea002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:42.183 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b580 [ CSSD]2013-05-23 16:27:42.183 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b580) con(0x261bfd0) skgpid ospid 23761 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:43.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:43.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:43.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:45.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:45.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:45.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:46.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:46.768 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:46.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05eb002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:46.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:27:46.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:27:46.878 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:27:46.878 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:46.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05ec002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:46.886 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:27:46.886 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:27:47.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:47.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:47.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:49.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ef0b0) [ CSSD]2013-05-23 16:27:49.228 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ef0b0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:27:49.228 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ef0b0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:27:49.228 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:27:49.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26b9260) [ CSSD]2013-05-23 16:27:49.230 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26b9260), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:27:49.230 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26b9260), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:27:49.230 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b9b0 [ CSSD]2013-05-23 16:27:49.233 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b9b0) con(0x2681ca0) skgpid 18307 ospid 18307 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9310) [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9310), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9310), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d5f0 [ CSSD]2013-05-23 16:27:49.234 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d5f0) con(0x2650ad0) skgpid 18305 ospid 18305 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:49.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:49.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:49.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:51.035 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:27:51.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:51.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:51.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:51.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:51.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:52.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ed002c) incarnation(174631051) [ CSSD]2013-05-23 16:27:53.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:53.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:53.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:55.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:55.549 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:55.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:56.774 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:27:56.775 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:27:57.216 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:27:57.217 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:27:57.217 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:27:57.217 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(23938) version 11:1:1:4 [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:27:57.224 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:27:57.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:27:57.230 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:27:57.230 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:27:57.230 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:27:57.433 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:27:57.433 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 23938 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:27:57.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:57.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:57.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:27:59.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:27:59.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:27:59.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:00.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:00.777 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:28:01.056 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:01.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:01.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:01.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:02.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05ee002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:02.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ef002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:02.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:28:02.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:28:02.139 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:28:02.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:02.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f0002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:02.147 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:28:02.147 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:28:03.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:03.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:03.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:05.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:05.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:05.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:05.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:05.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:07.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:07.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:07.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:09.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:09.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:09.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:10.784 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:10.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:11.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:11.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:11.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:11.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:12.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f1002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:12.465 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:28:12.466 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:28:12.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:28:12.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x2682140) pid(24084) version 11:1:1:4 [ CSSD]2013-05-23 16:28:12.472 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:28:12.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:12.472 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:28:12.472 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:12.472 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650860/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:28:12.473 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:12.473 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:12.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:12.481 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:28:12.481 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:12.481 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:12.683 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:28:12.683 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x26b9a50) skgpid ospid 24084 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:13.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:13.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:13.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:15.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:15.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:15.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:15.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:15.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:17.370 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:28:17.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:28:17.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:28:17.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24160) version 11:1:1:4 [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:17.379 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:17.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:17.387 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:28:17.387 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:17.387 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:17.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f2002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:17.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:28:17.406 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:28:17.406 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:28:17.406 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:17.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f3002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:17.414 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:28:17.414 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:28:17.590 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:28:17.590 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24160 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:17.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:17.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:17.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:19.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:19.791 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:28:19.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:19.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:19.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:21.101 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:21.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f4002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:21.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:28:21.191 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:28:21.191 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:28:21.191 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:21.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f5002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:21.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:28:21.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:28:21.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:21.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:21.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:22.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f6002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:23.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:23.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:23.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:24.794 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:24.794 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:25.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:25.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:25.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:27.712 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:28:27.713 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:28:27.713 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:28:27.713 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24234) version 11:1:1:4 [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:27.719 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:27.726 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:27.726 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:28:27.726 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:27.726 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:27.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:27.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:27.929 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:28:27.929 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24234 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:27.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:29.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:29.798 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:29.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:29.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:29.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:31.136 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:31.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:31.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:31.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:32.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05f7002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:32.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05f8002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:32.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:28:32.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:28:32.670 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:28:32.670 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:32.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05f9002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:32.678 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:28:32.678 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:28:33.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:33.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:34.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:34.801 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:34.801 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:35.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:35.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:36.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:38.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:38.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:38.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:38.742 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:28:38.743 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:28:38.743 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:28:38.743 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24377) version 11:1:1:4 [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:38.750 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:38.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:28:38.756 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:28:38.756 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:28:38.756 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:38.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:38.804 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:28:38.865 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:28:38.866 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:28:38.866 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:28:38.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1400) proc(0x261b8e0) pid(24382) version 11:1:1:4 [ CSSD]2013-05-23 16:28:38.880 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:28:38.882 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:28:38.884 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:28:38.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:28:38.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x26e1400) skgpid ospid 24382 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:38.958 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:28:38.958 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24377 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:40.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:40.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:40.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:41.165 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:41.447 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:28:41.447 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:28:41.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:28:41.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24419) version 11:1:1:4 [ CSSD]2013-05-23 16:28:42.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:42.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:42.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:28:42.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24419 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:42.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:42.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05fa002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:42.972 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:28:42.972 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:28:42.973 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:28:42.973 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x2682140) pid(24584) version 11:1:1:4 [ CSSD]2013-05-23 16:28:42.978 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:28:42.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:42.978 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:28:42.979 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:42.979 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650860/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:28:42.979 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:42.979 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:42.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:42.984 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:28:42.984 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:42.984 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:43.186 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:28:43.186 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x26b9a50) skgpid ospid 24584 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:28:43.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:43.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:44.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:44.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:44.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:46.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:46.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:46.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:47.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05fb002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:47.921 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:28:47.921 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:28:47.921 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:28:47.921 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:47.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(05fc002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:47.929 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:28:47.929 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:28:48.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:48.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:48.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:48.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:48.811 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:50.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:50.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:50.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:51.185 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:28:52.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:52.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:52.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05fd002c) incarnation(174631051) [ CSSD]2013-05-23 16:28:52.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:53.814 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:53.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:28:54.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:54.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:54.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:56.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:56.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:56.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:57.817 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:28:57.817 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:28:58.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:28:58.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:28:58.219 [1199044928] >TRACE: clssgmAllocProc: (0x2682140) allocated [ CSSD]2013-05-23 16:28:58.220 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:28:58.220 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2682140 - 1,2,3 [ CSSD]2013-05-23 16:28:58.220 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x2682140) pid(24741) version 11:1:1:4 [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x2682140), client(1/0x26e1410) [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1410 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2650860/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:28:58.236 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:28:58.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1410) [ CSSD]2013-05-23 16:28:58.242 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1410), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:28:58.242 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:28:58.242 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:28:58.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:28:58.445 [1199044928] >TRACE: clssgmDeadProc: proc 0x2682140 [ CSSD]2013-05-23 16:28:58.445 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2682140) con(0x26b9a50) skgpid ospid 24741 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:00.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:00.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:00.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:01.212 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:02.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:02.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:02.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(05fe002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:02.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:02.821 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:02.821 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:03.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(05ff002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:03.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:29:03.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:29:03.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:29:03.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:03.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0600002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:03.199 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:29:03.199 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:29:04.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:04.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:04.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:06.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:06.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:06.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:07.824 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:07.824 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:08.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:08.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:08.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:10.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:10.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:10.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:11.234 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:12.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0601002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:12.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:12.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:12.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:12.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:12.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:13.478 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:29:13.479 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:29:13.479 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:29:13.479 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24886) version 11:1:1:4 [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:13.485 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:13.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:13.490 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:29:13.490 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:13.490 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:13.693 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:29:13.693 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24886 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:14.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:14.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:14.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:16.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:16.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:16.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:17.635 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:29:17.636 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:29:17.636 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:29:17.636 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24957) version 11:1:1:4 [ CSSD]2013-05-23 16:29:17.642 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:29:17.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:17.642 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:29:17.642 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:17.642 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:29:17.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:17.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:17.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:17.648 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:29:17.648 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:17.648 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:17.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:17.831 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:17.851 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:29:17.851 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 24957 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:18.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:18.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:18.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0602002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:18.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:29:18.441 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:29:18.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:29:18.442 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:18.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0603002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:18.449 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:29:18.449 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:29:18.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:20.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:20.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:20.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:21.258 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:21.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0604002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:21.451 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:29:21.451 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:29:21.451 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:29:21.451 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:21.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0605002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:21.458 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:29:21.458 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:29:22.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0606002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:22.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:22.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:22.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:22.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:22.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:24.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:24.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:24.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:25.563 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:29:25.564 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:29:25.564 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:29:25.564 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(25019) version 11:1:1:4 [ CSSD]2013-05-23 16:29:25.682 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:29:25.683 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:29:25.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:29:25.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1400) proc(0x261bee0) pid(25029) version 11:1:1:4 [ CSSD]2013-05-23 16:29:25.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:29:25.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:29:25.705 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:29:25.705 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26e1400) skgpid ospid 25029 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5346/0x266f1a0) [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5346 (0x266f1a0) [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x261b8e0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:25.786 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:29:25.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5346 (0x266f1a0) [ CSSD]2013-05-23 16:29:25.794 [1199044928] >TRACE: clssgmExitGrock: client 5346 (0x266f1a0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:29:25.794 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:29:25.794 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:25.795 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:29:25.795 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 25019 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:26.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:26.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:26.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:27.838 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:27.838 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:28.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:28.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:28.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:28.727 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:29:28.728 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:29:28.728 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:29:28.728 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(25060) version 11:1:1:4 [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x266f1a0 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261b8e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:28.734 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:28.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:28.740 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x266f1a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:29:28.740 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268b340) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:28.740 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268b340) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:28.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:29:28.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid ospid 25060 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:30.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:30.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:30.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:31.282 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:31.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:31.841 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:29:32.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0607002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:32.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:32.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:32.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:33.032 [1199044928] >TRACE: clssgmAllocProc: (0x26501e0) allocated [ CSSD]2013-05-23 16:29:33.033 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:29:33.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26501e0 - 1,2,3 [ CSSD]2013-05-23 16:29:33.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26e1280) proc(0x26501e0) pid(24005/24005) version 11:1:1:4 [ CSSD]2013-05-23 16:29:33.048 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x26501e0), client(1/0x266f1a0) [ CSSD]2013-05-23 16:29:33.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:29:33.049 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:29:33.049 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 16:29:33.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0608002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:33.701 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:29:33.701 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:29:33.701 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:29:33.701 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:33.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0609002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:33.708 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:29:33.708 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:29:34.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:34.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:34.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:36.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:36.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:36.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:36.844 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:36.844 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:38.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:38.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:38.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:40.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:40.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:40.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:41.306 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:41.847 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:41.848 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:42.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(060a002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:42.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:42.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:42.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:43.976 [1199044928] >TRACE: clssgmAllocProc: (0x261bef0) allocated [ CSSD]2013-05-23 16:29:43.977 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:29:43.977 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bef0 - 1,2,3 [ CSSD]2013-05-23 16:29:43.977 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261b9c0) proc(0x261bef0) pid(25228) version 11:1:1:4 [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261bef0), client(1/0x2690e40) [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690e40) [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690e40 with con 0x261be40, requested num -1 [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2678880/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:43.983 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:43.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690e40) [ CSSD]2013-05-23 16:29:43.989 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690e40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:29:43.989 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2690fb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:43.989 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2690fb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:44.192 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bef0 [ CSSD]2013-05-23 16:29:44.192 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bef0) con(0x261b9c0) skgpid ospid 25228 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:29:44.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:44.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:44.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:46.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:46.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:46.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:46.851 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:46.851 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:47.051 [1199044928] >TRACE: clssgmAllocProc: (0x261bef0) allocated [ CSSD]2013-05-23 16:29:47.052 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:29:47.053 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bef0 - 1,2,3 [ CSSD]2013-05-23 16:29:47.053 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261b9c0) proc(0x261bef0) pid(24712/24712) version 11:1:1:4 [ CSSD]2013-05-23 16:29:47.058 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x261bef0), client(1/0x261be40) [ CSSD]2013-05-23 16:29:47.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261be40) [ CSSD]2013-05-23 16:29:47.058 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:29:47.058 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:29:48.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:48.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:48.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:48.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060b002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:48.951 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:29:48.951 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:29:48.951 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:29:48.952 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:48.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(060c002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:48.959 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:29:48.959 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:29:50.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:50.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:50.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:50.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:50.854 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:29:51.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:29:52.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(060d002c) incarnation(174631051) [ CSSD]2013-05-23 16:29:52.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:52.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:52.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:54.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:54.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:54.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:55.858 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:29:55.858 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:29:56.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:56.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:56.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:58.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:29:58.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:29:58.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:29:59.224 [1199044928] >TRACE: clssgmAllocProc: (0x2678f80) allocated [ CSSD]2013-05-23 16:29:59.225 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:29:59.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f80 - 1,2,3 [ CSSD]2013-05-23 16:29:59.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690ff0) proc(0x2678f80) pid(25384) version 11:1:1:4 [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f80), client(1/0x2690cd0) [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690cd0) [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690cd0 with con 0x267d6a0, requested num -1 [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269a210/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:29:59.232 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:29:59.238 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690cd0) [ CSSD]2013-05-23 16:29:59.238 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690cd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:29:59.238 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269a510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:29:59.238 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269a510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:29:59.440 [1199044928] >TRACE: clssgmDeadProc: proc 0x2678f80 [ CSSD]2013-05-23 16:29:59.440 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2678f80) con(0x2690ff0) skgpid ospid 25384 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:00.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:00.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:00.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:00.862 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:00.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:01.356 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:02.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(060e002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:02.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:02.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:02.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:04.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(060f002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:04.200 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:04.200 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:04.200 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:04.200 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:04.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0610002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:04.208 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:04.208 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:04.423 [1199044928] >TRACE: clssgmAllocProc: (0x267d300) allocated [ CSSD]2013-05-23 16:30:04.423 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:30:04.424 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x267d300 - 1,2,3 [ CSSD]2013-05-23 16:30:04.424 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x267d300) pid(25646/25646) version 11:1:1:4 [ CSSD]2013-05-23 16:30:04.440 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x267d300), client(1/0x2690cd0) [ CSSD]2013-05-23 16:30:04.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2690cd0) [ CSSD]2013-05-23 16:30:04.440 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:30:04.440 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:30:04.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:04.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2690cd0) [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2690cd0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2690cd0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x267d300 [ CSSD]2013-05-23 16:30:04.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x267d300) con(0x26b9a50) skgpid 25646 ospid 25646 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:04.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:05.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:05.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:06.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:06.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:06.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:08.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:08.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:09.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:09.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:09.868 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:30:10.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:10.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:11.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:11.378 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:11.416 [1199044928] >TRACE: clssgmAllocProc: (0x2678f80) allocated [ CSSD]2013-05-23 16:30:11.417 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:30:11.418 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2678f80 - 1,2,3 [ CSSD]2013-05-23 16:30:11.418 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690ff0) proc(0x2678f80) pid(25689/25689) version 11:1:1:4 [ CSSD]2013-05-23 16:30:11.433 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2678f80), client(1/0x2690cd0) [ CSSD]2013-05-23 16:30:11.433 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2690cd0) [ CSSD]2013-05-23 16:30:11.433 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:30:11.433 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:30:12.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0611002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:12.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:12.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:13.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:14.473 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:30:14.474 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:30:14.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:30:14.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(25717) version 11:1:1:4 [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:30:14.481 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:14.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:30:14.487 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:30:14.487 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:14.487 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:30:14.689 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:30:14.689 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid ospid 25717 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:14.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:14.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:14.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:14.872 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:15.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:16.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:16.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:16.869 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:30:16.870 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:30:16.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:30:16.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(25765/25765) version 11:1:1:4 [ CSSD]2013-05-23 16:30:16.875 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26b9a50) [ CSSD]2013-05-23 16:30:16.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:30:16.875 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:30:16.875 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:30:17.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26b9a50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26b9a50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:30:17.180 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid 25765 ospid 25765 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:17.893 [1199044928] >TRACE: clssgmAllocProc: (0x26bb750) allocated [ CSSD]2013-05-23 16:30:17.894 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:30:17.894 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb750 - 1,2,3 [ CSSD]2013-05-23 16:30:17.894 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x26bb750) pid(25789) version 11:1:1:4 [ CSSD]2013-05-23 16:30:17.910 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26bb750), client(1/0x26bbc80) [ CSSD]2013-05-23 16:30:17.910 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbc80) [ CSSD]2013-05-23 16:30:17.910 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbc80 with con 0x267d430, requested num -1 [ CSSD]2013-05-23 16:30:17.910 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:17.910 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8fc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:30:17.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:30:17.911 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:17.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbc80) [ CSSD]2013-05-23 16:30:17.917 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbc80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:30:17.917 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26a92c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:17.917 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26a92c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:30:18.119 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb750 [ CSSD]2013-05-23 16:30:18.119 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb750) con(0x26b9a50) skgpid ospid 25789 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:18.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:18.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:19.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:19.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0612002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:19.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:19.449 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:19.449 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:19.449 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:19.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0613002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:19.456 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:19.456 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:19.875 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:19.875 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:20.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:20.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:21.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:21.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:21.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0614002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:21.709 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:21.709 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:21.709 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:21.709 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:21.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0615002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:21.716 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:21.716 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:22.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0616002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:22.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:22.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:23.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:24.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:24.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:24.878 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:24.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:25.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:26.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:26.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:27.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:28.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:28.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:28.881 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:28.882 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:30:29.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:29.722 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:30:29.723 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:30:29.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:30:29.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(25879) version 11:1:1:4 [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:30:29.729 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:29.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:30:29.735 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:30:29.735 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:29.735 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:30:29.937 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:30:29.937 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid ospid 25879 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:30.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:30.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:31.187 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:31.427 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:32.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0617002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:32.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:32.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:33.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:33.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:33.885 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:34.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0618002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:34.709 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:34.709 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:34.709 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:34.709 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:34.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0619002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:34.716 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:34.716 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:34.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:34.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:35.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:36.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:36.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:37.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:38.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:38.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:38.889 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:38.889 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:39.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:40.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:40.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:41.328 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:41.494 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:42.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(061a002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:42.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:42.892 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:30:42.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:42.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:43.334 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:44.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:44.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:44.981 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:30:44.982 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:30:44.983 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:30:44.983 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(26030) version 11:1:1:4 [ CSSD]2013-05-23 16:30:44.988 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x267d430) [ CSSD]2013-05-23 16:30:44.988 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:30:44.988 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d430 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:30:44.988 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:44.988 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:30:44.989 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:30:44.989 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:44.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:30:44.995 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:30:44.995 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:30:44.995 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:30:45.198 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:30:45.198 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid ospid 26030 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:30:45.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:46.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:46.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:47.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:47.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:47.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:48.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:48.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:49.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:49.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061b002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:49.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:49.979 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:49.979 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:49.979 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:49.987 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061c002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:49.987 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:49.987 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:50.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:50.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:51.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:51.522 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:30:52.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(061d002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:52.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:52.900 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:53.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:53.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:53.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:55.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:55.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:55.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:56.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(061e002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:56.989 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:30:56.989 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:30:56.989 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:30:56.989 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:30:56.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(061f002c) incarnation(174631051) [ CSSD]2013-05-23 16:30:56.996 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:30:56.996 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:30:57.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:57.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:57.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:30:57.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:30:57.904 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:30:59.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:30:59.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:30:59.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:00.230 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:00.231 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:31:00.231 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:00.231 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(26188) version 11:1:1:4 [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:31:00.237 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:00.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:00.243 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:31:00.243 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:00.243 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:31:00.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:00.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid ospid 26188 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:01.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:01.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:01.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:01.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:01.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:01.907 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:31:02.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0620002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:03.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:03.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:03.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:05.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:05.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:05.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0621002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:05.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:05.238 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:05.238 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:31:05.238 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:05.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0622002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:05.245 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:05.245 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:05.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:06.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:06.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:07.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:07.238 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:07.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:09.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:09.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:09.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:11.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:11.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:11.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:11.580 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:11.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:11.914 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:12.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0623002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:13.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:13.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:13.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:15.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:15.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:15.413 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:15.414 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:31:15.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:15.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(26359/26359) version 11:1:1:4 [ CSSD]2013-05-23 16:31:15.430 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x267d430) [ CSSD]2013-05-23 16:31:15.430 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:31:15.430 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:31:15.430 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x267d430), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x267d430), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:15.448 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid 26359 ospid 26359 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:15.480 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:15.481 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:31:15.481 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:15.481 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(26361) version 11:1:1:4 [ CSSD]2013-05-23 16:31:15.487 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26b9a50) [ CSSD]2013-05-23 16:31:15.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:31:15.487 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9a50 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:31:15.487 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:15.487 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:31:15.488 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:31:15.488 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:15.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:31:15.494 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9a50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:31:15.494 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:15.494 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:31:15.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:15.697 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:15.697 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid ospid 26361 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:16.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:16.917 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:17.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:17.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:17.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:17.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0624002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:17.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:17.913 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:17.913 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:31:17.914 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:17.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0625002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:17.921 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:17.921 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:18.053 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:31:18.054 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:31:18.055 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:31:18.056 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:31:18.161 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:18.162 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:31:18.163 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:18.163 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(26425) version 11:1:1:4 [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26b9a50) [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b9a50 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:31:18.169 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:18.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b9a50) [ CSSD]2013-05-23 16:31:18.175 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b9a50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:31:18.175 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbbf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:18.175 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbbf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:31:18.377 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:18.377 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid ospid 26425 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:19.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:19.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:19.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:20.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0626002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:20.493 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:20.493 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:20.493 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:31:20.493 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:20.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0627002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:20.499 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:20.499 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:21.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:21.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:21.601 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:21.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:21.920 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:21.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:21.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0628002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:21.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:21.971 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:21.971 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:31:21.971 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:21.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0629002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:21.978 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:21.978 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:22.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062a002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:23.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:23.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:23.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:25.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:25.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:25.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:26.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:26.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:27.350 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:27.350 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:27.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:29.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:29.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:29.775 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:30.731 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:30.732 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:31:30.732 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:30.732 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(26523) version 11:1:1:4 [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:31:30.738 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:30.745 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:30.745 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:31:30.745 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:30.745 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:31:30.947 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:30.947 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid ospid 26523 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:31.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:31.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:31.620 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:31.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:31.927 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:31.927 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:32.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062b002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:33.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:33.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:33.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:35.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:35.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:35.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062c002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:35.739 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:35.739 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:35.739 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:31:35.739 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:35.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(062d002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:35.747 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:35.747 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:35.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:35.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:35.930 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:31:37.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:37.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:37.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:39.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:39.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:39.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:40.933 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:40.933 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:41.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:41.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:41.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:41.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:42.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(062e002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:43.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:43.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:43.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:45.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:45.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:45.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:45.936 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:45.937 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:45.990 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:31:45.991 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:31:45.992 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:31:45.992 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(26699) version 11:1:1:4 [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:31:45.998 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:46.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:31:46.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:31:46.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:31:46.004 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:31:46.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:31:46.206 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid ospid 26699 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:31:47.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:47.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:47.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:49.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:49.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:49.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:50.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:50.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:31:50.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(062f002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:50.988 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:31:50.988 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:31:50.988 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:31:50.988 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:31:50.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0630002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:50.995 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:31:50.995 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:31:51.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:51.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:51.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:31:52.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:52.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0631002c) incarnation(174631051) [ CSSD]2013-05-23 16:31:53.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:53.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:54.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:54.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:54.943 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:31:55.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:55.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:56.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:57.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:57.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:58.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:31:59.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:31:59.663 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:31:59.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:31:59.947 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:00.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:01.239 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:32:01.240 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:32:01.241 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:32:01.241 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x269b4e0) pid(26891) version 11:1:1:4 [ CSSD]2013-05-23 16:32:01.246 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x26bbb20) [ CSSD]2013-05-23 16:32:01.246 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:32:01.246 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26bbb20 with con 0x2699fc0, requested num -1 [ CSSD]2013-05-23 16:32:01.246 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:01.246 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a8ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:32:01.247 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:32:01.247 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:01.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26bbb20) [ CSSD]2013-05-23 16:32:01.253 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26bbb20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:32:01.253 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:01.254 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:32:01.456 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:32:01.456 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x267d430) skgpid ospid 26891 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:01.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:01.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:01.688 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:02.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:02.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0632002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:03.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:03.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:04.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:04.951 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:04.951 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:05.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:05.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:06.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:06.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0633002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:06.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:06.248 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:06.248 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:06.248 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:06.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0634002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:06.256 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:06.256 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:07.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0635002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:07.046 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:07.046 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:07.046 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:07.046 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:07.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0636002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:07.054 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:07.054 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:07.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:07.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:08.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:09.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:09.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:09.954 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:09.954 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:10.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:10.537 [1199044928] >TRACE: clssgmAllocProc: (0x269b4e0) allocated [ CSSD]2013-05-23 16:32:10.537 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:32:10.538 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269b4e0 - 1,2,3 [ CSSD]2013-05-23 16:32:10.538 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9a50) proc(0x269b4e0) pid(25810/25810) version 11:1:1:4 [ CSSD]2013-05-23 16:32:10.554 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269b4e0), client(1/0x269b430) [ CSSD]2013-05-23 16:32:10.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269b430) [ CSSD]2013-05-23 16:32:10.554 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:32:10.554 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:32:11.320 [1199044928] >TRACE: clssgmAllocProc: (0x26aaac0) allocated [ CSSD]2013-05-23 16:32:11.321 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:32:11.321 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaac0 - 1,2,3 [ CSSD]2013-05-23 16:32:11.321 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb9a0) proc(0x26aaac0) pid(27043) version 11:1:1:4 [ CSSD]2013-05-23 16:32:11.710 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:11.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:11.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:12.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:12.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0637002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:13.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:13.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:13.955 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaac0 [ CSSD]2013-05-23 16:32:13.955 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaac0) con(0x26bb9a0) skgpid ospid 27043 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:13.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:13.957 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:32:14.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:15.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:15.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:16.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:16.489 [1199044928] >TRACE: clssgmAllocProc: (0x26aab20) allocated [ CSSD]2013-05-23 16:32:16.490 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:32:16.490 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab20 - 1,2,3 [ CSSD]2013-05-23 16:32:16.490 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb9a0) proc(0x26aab20) pid(27383) version 11:1:1:4 [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aab20), client(1/0x26ecf20) [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ecf20 with con 0x26aa9f0, requested num -1 [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:32:16.496 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:16.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:16.503 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ecf20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:32:16.503 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:16.503 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:32:16.552 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:32:16.553 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:32:16.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:32:16.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:32:16.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0638002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:16.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:16.632 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:16.632 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:32:16.632 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:32:16.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0639002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:16.638 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:16.638 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:16.705 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab20 [ CSSD]2013-05-23 16:32:16.705 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab20) con(0x26bb9a0) skgpid ospid 27383 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:17.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:17.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:18.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:18.422 [1199044928] >TRACE: clssgmAllocProc: (0x26aaac0) allocated [ CSSD]2013-05-23 16:32:18.424 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:32:18.424 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aaac0 - 1,2,3 [ CSSD]2013-05-23 16:32:18.424 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb9a0) proc(0x26aaac0) pid(27444) version 11:1:1:4 [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aaac0), client(1/0x26ece60) [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ece60) [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ece60 with con 0x26aa870, requested num -1 [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ecfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:32:18.431 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:18.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ece60) [ CSSD]2013-05-23 16:32:18.439 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ece60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:32:18.439 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:18.439 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:32:18.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aaac0 [ CSSD]2013-05-23 16:32:18.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aaac0) con(0x26bb9a0) skgpid ospid 27444 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:18.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:18.961 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:19.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:19.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:20.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:21.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063a002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:21.500 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:21.500 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:21.500 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:21.500 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:21.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063b002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:21.507 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:21.507 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:21.732 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:21.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:21.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:22.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(063c002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:22.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:22.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:22.229 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:22.229 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:22.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:22.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(063d002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:22.236 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:22.236 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:22.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(063e002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:23.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:23.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:23.964 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:23.964 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:24.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:25.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:25.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:26.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:27.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:27.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:28.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:28.968 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:28.968 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:29.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:29.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:30.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:31.744 [1199044928] >TRACE: clssgmAllocProc: (0x26aab40) allocated [ CSSD]2013-05-23 16:32:31.745 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:32:31.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab40 - 1,2,3 [ CSSD]2013-05-23 16:32:31.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb9a0) proc(0x26aab40) pid(27566) version 11:1:1:4 [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aab40), client(1/0x26ecf20) [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ecf20 with con 0x26aaa10, requested num -1 [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:32:31.751 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:31.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:31.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ecf20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:32:31.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:31.758 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:32:31.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:31.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:31.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:31.960 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab40 [ CSSD]2013-05-23 16:32:31.960 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab40) con(0x26bb9a0) skgpid ospid 27566 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:32.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:32.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(063f002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:33.912 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:33.912 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:33.971 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:33.972 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:34.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:35.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:35.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:36.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:36.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0640002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:36.747 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:36.747 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:36.747 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:36.747 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:36.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0641002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:36.755 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:36.755 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:37.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:37.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:38.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:38.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:38.976 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:39.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:39.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:40.408 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:41.780 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:41.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:41.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:42.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:42.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0642002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:43.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:43.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:43.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:43.979 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:44.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:45.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:45.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:46.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:46.993 [1199044928] >TRACE: clssgmAllocProc: (0x26aab40) allocated [ CSSD]2013-05-23 16:32:46.994 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:32:46.995 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aab40 - 1,2,3 [ CSSD]2013-05-23 16:32:46.995 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bb9a0) proc(0x26aab40) pid(27727) version 11:1:1:4 [ CSSD]2013-05-23 16:32:47.000 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aab40), client(1/0x26ecf20) [ CSSD]2013-05-23 16:32:47.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:47.001 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26ecf20 with con 0x26aaa10, requested num -1 [ CSSD]2013-05-23 16:32:47.001 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:47.001 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed090/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:32:47.001 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:32:47.001 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:47.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26ecf20) [ CSSD]2013-05-23 16:32:47.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26ecf20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:32:47.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed390) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:32:47.007 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed390) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:32:47.209 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aab40 [ CSSD]2013-05-23 16:32:47.210 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aab40) con(0x26bb9a0) skgpid ospid 27727 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:47.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:47.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:47.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:47.982 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:32:48.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:49.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26598b0) [ CSSD]2013-05-23 16:32:49.291 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26598b0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:32:49.291 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26598b0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:32:49.291 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 16:32:49.294 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ba1f0) [ CSSD]2013-05-23 16:32:49.294 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ba1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:32:49.294 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ba1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:32:49.294 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268c680) [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268c680), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268c680), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b9850 [ CSSD]2013-05-23 16:32:49.295 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b9850) con(0x2659580) skgpid 21955 ospid 21955 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:49.303 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eeb30) [ CSSD]2013-05-23 16:32:49.304 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eeb30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:32:49.304 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eeb30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:32:49.304 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:32:49.304 [1199044928] >TRACE: clssgmDeadProc: proc 0x268f960 [ CSSD]2013-05-23 16:32:49.304 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268f960) con(0x266f0d0) skgpid 21957 ospid 21957 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:32:49.685 [1199044928] >TRACE: clssgmAllocProc: (0x26ba1f0) allocated [ CSSD]2013-05-23 16:32:49.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:32:49.686 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ba1f0 - 1,2,3 [ CSSD]2013-05-23 16:32:49.686 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26ba1f0) pid(27794/27794) version 11:1:1:4 [ CSSD]2013-05-23 16:32:49.701 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26ba1f0), client(1/0x26eeb30) [ CSSD]2013-05-23 16:32:49.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26eeb30) [ CSSD]2013-05-23 16:32:49.701 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:32:49.701 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:32:49.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:49.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:50.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:51.809 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:32:52.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0643002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:52.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:32:52.006 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:32:52.006 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:32:52.006 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:32:52.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:52.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:52.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0644002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:52.012 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:32:52.013 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:32:52.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:52.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0645002c) incarnation(174631051) [ CSSD]2013-05-23 16:32:52.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:52.985 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:54.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:54.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:54.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:56.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:56.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:56.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:32:57.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:32:57.989 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:32:58.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:32:58.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:32:58.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:00.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:00.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:00.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:01.837 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:01.982 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x266f1a0) [ CSSD]2013-05-23 16:33:01.982 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:33:01.982 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x266f1a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:33:01.982 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:33:01.983 [1199044928] >TRACE: clssgmDeadProc: proc 0x26501e0 [ CSSD]2013-05-23 16:33:01.983 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26501e0) con(0x26e1280) skgpid 24005 ospid 24005 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:02.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:02.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:02.243 [1199044928] >TRACE: clssgmAllocProc: (0x26bb8e0) allocated [ CSSD]2013-05-23 16:33:02.244 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:33:02.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb8e0 - 1,2,3 [ CSSD]2013-05-23 16:33:02.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26bb8e0) pid(27893) version 11:1:1:4 [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26bb8e0), client(1/0x268b630) [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b630 with con 0x26e1c90, requested num -1 [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:02.250 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:02.256 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:02.256 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:33:02.256 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ef0e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:02.256 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ef0e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:02.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb8e0 [ CSSD]2013-05-23 16:33:02.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb8e0) con(0x267d430) skgpid ospid 27893 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:02.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:02.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0646002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:02.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:02.992 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:04.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:04.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:04.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:06.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:06.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:06.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:06.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:06.995 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:33:07.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0647002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:07.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:33:07.261 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:33:07.262 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:33:07.262 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:07.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0648002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:07.268 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:33:07.268 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:33:08.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:08.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:08.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:10.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:10.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:10.729 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:11.978 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:11.998 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:11.998 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:12.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:12.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:12.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:12.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0649002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:14.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:14.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:14.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:16.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:16.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:16.812 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:17.001 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:17.001 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:17.492 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 16:33:17.493 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:33:17.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 16:33:17.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c1a0) proc(0x26eef20) pid(28034) version 11:1:1:4 [ CSSD]2013-05-23 16:33:17.499 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26eef20), client(1/0x268b630) [ CSSD]2013-05-23 16:33:17.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:17.499 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b630 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:33:17.499 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:17.499 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:33:17.500 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:17.500 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:17.506 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:17.506 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:33:17.506 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:17.506 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:17.709 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 16:33:17.709 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x268c1a0) skgpid ospid 28034 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:18.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:18.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:18.681 [1199044928] >TRACE: clssgmAllocProc: (0x26b95b0) allocated [ CSSD]2013-05-23 16:33:18.682 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:18.683 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b95b0 - 1,2,3 [ CSSD]2013-05-23 16:33:18.683 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26b95b0) pid(28085) version 11:1:1:4 [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b95b0), client(1/0x268b630) [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b630 with con 0x26e1c90, requested num -1 [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:33:18.688 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:18.689 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:18.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:18.694 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:33:18.694 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ef0e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:18.694 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ef0e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:18.818 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:18.897 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b95b0 [ CSSD]2013-05-23 16:33:18.897 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b95b0) con(0x267d430) skgpid ospid 28085 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:20.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:20.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:20.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:22.001 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:22.005 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:22.005 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:22.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:22.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:22.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064a002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:22.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:33:22.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:33:22.495 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:33:22.495 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:22.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(064b002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:22.502 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:33:22.502 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:33:22.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(064c002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:22.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:33:22.520 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:33:22.520 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:33:22.520 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:22.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(064d002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:22.528 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:33:22.528 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:33:22.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:22.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064e002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:24.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:24.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:24.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:26.007 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:26.008 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:33:26.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:26.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:26.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:28.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:28.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:28.622 [1199044928] >TRACE: clssgmAllocProc: (0x26b95b0) allocated [ CSSD]2013-05-23 16:33:28.622 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:28.623 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26b95b0 - 1,2,3 [ CSSD]2013-05-23 16:33:28.623 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26b95b0) pid(28161/28161) version 11:1:1:4 [ CSSD]2013-05-23 16:33:28.639 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26b95b0), client(1/0x268b630) [ CSSD]2013-05-23 16:33:28.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:28.639 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:33:28.639 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:33:28.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:28.678 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b630), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:33:28.678 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b630), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:33:28.678 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:33:28.679 [1199044928] >TRACE: clssgmDeadProc: proc 0x26b95b0 [ CSSD]2013-05-23 16:33:28.679 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26b95b0) con(0x267d430) skgpid 28161 ospid 28161 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:28.854 [1199044928] >TRACE: clssgmAllocProc: (0x26bb8e0) allocated [ CSSD]2013-05-23 16:33:28.855 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:28.855 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb8e0 - 1,2,3 [ CSSD]2013-05-23 16:33:28.855 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26bb8e0) pid(28164/28164) version 11:1:1:4 [ CSSD]2013-05-23 16:33:28.871 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26bb8e0), client(1/0x268b630) [ CSSD]2013-05-23 16:33:28.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:28.871 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:33:28.871 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:33:28.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x268b630), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x268b630), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb8e0 [ CSSD]2013-05-23 16:33:28.916 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb8e0) con(0x267d430) skgpid 28164 ospid 28164 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:30.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:30.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:30.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:31.011 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:31.011 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:32.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:32.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:32.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:32.740 [1199044928] >TRACE: clssgmAllocProc: (0x26bb8e0) allocated [ CSSD]2013-05-23 16:33:32.740 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:33:32.741 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb8e0 - 1,2,3 [ CSSD]2013-05-23 16:33:32.741 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26bb8e0) pid(28196) version 11:1:1:4 [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26bb8e0), client(1/0x268b630) [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b630 with con 0x26e1c90, requested num -1 [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:32.747 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:32.752 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:32.752 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:33:32.752 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ef0e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:32.752 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ef0e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:32.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:32.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(064f002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:32.955 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb8e0 [ CSSD]2013-05-23 16:33:32.955 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb8e0) con(0x267d430) skgpid ospid 28196 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:34.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:34.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:34.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:36.014 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:36.014 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:36.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:36.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:36.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:37.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0650002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:37.781 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:33:37.781 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:33:37.781 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:33:37.781 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:37.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0651002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:37.789 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:33:37.789 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:33:38.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:38.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:38.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:39.029 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 16:33:39.030 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:39.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 16:33:39.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268c1a0) proc(0x26eef20) pid(28274) version 11:1:1:4 [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26eef20), client(1/0x268b630) [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x268b630 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:39.048 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:39.055 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:39.055 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:33:39.055 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:33:39.055 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:39.163 [1199044928] >TRACE: clssgmAllocProc: (0x26596e0) allocated [ CSSD]2013-05-23 16:33:39.164 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:39.165 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26596e0 - 1,2,3 [ CSSD]2013-05-23 16:33:39.165 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ef120) proc(0x26596e0) pid(28279) version 11:1:1:4 [ CSSD]2013-05-23 16:33:39.180 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:33:39.182 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:33:39.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:33:39.184 [1199044928] >TRACE: clssgmDeadProc: proc 0x26596e0 [ CSSD]2013-05-23 16:33:39.185 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26596e0) con(0x26ef120) skgpid ospid 28279 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:39.258 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 16:33:39.258 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x268c1a0) skgpid ospid 28274 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:40.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:40.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:40.958 [1199044928] >TRACE: clssgmAllocProc: (0x26bb8e0) allocated [ CSSD]2013-05-23 16:33:40.959 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:33:40.959 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb8e0 - 1,2,3 [ CSSD]2013-05-23 16:33:40.959 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26bb8e0) pid(28316) version 11:1:1:4 [ CSSD]2013-05-23 16:33:41.002 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:41.017 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:41.017 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:41.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb8e0 [ CSSD]2013-05-23 16:33:41.492 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb8e0) con(0x267d430) skgpid ospid 28316 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:42.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:42.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:42.474 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:42.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0652002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:43.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:44.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:44.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:45.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:45.020 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:45.021 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:33:46.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:46.491 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:47.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:47.991 [1199044928] >TRACE: clssgmAllocProc: (0x26eef20) allocated [ CSSD]2013-05-23 16:33:47.992 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:33:47.992 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26eef20 - 1,2,3 [ CSSD]2013-05-23 16:33:47.992 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26cdcd0) proc(0x26eef20) pid(28523) version 11:1:1:4 [ CSSD]2013-05-23 16:33:47.998 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x26eef20), client(1/0x268b630) [ CSSD]2013-05-23 16:33:47.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:47.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b630 with con 0x26e1400, requested num -1 [ CSSD]2013-05-23 16:33:47.999 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:47.999 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26596e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:33:47.999 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:33:47.999 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:48.005 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b630) [ CSSD]2013-05-23 16:33:48.005 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b630), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:33:48.005 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:33:48.005 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:33:48.208 [1199044928] >TRACE: clssgmDeadProc: proc 0x26eef20 [ CSSD]2013-05-23 16:33:48.208 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26eef20) con(0x26cdcd0) skgpid ospid 28523 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:48.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:48.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:49.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:50.024 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:50.024 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:50.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:50.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:51.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:52.065 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:33:52.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:52.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:52.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0653002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:53.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0654002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:53.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:33:53.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:33:53.033 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:33:53.033 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:33:53.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0655002c) incarnation(174631051) [ CSSD]2013-05-23 16:33:53.041 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:33:53.042 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:33:53.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:53.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26e4dd0) [ CSSD]2013-05-23 16:33:53.903 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26e4dd0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:33:53.903 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26e4dd0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:33:53.903 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 23 [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681e20) [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681e20), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681e20), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:33:53.911 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26ee500) skgpid 22624 ospid 22624 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:33:54.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:54.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:55.027 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:33:55.027 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:33:55.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:56.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:56.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:57.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:33:58.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:33:58.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:33:59.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:00.031 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:00.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:00.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:00.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:01.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:02.086 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:02.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:02.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:03.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0656002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:03.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:03.250 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:34:03.251 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:34:03.252 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:34:03.252 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26e1090) pid(28703) version 11:1:1:4 [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x26790b0) [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26790b0) [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26790b0 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:03.268 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:03.275 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26790b0) [ CSSD]2013-05-23 16:34:03.275 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26790b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:34:03.275 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:03.275 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:03.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:34:03.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x267d430) skgpid ospid 28703 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:04.034 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:04.034 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:34:04.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:04.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:05.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:06.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:06.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:07.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:08.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0657002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:08.293 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:34:08.293 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:34:08.293 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:34:08.293 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:08.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0658002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:08.300 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:34:08.300 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:34:08.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:08.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:09.037 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:09.037 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:09.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:10.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:10.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:11.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:12.108 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:12.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:12.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:13.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0659002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:13.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:14.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:14.041 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:14.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:14.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:15.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:16.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:16.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:17.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:18.044 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:18.044 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:34:18.511 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:34:18.511 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:34:18.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:34:18.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26790b0) pid(28847) version 11:1:1:4 [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1090 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:18.518 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:18.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:34:18.525 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:34:18.525 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:18.525 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:18.727 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:34:18.727 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x267d430) skgpid ospid 28847 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:18.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:18.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:18.940 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:34:18.941 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:34:18.941 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:34:18.941 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x26e1090) pid(28898) version 11:1:1:4 [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x267d430) [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x267d430 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:18.948 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:18.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x267d430) [ CSSD]2013-05-23 16:34:18.955 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x267d430), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:34:18.955 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ba070) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:18.955 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ba070) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:19.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:34:19.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x26ee500) skgpid ospid 28898 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:19.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:20.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:20.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:21.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:22.130 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:22.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065a002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:22.752 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:34:22.752 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:34:22.752 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:34:22.752 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:22.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(065b002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:22.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:34:22.760 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:34:22.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:22.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:23.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065c002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:23.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:23.048 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:23.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:23.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(065d002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:23.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:34:23.552 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:34:23.552 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:34:23.552 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:23.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(065e002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:23.560 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:34:23.560 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:34:24.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:24.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:25.401 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:25.870 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:34:25.871 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:34:25.871 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:34:25.871 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26e1090) pid(28948) version 11:1:1:4 [ CSSD]2013-05-23 16:34:25.988 [1199044928] >TRACE: clssgmAllocProc: (0x268c690) allocated [ CSSD]2013-05-23 16:34:25.988 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:34:25.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c690 - 1,2,3 [ CSSD]2013-05-23 16:34:25.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x268c690) pid(28964) version 11:1:1:4 [ CSSD]2013-05-23 16:34:26.005 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:34:26.007 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:34:26.011 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c690 [ CSSD]2013-05-23 16:34:26.011 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c690) con(0x26ee500) skgpid ospid 28964 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5347/0x26790b0) [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5347 (0x26790b0) [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26790b0 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26a67c0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:26.093 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:34:26.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5347 (0x26790b0) [ CSSD]2013-05-23 16:34:26.100 [1199044928] >TRACE: clssgmExitGrock: client 5347 (0x26790b0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:34:26.100 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:34:26.100 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:26.101 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:34:26.101 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x267d430) skgpid ospid 28948 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:26.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:26.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:27.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:28.051 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:28.052 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:28.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:28.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:29.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:30.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:30.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:31.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:32.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:32.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:32.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:33.055 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:33.055 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:33.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(065f002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:33.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:33.763 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:34:33.764 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:34:33.765 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:34:33.765 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26790b0) pid(29022) version 11:1:1:4 [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1090 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:33.771 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:33.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:34:33.778 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:34:33.778 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:33.778 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:33.981 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:34:33.981 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x267d430) skgpid ospid 29022 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:34.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:34.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:35.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:36.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:36.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:37.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:37.058 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:34:37.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:38.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0660002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:38.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:34:38.812 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:34:38.812 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:34:38.812 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:38.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0661002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:38.819 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:34:38.819 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:34:38.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:38.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:39.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:40.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:40.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:41.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:42.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:42.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:42.174 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:42.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:42.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:43.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0662002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:43.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:44.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:44.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:45.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:47.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:47.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:47.064 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:47.065 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:47.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:49.015 [1199044928] >TRACE: clssgmAllocProc: (0x26e1090) allocated [ CSSD]2013-05-23 16:34:49.016 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:34:49.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1090 - 1,2,3 [ CSSD]2013-05-23 16:34:49.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26e1090) pid(29198) version 11:1:1:4 [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26e1090), client(1/0x26790b0) [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26790b0) [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26790b0 with con 0x26ee500, requested num -1 [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26a67c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:34:49.023 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:49.031 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26790b0) [ CSSD]2013-05-23 16:34:49.031 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26790b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:34:49.031 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x268c5c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:34:49.031 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x268c5c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:34:49.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:49.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:49.233 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1090 [ CSSD]2013-05-23 16:34:49.233 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1090) con(0x267d430) skgpid ospid 29198 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:34:49.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:50.683 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:34:50.683 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:34:50.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:34:50.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26790b0) pid(28625/28625) version 11:1:1:4 [ CSSD]2013-05-23 16:34:50.699 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:34:50.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:34:50.699 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:34:50.699 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 16:34:51.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:51.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:51.694 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:52.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:52.068 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:34:52.196 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:34:53.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:53.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:53.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0663002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:53.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:54.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0664002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:54.062 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:34:54.062 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:34:54.062 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:34:54.062 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:34:54.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0665002c) incarnation(174631051) [ CSSD]2013-05-23 16:34:54.069 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:34:54.069 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:34:55.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:55.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:55.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:56.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:34:56.070 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:34:57.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:57.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:57.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:34:59.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:34:59.176 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:34:59.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:01.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:01.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:01.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:01.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:01.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:02.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:03.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0666002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:03.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:03.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:03.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:04.266 [1199044928] >TRACE: clssgmAllocProc: (0x268c190) allocated [ CSSD]2013-05-23 16:35:04.267 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:35:04.267 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c190 - 1,2,3 [ CSSD]2013-05-23 16:35:04.267 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba140) proc(0x268c190) pid(29362) version 11:1:1:4 [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268c190), client(1/0x26e4ea0) [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e4ea0 with con 0x26e1c90, requested num -1 [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:35:04.273 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:04.280 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:04.280 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e4ea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:35:04.280 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682110) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:04.280 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682110) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:35:04.483 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c190 [ CSSD]2013-05-23 16:35:04.483 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c190) con(0x26ba140) skgpid ospid 29362 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:04.961 [1199044928] >TRACE: clssgmAllocProc: (0x268c1a0) allocated [ CSSD]2013-05-23 16:35:04.962 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:35:04.962 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c1a0 - 1,2,3 [ CSSD]2013-05-23 16:35:04.962 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9fa0) proc(0x268c1a0) pid(29405/29405) version 11:1:1:4 [ CSSD]2013-05-23 16:35:04.967 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268c1a0), client(1/0x26e4ea0) [ CSSD]2013-05-23 16:35:04.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:04.967 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:35:04.967 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:35:05.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:05.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c1a0 [ CSSD]2013-05-23 16:35:05.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c1a0) con(0x26b9fa0) skgpid 29405 ospid 29405 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:05.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:06.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:06.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:07.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:07.243 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:07.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:09.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:09.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:09.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0667002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:09.310 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:35:09.310 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:35:09.310 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:35:09.310 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:09.316 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0668002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:09.316 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:35:09.316 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:35:09.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:11.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:11.080 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:11.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:11.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:11.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:12.246 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:13.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0669002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:13.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:13.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:13.763 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:15.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:15.083 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:35:15.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:15.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:15.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:17.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:17.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:17.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:19.195 [1199044928] >TRACE: clssgmAllocProc: (0x268c190) allocated [ CSSD]2013-05-23 16:35:19.196 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:35:19.197 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c190 - 1,2,3 [ CSSD]2013-05-23 16:35:19.197 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba140) proc(0x268c190) pid(29494) version 11:1:1:4 [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268c190), client(1/0x26e4ea0) [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e4ea0 with con 0x26e1c90, requested num -1 [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:35:19.204 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:19.210 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:19.210 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e4ea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:35:19.210 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2682080) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:19.210 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2682080) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:35:19.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:19.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:19.413 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c190 [ CSSD]2013-05-23 16:35:19.413 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c190) con(0x26ba140) skgpid ospid 29494 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:19.518 [1199044928] >TRACE: clssgmAllocProc: (0x268c190) allocated [ CSSD]2013-05-23 16:35:19.519 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:35:19.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c190 - 1,2,3 [ CSSD]2013-05-23 16:35:19.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x268c190) pid(29519) version 11:1:1:4 [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268c190), client(1/0x26e4ea0) [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e4ea0 with con 0x26ba140, requested num -1 [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ce610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:35:19.526 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:19.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:19.533 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e4ea0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:35:19.533 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26bbce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:19.534 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26bbce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:35:19.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c190 [ CSSD]2013-05-23 16:35:19.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c190) con(0x26ee500) skgpid ospid 29519 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:19.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:20.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:20.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:21.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:21.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:21.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:22.265 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:22.267 [1199044928] >TRACE: clssgmAllocProc: (0x268c190) allocated [ CSSD]2013-05-23 16:35:22.267 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:35:22.268 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x268c190 - 1,2,3 [ CSSD]2013-05-23 16:35:22.268 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ba140) proc(0x268c190) pid(29521/29521) version 11:1:1:4 [ CSSD]2013-05-23 16:35:22.273 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x268c190), client(1/0x26e4ea0) [ CSSD]2013-05-23 16:35:22.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:35:22.273 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:35:22.273 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:35:23.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066a002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:23.016 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:35:23.016 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:35:23.016 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:35:23.017 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:23.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(066b002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:23.025 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:35:23.025 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:35:23.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066c002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:23.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:23.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:23.860 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:24.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(066d002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:24.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:35:24.556 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:35:24.556 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:35:24.556 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:24.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(066e002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:24.563 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:35:24.563 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:35:25.090 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:25.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:25.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:25.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:25.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:27.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:27.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:27.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:29.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:29.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:29.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:30.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:30.093 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:31.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:31.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:31.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:32.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:33.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(066f002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:33.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:33.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:34.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:34.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:34.097 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:35:34.769 [1199044928] >TRACE: clssgmAllocProc: (0x261f300) allocated [ CSSD]2013-05-23 16:35:34.770 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:35:34.771 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f300 - 1,2,3 [ CSSD]2013-05-23 16:35:34.771 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261f300) pid(29664) version 11:1:1:4 [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261f300), client(1/0x26b97e0) [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b97e0) [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b97e0 with con 0x26cdc20, requested num -1 [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:35:34.777 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:34.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b97e0) [ CSSD]2013-05-23 16:35:34.784 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b97e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:35:34.784 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261f580) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:34.784 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261f580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:35:34.987 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f300 [ CSSD]2013-05-23 16:35:34.987 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f300) con(0x26821e0) skgpid ospid 29664 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:35.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:35.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:36.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:37.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:37.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:38.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:39.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:39.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:39.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:39.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:39.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0670002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:39.804 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:35:39.804 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:35:39.804 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:35:39.804 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:39.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0671002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:39.811 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:35:39.811 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:35:40.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:41.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:41.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:42.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:42.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:43.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0672002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:43.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:43.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:44.103 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:44.104 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:44.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:45.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:45.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:46.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:47.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:47.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:48.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:49.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:49.107 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:49.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:49.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:50.020 [1199044928] >TRACE: clssgmAllocProc: (0x261f300) allocated [ CSSD]2013-05-23 16:35:50.020 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:35:50.021 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f300 - 1,2,3 [ CSSD]2013-05-23 16:35:50.021 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x261f300) pid(29824) version 11:1:1:4 [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261f300), client(1/0x26e8c00) [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e8c00 with con 0x26821e0, requested num -1 [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b94e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:35:50.037 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:50.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e8c00) [ CSSD]2013-05-23 16:35:50.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e8c00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:35:50.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:35:50.044 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:35:50.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:50.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f300 [ CSSD]2013-05-23 16:35:50.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f300) con(0x26ee500) skgpid ospid 29824 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:35:51.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:51.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:52.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:52.333 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:35:53.110 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:53.110 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:35:53.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0673002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:53.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:53.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:54.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:55.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0674002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:55.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:35:55.063 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:35:55.063 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:35:55.063 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:35:55.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0675002c) incarnation(174631051) [ CSSD]2013-05-23 16:35:55.070 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:35:55.070 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:35:55.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:55.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:56.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:57.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:57.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:35:58.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:35:58.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:35:58.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:35:59.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:35:59.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:00.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:01.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:01.734 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:02.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:02.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:03.117 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:03.117 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:03.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0676002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:03.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:03.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:04.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:05.289 [1199044928] >TRACE: clssgmAllocProc: (0x261f300) allocated [ CSSD]2013-05-23 16:36:05.290 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:36:05.291 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f300 - 1,2,3 [ CSSD]2013-05-23 16:36:05.291 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261f300) pid(29980) version 11:1:1:4 [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261f300), client(1/0x26b98a0) [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b98a0) [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b98a0 with con 0x26cdda0, requested num -1 [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:36:05.308 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:05.315 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b98a0) [ CSSD]2013-05-23 16:36:05.315 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b98a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:36:05.315 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26e8cc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:05.315 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26e8cc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:36:05.518 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f300 [ CSSD]2013-05-23 16:36:05.518 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f300) con(0x26821e0) skgpid ospid 29980 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:05.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:05.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:06.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:07.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:07.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:08.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:08.121 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:08.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:09.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:09.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:10.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0677002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:10.324 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:10.324 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:10.324 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:36:10.324 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:10.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0678002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:10.332 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:10.332 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:10.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:11.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:11.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:12.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:12.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:13.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:13.125 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:13.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0679002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:13.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:13.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:14.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:15.120 [1199044928] >TRACE: clssgmAllocProc: (0x261f300) allocated [ CSSD]2013-05-23 16:36:15.121 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:36:15.121 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261f300 - 1,2,3 [ CSSD]2013-05-23 16:36:15.121 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ee500) proc(0x261f300) pid(29517/29517) version 11:1:1:4 [ CSSD]2013-05-23 16:36:15.138 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261f300), client(1/0x26cdda0) [ CSSD]2013-05-23 16:36:15.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26cdda0) [ CSSD]2013-05-23 16:36:15.138 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:36:15.138 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:36:15.908 [1199044928] >TRACE: clssgmAllocProc: (0x26505c0) allocated [ CSSD]2013-05-23 16:36:15.908 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:36:15.909 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26505c0 - 1,2,3 [ CSSD]2013-05-23 16:36:15.909 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9670) proc(0x26505c0) pid(30094/30094) version 11:1:1:4 [ CSSD]2013-05-23 16:36:15.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:15.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:15.925 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26505c0), client(1/0x26506f0) [ CSSD]2013-05-23 16:36:15.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26506f0) [ CSSD]2013-05-23 16:36:15.925 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:36:15.925 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26506f0) [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26506f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26506f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmDeadProc: proc 0x26505c0 [ CSSD]2013-05-23 16:36:15.949 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26505c0) con(0x26b9670) skgpid 30094 ospid 30094 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:16.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:17.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:17.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:18.128 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:18.128 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:18.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067a002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:18.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:18.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:18.224 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:36:18.224 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:18.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067b002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:18.231 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:18.232 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:18.361 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:36:18.361 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:36:18.363 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:36:18.363 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:36:18.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:19.461 [1199044928] >TRACE: clssgmAllocProc: (0x2650560) allocated [ CSSD]2013-05-23 16:36:19.462 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:36:19.462 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650560 - 1,2,3 [ CSSD]2013-05-23 16:36:19.462 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9670) proc(0x2650560) pid(30115) version 11:1:1:4 [ CSSD]2013-05-23 16:36:19.468 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650560), client(1/0x26aae70) [ CSSD]2013-05-23 16:36:19.468 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 16:36:19.468 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aae70 with con 0x26aa920, requested num -1 [ CSSD]2013-05-23 16:36:19.468 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:19.468 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ec2d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:36:19.469 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:36:19.469 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:19.475 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aae70) [ CSSD]2013-05-23 16:36:19.475 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aae70), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:36:19.475 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ec5d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:19.475 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ec5d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:36:19.678 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650560 [ CSSD]2013-05-23 16:36:19.678 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650560) con(0x26b9670) skgpid ospid 30115 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:19.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:19.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:20.559 [1199044928] >TRACE: clssgmAllocProc: (0x2650560) allocated [ CSSD]2013-05-23 16:36:20.560 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:36:20.561 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650560 - 1,2,3 [ CSSD]2013-05-23 16:36:20.561 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x2650560) pid(30134) version 11:1:1:4 [ CSSD]2013-05-23 16:36:20.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x2650560), client(1/0x26aad10) [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aad10) [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aad10 with con 0x26aa920, requested num -1 [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ec450/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:36:20.567 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:20.573 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aad10) [ CSSD]2013-05-23 16:36:20.573 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aad10), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:36:20.573 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ec750) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:20.573 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ec750) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:36:20.776 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650560 [ CSSD]2013-05-23 16:36:20.776 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650560) con(0x26821e0) skgpid ospid 30134 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:21.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:21.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:22.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:22.569 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:23.131 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:23.132 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:23.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067c002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:23.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:23.273 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:23.273 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:36:23.273 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:23.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(067d002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:23.280 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:23.280 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:23.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(067e002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261be40) [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261be40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261be40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bef0 [ CSSD]2013-05-23 16:36:23.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bef0) con(0x261b9c0) skgpid 24712 ospid 24712 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:24.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:24.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:24.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:25.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(067f002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:25.581 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:25.581 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:25.581 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:36:25.581 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:25.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0680002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:25.587 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:25.588 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:26.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:26.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:26.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:27.134 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:27.135 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:36:28.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:28.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:28.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:30.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:30.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:30.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:32.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:32.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:32.138 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:32.138 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:32.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:32.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:33.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0681002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:34.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:34.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:34.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:35.815 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:36:35.816 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:36:35.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:36:35.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b97f0) proc(0x261bee0) pid(30278) version 11:1:1:4 [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x2690aa0) [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690aa0 with con 0x26b9060, requested num -1 [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:36:35.823 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:35.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:36:35.830 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:36:35.830 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26504e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:35.830 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26504e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:36:36.033 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:36:36.033 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26b97f0) skgpid ospid 30278 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:36.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:36.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:36.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:37.141 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:37.141 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:38.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:38.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:38.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:40.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:40.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:40.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:40.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0682002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:40.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:40.838 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:40.838 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:36:40.838 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:40.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0683002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:40.845 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:40.845 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:42.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:42.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:42.144 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:42.145 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:42.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:42.750 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:43.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0684002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:44.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:44.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:44.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:46.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:46.123 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:46.147 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:46.148 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:36:46.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:48.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:48.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:48.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:50.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:50.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:50.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:51.075 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:36:51.076 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:36:51.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:36:51.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b97f0) proc(0x261bee0) pid(30462) version 11:1:1:4 [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x2690aa0) [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690aa0 with con 0x261c520, requested num -1 [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:36:51.083 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:51.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:36:51.090 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:36:51.090 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26504e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:36:51.090 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26504e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:36:51.151 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:51.151 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:51.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:36:51.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26b97f0) skgpid ospid 30462 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:36:52.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:52.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:52.465 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:36:52.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:53.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0685002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:54.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:54.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:54.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:56.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0686002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:56.086 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:36:56.086 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:36:56.086 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:36:56.086 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:36:56.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0687002c) incarnation(174631051) [ CSSD]2013-05-23 16:36:56.093 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:36:56.093 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:36:56.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:36:56.155 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:36:56.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:56.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:56.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:36:58.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:36:58.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:36:58.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:00.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:00.340 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:00.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:01.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:01.159 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:02.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:02.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:02.490 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:02.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:03.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0688002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:04.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:04.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:04.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:05.161 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:05.162 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:37:06.329 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:06.330 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:37:06.331 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:06.331 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b97f0) proc(0x261bee0) pid(30628) version 11:1:1:4 [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x2690aa0) [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690aa0 with con 0x26b9060, requested num -1 [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:06.337 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:06.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:06.344 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:06.344 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26504e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:06.344 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26504e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:06.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:06.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:06.547 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:06.547 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26b97f0) skgpid ospid 30628 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:06.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:08.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:08.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:09.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:10.165 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:10.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:10.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:10.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:11.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:11.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0689002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:11.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:11.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:11.346 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:37:11.346 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:11.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068a002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:11.353 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:11.353 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:11.657 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:11.658 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:37:11.659 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:11.659 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261bee0) pid(30738) version 11:1:1:4 [ CSSD]2013-05-23 16:37:12.514 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:12.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:12.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:12.558 [1199044928] >TRACE: clssgmAllocProc: (0x26aa3f0) allocated [ CSSD]2013-05-23 16:37:12.559 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:37:12.559 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aa3f0 - 1,2,3 [ CSSD]2013-05-23 16:37:12.559 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b9480) proc(0x26aa3f0) pid(30876) version 11:1:1:4 [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aa3f0), client(1/0x26aab80) [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26aab80) [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26aab80 with con 0x26aa320, requested num -1 [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ec200/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:12.564 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:12.570 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26aab80) [ CSSD]2013-05-23 16:37:12.570 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26aab80), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:12.570 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26aacf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:12.570 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26aacf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:12.773 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aa3f0 [ CSSD]2013-05-23 16:37:12.773 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aa3f0) con(0x26b9480) skgpid ospid 30876 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:13.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:13.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(068b002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:14.262 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:14.262 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26821e0) skgpid ospid 30738 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:14.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:14.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:15.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:15.168 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:15.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:16.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:16.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:16.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:37:16.856 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:37:16.858 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:37:16.858 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:37:16.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068c002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:16.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:16.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:16.937 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:37:16.937 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:37:16.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(068d002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:16.944 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:16.944 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:17.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:18.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:18.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:19.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:19.715 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:19.716 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:37:19.717 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:19.717 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b97f0) proc(0x261bee0) pid(31100) version 11:1:1:4 [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x2690aa0) [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690aa0 with con 0x261c520, requested num -1 [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:19.723 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:19.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:19.730 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:19.730 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26504e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:19.731 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26504e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:19.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:19.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26b97f0) skgpid ospid 31100 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:20.172 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:20.172 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:20.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:20.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:21.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:21.586 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:21.587 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:37:21.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:21.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26b97f0) proc(0x261bee0) pid(31125) version 11:1:1:4 [ CSSD]2013-05-23 16:37:21.593 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x2690aa0) [ CSSD]2013-05-23 16:37:21.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:21.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2690aa0 with con 0x26b9060, requested num -1 [ CSSD]2013-05-23 16:37:21.594 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:21.594 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:21.594 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:21.594 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:21.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2690aa0) [ CSSD]2013-05-23 16:37:21.600 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2690aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:21.600 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26504e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:21.600 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26504e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:21.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:21.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26b97f0) skgpid ospid 31125 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:22.534 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:22.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:22.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:23.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:23.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(068e002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:23.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(068f002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:23.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:23.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:23.533 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:37:23.533 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:23.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0690002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:23.540 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:23.540 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:24.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:24.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:25.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:25.176 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:25.176 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:26.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0691002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:26.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:26.591 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:26.591 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:37:26.591 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:26.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0692002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:26.599 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:26.599 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:26.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:26.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:27.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:28.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:28.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:29.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:30.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:30.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:30.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:30.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:31.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:32.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:32.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:32.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:33.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:33.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0693002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:34.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:34.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:35.183 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:35.183 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:35.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:36.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:36.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:36.835 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:36.836 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:37:36.837 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:36.837 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261bee0) pid(31274) version 11:1:1:4 [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x26b93c0) [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b93c0) [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b93c0 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:36.843 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:36.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b93c0) [ CSSD]2013-05-23 16:37:36.850 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b93c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:36.850 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9530) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:36.850 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9530) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:37.053 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:37.053 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26821e0) skgpid ospid 31274 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:37.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:38.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:38.817 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:39.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:39.185 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:37:39.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:40.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:40.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:41.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:41.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0694002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:41.849 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:41.849 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:37:41.849 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:41.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0695002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:41.855 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:41.855 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:42.070 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:42.071 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:37:42.071 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:42.071 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261bee0) pid(31361) version 11:1:1:4 [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x261bee0), client(1/0x26b93c0) [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26b93c0) [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26b93c0 with con 0x26b8e80, requested num -1 [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26501e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:42.089 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:42.096 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26b93c0) [ CSSD]2013-05-23 16:37:42.096 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26b93c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:42.096 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b9530) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:42.096 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b9530) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:42.299 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:42.299 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x26821e0) skgpid ospid 31361 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:42.576 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:42.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:42.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:43.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:43.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0696002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:44.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:44.189 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:44.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:44.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:45.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:46.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:46.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:47.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:48.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:48.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:49.192 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:49.192 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:49.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:49.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269b430) [ CSSD]2013-05-23 16:37:49.338 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269b430), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:37:49.338 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269b430), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:37:49.338 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:37:49.339 [1199044928] >TRACE: clssgmDeadProc: proc 0x269b4e0 [ CSSD]2013-05-23 16:37:49.339 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269b4e0) con(0x26b9a50) skgpid 25810 ospid 25810 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:50.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:50.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:51.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:52.092 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:37:52.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:37:52.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:37:52.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b340) proc(0x261bee0) pid(31447) version 11:1:1:4 [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bee0), client(1/0x261c4d0) [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c4d0) [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c4d0 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:37:52.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:52.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c4d0) [ CSSD]2013-05-23 16:37:52.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:37:52.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:37:52.107 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:37:52.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:37:52.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x268b340) skgpid ospid 31447 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:37:52.599 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:37:53.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:53.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:53.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:53.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0697002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:54.195 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:54.196 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:37:55.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:55.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:55.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:57.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:57.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:57.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0698002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:57.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:37:57.097 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:37:57.097 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:37:57.097 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:37:57.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0699002c) incarnation(174631051) [ CSSD]2013-05-23 16:37:57.105 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:37:57.105 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:37:57.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:37:58.198 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:37:58.199 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:37:59.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:37:59.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:37:59.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:01.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:01.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:01.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:02.622 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:03.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:03.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:03.202 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:03.202 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:03.466 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:03.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069a002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:05.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:05.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:05.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:07.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:07.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:07.342 [1199044928] >TRACE: clssgmAllocProc: (0x2699ef0) allocated [ CSSD]2013-05-23 16:38:07.343 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:38:07.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2699ef0 - 1,2,3 [ CSSD]2013-05-23 16:38:07.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x2699ef0) pid(31593) version 11:1:1:4 [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2699ef0), client(1/0x268b4d0) [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b4d0) [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b4d0 with con 0x26b97f0, requested num -1 [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26505b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:07.350 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:07.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b4d0) [ CSSD]2013-05-23 16:38:07.357 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:38:07.357 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26508b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:07.358 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26508b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:07.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:07.560 [1199044928] >TRACE: clssgmDeadProc: proc 0x2699ef0 [ CSSD]2013-05-23 16:38:07.560 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2699ef0) con(0x26821e0) skgpid ospid 31593 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:08.205 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:08.206 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:09.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:09.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:09.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:11.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:11.113 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:11.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:12.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069b002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:12.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:38:12.346 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:38:12.346 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:38:12.346 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:12.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(069c002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:12.354 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:38:12.354 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:38:12.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:13.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:13.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:13.208 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:13.208 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:13.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:13.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069d002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:15.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:15.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:15.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:17.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:17.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:17.211 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:17.211 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:38:17.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:19.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:19.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:19.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:19.973 [1199044928] >TRACE: clssgmAllocProc: (0x261bee0) allocated [ CSSD]2013-05-23 16:38:19.973 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:19.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261bee0 - 1,2,3 [ CSSD]2013-05-23 16:38:19.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b340) proc(0x261bee0) pid(31718) version 11:1:1:4 [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261bee0), client(1/0x261c4d0) [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261c4d0) [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261c4d0 with con 0x268b4c0, requested num -1 [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c640/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:19.991 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:19.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261c4d0) [ CSSD]2013-05-23 16:38:19.998 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261c4d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:38:19.998 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c940) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:19.998 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c940) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:20.083 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x26cfa40), client(2/0x26b9980) [ CSSD]2013-05-23 16:38:20.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26b9980) [ CSSD]2013-05-23 16:38:20.083 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:38:20.083 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 24 [ CSSD]2013-05-23 16:38:20.200 [1199044928] >TRACE: clssgmDeadProc: proc 0x261bee0 [ CSSD]2013-05-23 16:38:20.200 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261bee0) con(0x268b340) skgpid ospid 31718 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:21.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:21.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:21.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:22.215 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:22.215 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:22.593 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:38:22.594 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:38:22.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:38:22.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699ef0) proc(0x261b8e0) pid(31749) version 11:1:1:4 [ CSSD]2013-05-23 16:38:22.600 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261b8e0), client(1/0x261beb0) [ CSSD]2013-05-23 16:38:22.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x261beb0) [ CSSD]2013-05-23 16:38:22.600 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x261beb0 with con 0x268b410, requested num -1 [ CSSD]2013-05-23 16:38:22.601 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:22.601 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c1c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:38:22.601 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:22.601 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:22.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x261beb0) [ CSSD]2013-05-23 16:38:22.607 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x261beb0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:38:22.607 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c4c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:22.607 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c4c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:22.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:22.809 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:38:22.809 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x2699ef0) skgpid ospid 31749 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:23.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:23.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:23.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(069e002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:23.767 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:23.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(069f002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:23.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:38:23.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:38:23.796 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:38:23.796 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:23.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a0002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:23.804 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:38:23.804 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:38:25.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:25.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:25.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:27.218 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:27.218 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:27.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:27.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:27.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a1002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:27.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:38:27.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:38:27.606 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:38:27.606 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:27.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a2002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:27.613 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:38:27.613 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:38:27.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:29.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:29.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:29.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:31.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:31.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:31.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:32.221 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:32.221 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:32.693 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:33.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:33.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:33.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a3002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:33.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:35.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:35.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:35.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:36.224 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:36.224 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:38:37.320 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:37.320 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:37.852 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:38:37.853 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:38:37.853 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:38:37.853 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261b8e0) pid(31920) version 11:1:1:4 [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261b8e0), client(1/0x268b420) [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x268b420) [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x268b420 with con 0x2699f00, requested num -1 [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c1c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:37.859 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:37.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x268b420) [ CSSD]2013-05-23 16:38:37.866 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x268b420), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:38:37.866 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650920) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:37.866 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:37.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:38.069 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:38:38.069 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x26821e0) skgpid ospid 31920 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:39.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:39.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:39.341 [1199044928] >TRACE: clssgmAllocProc: (0x261b8e0) allocated [ CSSD]2013-05-23 16:38:39.342 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:39.342 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261b8e0 - 1,2,3 [ CSSD]2013-05-23 16:38:39.342 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x261b8e0) pid(31967) version 11:1:1:4 [ CSSD]2013-05-23 16:38:39.349 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x261b8e0), client(1/0x2699f10) [ CSSD]2013-05-23 16:38:39.349 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2699f10) [ CSSD]2013-05-23 16:38:39.349 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x2699f10 with con 0x268b410, requested num -1 [ CSSD]2013-05-23 16:38:39.349 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:38:39.349 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x261c1c0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:38:39.350 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:39.350 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:39.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2699f10) [ CSSD]2013-05-23 16:38:39.356 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2699f10), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:38:39.356 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650920) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:38:39.356 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x2650920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:39.463 [1199044928] >TRACE: clssgmAllocProc: (0x269aa90) allocated [ CSSD]2013-05-23 16:38:39.464 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:39.464 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269aa90 - 1,2,3 [ CSSD]2013-05-23 16:38:39.464 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b410) proc(0x269aa90) pid(31972) version 11:1:1:4 [ CSSD]2013-05-23 16:38:39.490 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:38:39.493 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:38:39.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:38:39.497 [1199044928] >TRACE: clssgmDeadProc: proc 0x269aa90 [ CSSD]2013-05-23 16:38:39.497 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269aa90) con(0x268b410) skgpid ospid 31972 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:39.659 [1199044928] >TRACE: clssgmDeadProc: proc 0x261b8e0 [ CSSD]2013-05-23 16:38:39.659 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261b8e0) con(0x26821e0) skgpid ospid 31967 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:39.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:41.095 [1199044928] >TRACE: clssgmAllocProc: (0x2650920) allocated [ CSSD]2013-05-23 16:38:41.096 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:41.097 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650920 - 1,2,3 [ CSSD]2013-05-23 16:38:41.097 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b400) proc(0x2650920) pid(31995/31995) version 11:1:1:4 [ CSSD]2013-05-23 16:38:41.113 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2650920), client(1/0x261c400) [ CSSD]2013-05-23 16:38:41.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c400) [ CSSD]2013-05-23 16:38:41.114 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:38:41.114 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c400) [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c400), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c400), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650920 [ CSSD]2013-05-23 16:38:41.128 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650920) con(0x268b400) skgpid 31995 ospid 31995 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:41.228 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:41.228 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:41.271 [1199044928] >TRACE: clssgmAllocProc: (0x2650920) allocated [ CSSD]2013-05-23 16:38:41.272 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:41.272 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650920 - 1,2,3 [ CSSD]2013-05-23 16:38:41.272 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699ef0) proc(0x2650920) pid(32039/32039) version 11:1:1:4 [ CSSD]2013-05-23 16:38:41.279 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x2650920), client(1/0x261c400) [ CSSD]2013-05-23 16:38:41.279 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x261c400) [ CSSD]2013-05-23 16:38:41.279 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:38:41.279 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:38:41.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:41.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:41.547 [1199044928] >TRACE: clssgmAllocProc: (0x26bb640) allocated [ CSSD]2013-05-23 16:38:41.548 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:41.549 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26bb640 - 1,2,3 [ CSSD]2013-05-23 16:38:41.549 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x26bb640) pid(32011) version 11:1:1:4 [ CSSD]2013-05-23 16:38:41.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:42.168 [1199044928] >TRACE: clssgmDeadProc: proc 0x26bb640 [ CSSD]2013-05-23 16:38:42.168 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26bb640) con(0x26821e0) skgpid ospid 32011 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:42.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:42.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a4002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:42.855 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:38:42.855 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:38:42.855 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:38:42.855 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:42.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a5002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:42.863 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:38:42.863 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:38:43.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:43.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:43.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a6002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:43.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:45.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:45.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:45.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:46.231 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:46.231 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:47.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:47.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:47.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:49.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:49.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:49.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:51.235 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:51.235 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:38:51.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:51.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:52.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:52.739 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:38:53.101 [1199044928] >TRACE: clssgmAllocProc: (0x269aa90) allocated [ CSSD]2013-05-23 16:38:53.102 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:38:53.103 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269aa90 - 1,2,3 [ CSSD]2013-05-23 16:38:53.103 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261ba90) proc(0x269aa90) pid(32250) version 11:1:1:4 [ CSSD]2013-05-23 16:38:53.108 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269aa90), client(1/0x269b050) [ CSSD]2013-05-23 16:38:53.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x269b050) [ CSSD]2013-05-23 16:38:53.108 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x269b050 with con 0x26bb650, requested num -1 [ CSSD]2013-05-23 16:38:53.109 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:53.109 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x269b1c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:38:53.109 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:38:53.109 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:53.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x269b050) [ CSSD]2013-05-23 16:38:53.115 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x269b050), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:38:53.115 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x269b4c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:38:53.115 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x269b4c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:38:53.317 [1199044928] >TRACE: clssgmDeadProc: proc 0x269aa90 [ CSSD]2013-05-23 16:38:53.317 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269aa90) con(0x261ba90) skgpid ospid 32250 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:38:53.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:53.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:53.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06a7002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:54.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:54.121 [1199044928] >TRACE: clssgmAllocProc: (0x269aa90) allocated [ CSSD]2013-05-23 16:38:54.122 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:38:54.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x269aa90 - 1,2,3 [ CSSD]2013-05-23 16:38:54.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x261ba90) proc(0x269aa90) pid(32299/32299) version 11:1:1:4 [ CSSD]2013-05-23 16:38:54.138 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269aa90), client(1/0x269aed0) [ CSSD]2013-05-23 16:38:54.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x269aed0) [ CSSD]2013-05-23 16:38:54.138 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:38:54.138 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:38:55.238 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:38:55.238 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:38:55.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:55.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:56.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:57.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:57.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:38:58.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:38:58.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06a8002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:58.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:38:58.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:38:58.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:38:58.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:38:58.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06a9002c) incarnation(174631051) [ CSSD]2013-05-23 16:38:58.113 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:38:58.113 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:38:59.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:38:59.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:00.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:00.242 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:00.242 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:01.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:01.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:02.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:02.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:03.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:03.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:03.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06aa002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:04.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:05.245 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:05.246 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:05.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:05.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:06.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:07.074 [1199044928] >TRACE: clssgmAllocProc: (0x26aad20) allocated [ CSSD]2013-05-23 16:39:07.075 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:39:07.075 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26aad20 - 1,2,3 [ CSSD]2013-05-23 16:39:07.075 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x269b5d0) proc(0x26aad20) pid(32305/32305) version 11:1:1:4 [ CSSD]2013-05-23 16:39:07.080 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aad20), client(1/0x26ec7d0) [ CSSD]2013-05-23 16:39:07.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ec7d0) [ CSSD]2013-05-23 16:39:07.080 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:39:07.080 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:39:07.390 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x269aa90), client(2/0x26ecc50) [ CSSD]2013-05-23 16:39:07.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ecc50) [ CSSD]2013-05-23 16:39:07.390 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:39:07.390 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 16:39:07.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:07.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:08.195 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:08.350 [1199044928] >TRACE: clssgmAllocProc: (0x26ee160) allocated [ CSSD]2013-05-23 16:39:08.351 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:39:08.351 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee160 - 1,2,3 [ CSSD]2013-05-23 16:39:08.351 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed290) proc(0x26ee160) pid(32407) version 11:1:1:4 [ CSSD]2013-05-23 16:39:08.355 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee160), client(1/0x26812d0) [ CSSD]2013-05-23 16:39:08.355 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:08.355 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26812d0 with con 0x26ee090, requested num -1 [ CSSD]2013-05-23 16:39:08.355 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:08.355 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:39:08.356 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:08.356 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:08.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:08.360 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26812d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:39:08.360 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:08.360 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:08.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee160 [ CSSD]2013-05-23 16:39:08.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee160) con(0x26ed290) skgpid ospid 32407 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:09.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:09.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:10.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:10.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:10.249 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:11.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:11.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:12.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:12.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:13.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ab002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:13.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:39:13.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:39:13.355 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:39:13.355 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:13.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ac002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:13.363 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:39:13.363 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:39:13.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:13.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:13.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ad002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:14.285 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:15.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:15.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:15.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:15.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:16.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:17.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:17.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:18.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:19.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:19.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:20.246 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0b0) allocated [ CSSD]2013-05-23 16:39:20.247 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:39:20.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0b0 - 1,2,3 [ CSSD]2013-05-23 16:39:20.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x26ee0b0) pid(32556) version 11:1:1:4 [ CSSD]2013-05-23 16:39:20.254 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee0b0), client(1/0x26812d0) [ CSSD]2013-05-23 16:39:20.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:20.254 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26812d0 with con 0x26edfe0, requested num -1 [ CSSD]2013-05-23 16:39:20.254 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:20.254 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:39:20.255 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:20.255 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:20.255 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:20.256 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:20.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:20.261 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26812d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:39:20.261 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:20.261 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:20.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:20.464 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0b0 [ CSSD]2013-05-23 16:39:20.464 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0b0) con(0x26821e0) skgpid ospid 32556 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:21.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:21.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:22.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:22.805 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:23.598 [1199044928] >TRACE: clssgmAllocProc: (0x26ee160) allocated [ CSSD]2013-05-23 16:39:23.600 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:39:23.600 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee160 - 1,2,3 [ CSSD]2013-05-23 16:39:23.600 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed290) proc(0x26ee160) pid(32591) version 11:1:1:4 [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee160), client(1/0x26812d0) [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26812d0 with con 0x26ee090, requested num -1 [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:23.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:23.614 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:23.614 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26812d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:39:23.614 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:23.614 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:23.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:23.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:23.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ae002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:23.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee160 [ CSSD]2013-05-23 16:39:23.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee160) con(0x26ed290) skgpid ospid 32591 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:24.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06af002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:24.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:39:24.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:39:24.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:39:24.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:24.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b0002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:24.064 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:39:24.064 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:39:24.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:25.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:25.259 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:25.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:25.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:26.181 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0b0) allocated [ CSSD]2013-05-23 16:39:26.181 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:39:26.182 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0b0 - 1,2,3 [ CSSD]2013-05-23 16:39:26.182 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x26ee0b0) pid(32651) version 11:1:1:4 [ CSSD]2013-05-23 16:39:26.301 [1199044928] >TRACE: clssgmAllocProc: (0x26ddfd0) allocated [ CSSD]2013-05-23 16:39:26.302 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:39:26.303 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ddfd0 - 1,2,3 [ CSSD]2013-05-23 16:39:26.303 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26812e0) proc(0x26ddfd0) pid(32661) version 11:1:1:4 [ CSSD]2013-05-23 16:39:26.320 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:39:26.322 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:39:26.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ddfd0 [ CSSD]2013-05-23 16:39:26.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ddfd0) con(0x26812e0) skgpid ospid 32661 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5348/0x26de740) [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5348 (0x26de740) [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x26de740 with con 0x26edfe0, requested num -1 [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x26de8b0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:26.404 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:39:26.412 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5348 (0x26de740) [ CSSD]2013-05-23 16:39:26.412 [1199044928] >TRACE: clssgmExitGrock: client 5348 (0x26de740), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:39:26.412 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26debb0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:39:26.412 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x26debb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:26.413 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0b0 [ CSSD]2013-05-23 16:39:26.413 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0b0) con(0x26821e0) skgpid ospid 32651 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:26.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:27.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:27.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:28.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:28.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b1002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:28.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:39:28.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:39:28.615 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:39:28.615 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:28.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b2002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:28.622 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:39:28.622 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:39:29.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:29.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:30.262 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:30.262 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:30.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:31.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:31.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:32.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:32.826 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:33.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:33.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:33.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b3002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:34.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:35.265 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:35.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:35.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:35.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:36.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:37.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:37.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:38.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:38.847 [1199044928] >TRACE: clssgmAllocProc: (0x26ee160) allocated [ CSSD]2013-05-23 16:39:38.848 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:39:38.848 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee160 - 1,2,3 [ CSSD]2013-05-23 16:39:38.848 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed290) proc(0x26ee160) pid(32748) version 11:1:1:4 [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee160), client(1/0x26812d0) [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26812d0 with con 0x26ee090, requested num -1 [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:38.854 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:38.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:38.860 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26812d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:39:38.860 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:38.860 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:39.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee160 [ CSSD]2013-05-23 16:39:39.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee160) con(0x26ed290) skgpid ospid 32748 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:39.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:39.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:40.268 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:40.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:40.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:41.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:41.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:42.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:42.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:43.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:43.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:43.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b4002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:43.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b5002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:43.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:39:43.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:39:43.878 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:39:43.878 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:43.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b6002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:43.885 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:39:43.885 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:39:44.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:45.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:45.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:45.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:45.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:46.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:47.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:47.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:48.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:49.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:49.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:50.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:50.275 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:50.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:51.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:51.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:52.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:52.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:39:53.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06b7002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:53.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:53.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:54.091 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0b0) allocated [ CSSD]2013-05-23 16:39:54.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:39:54.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0b0 - 1,2,3 [ CSSD]2013-05-23 16:39:54.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x26ee0b0) pid(437) version 11:1:1:4 [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee0b0), client(1/0x26812d0) [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26812d0 with con 0x26edfe0, requested num -1 [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:39:54.097 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:54.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26812d0) [ CSSD]2013-05-23 16:39:54.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26812d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:39:54.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:39:54.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:39:54.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0b0 [ CSSD]2013-05-23 16:39:54.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0b0) con(0x26821e0) skgpid ospid 437 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:39:54.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:55.278 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:39:55.278 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:39:55.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:55.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:56.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:58.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:39:58.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:39:58.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:39:59.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06b8002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:59.133 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:39:59.133 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:39:59.133 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:39:59.133 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:39:59.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06b9002c) incarnation(174631051) [ CSSD]2013-05-23 16:39:59.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:39:59.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:00.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:00.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:00.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:00.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:00.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:02.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:02.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:02.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:02.891 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:03.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ba002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:04.061 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:04.061 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:04.370 [1199044928] >TRACE: clssgmAllocProc: (0x26ee0b0) allocated [ CSSD]2013-05-23 16:40:04.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:40:04.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee0b0 - 1,2,3 [ CSSD]2013-05-23 16:40:04.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26821e0) proc(0x26ee0b0) pid(767/767) version 11:1:1:4 [ CSSD]2013-05-23 16:40:04.387 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee0b0), client(1/0x2681140) [ CSSD]2013-05-23 16:40:04.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681140) [ CSSD]2013-05-23 16:40:04.387 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:40:04.387 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681140) [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681140), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681140), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee0b0 [ CSSD]2013-05-23 16:40:04.665 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee0b0) con(0x26821e0) skgpid 767 ospid 767 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:04.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:05.284 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:05.284 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:06.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:06.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:06.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:08.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:08.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:08.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:09.335 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1e0) allocated [ CSSD]2013-05-23 16:40:09.336 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:40:09.337 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1e0 - 1,2,3 [ CSSD]2013-05-23 16:40:09.337 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed290) proc(0x26ee1e0) pid(810) version 11:1:1:4 [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee1e0), client(1/0x2681400) [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2681400) [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2681400 with con 0x26ee0b0, requested num -1 [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681570/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:40:09.342 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:09.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2681400) [ CSSD]2013-05-23 16:40:09.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2681400), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:40:09.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681870) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:09.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681870) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:40:09.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1e0 [ CSSD]2013-05-23 16:40:09.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1e0) con(0x26ed290) skgpid ospid 810 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:10.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:10.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:10.286 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:10.287 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:10.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:12.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:12.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:12.913 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:12.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:13.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06bb002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:14.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:14.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:14.289 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:14.289 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:40:14.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06bc002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:14.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:40:14.384 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:40:14.384 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:40:14.384 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:14.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06bd002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:14.391 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:40:14.391 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:15.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:16.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:16.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:17.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:18.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:18.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:19.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:19.292 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:19.293 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:19.369 [1199044928] >TRACE: clssgmAllocProc: (0x26ee1e0) allocated [ CSSD]2013-05-23 16:40:19.370 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:40:19.370 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26ee1e0 - 1,2,3 [ CSSD]2013-05-23 16:40:19.370 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed290) proc(0x26ee1e0) pid(27790/27790) version 11:1:1:4 [ CSSD]2013-05-23 16:40:19.386 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x26ee1e0), client(1/0x2681270) [ CSSD]2013-05-23 16:40:19.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681270) [ CSSD]2013-05-23 16:40:19.386 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:40:19.386 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:40:19.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681270) [ CSSD]2013-05-23 16:40:19.410 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681270), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:40:19.410 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681270), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:40:19.411 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:40:19.411 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ee1e0 [ CSSD]2013-05-23 16:40:19.411 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ee1e0) con(0x26ed290) skgpid 27790 ospid 27790 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26eeb30) [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26eeb30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26eeb30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmDeadProc: proc 0x26ba1f0 [ CSSD]2013-05-23 16:40:19.437 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26ba1f0) con(0x266f0d0) skgpid 27794 ospid 27794 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:20.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:20.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:20.502 [1199044928] >TRACE: clssgmAllocProc: (0x26e1460) allocated [ CSSD]2013-05-23 16:40:20.503 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:40:20.504 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1460 - 1,2,3 [ CSSD]2013-05-23 16:40:20.504 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e1460) pid(934) version 11:1:1:4 [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1460), client(1/0x26e87b0) [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e87b0 with con 0x26821e0, requested num -1 [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26ed010/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:40:20.510 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:20.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e87b0) [ CSSD]2013-05-23 16:40:20.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e87b0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:40:20.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26ed310) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:20.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26ed310) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:40:20.719 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1460 [ CSSD]2013-05-23 16:40:20.719 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1460) con(0x266f0d0) skgpid ospid 934 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:21.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:21.392 [1199044928] >TRACE: clssgmAllocProc: (0x26e1460) allocated [ CSSD]2013-05-23 16:40:21.392 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:40:21.393 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26e1460 - 1,2,3 [ CSSD]2013-05-23 16:40:21.393 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x266f0d0) proc(0x26e1460) pid(32303/32303) version 11:1:1:4 [ CSSD]2013-05-23 16:40:21.407 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1460), client(1/0x26ecdc0) [ CSSD]2013-05-23 16:40:21.407 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26ecdc0) [ CSSD]2013-05-23 16:40:21.407 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:40:21.407 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:40:22.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:22.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:22.271 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26e1460), client(2/0x26ed180) [ CSSD]2013-05-23 16:40:22.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x26ed180) [ CSSD]2013-05-23 16:40:22.271 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:40:22.272 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 16:40:22.933 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:23.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:23.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06be002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:24.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:24.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:24.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:24.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:24.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06bf002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:24.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:40:24.315 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:40:24.315 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:40:24.315 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:24.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c0002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:24.322 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:40:24.322 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:24.583 [1199044928] >TRACE: clssgmAllocProc: (0x2681150) allocated [ CSSD]2013-05-23 16:40:24.584 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:40:24.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681150 - 1,2,3 [ CSSD]2013-05-23 16:40:24.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed7c0) proc(0x2681150) pid(973) version 11:1:1:4 [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681150), client(1/0x2681870) [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2681870) [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2681870 with con 0x2681080, requested num -1 [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26819e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:40:24.590 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:24.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2681870) [ CSSD]2013-05-23 16:40:24.596 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2681870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:40:24.596 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:24.596 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:40:24.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681150 [ CSSD]2013-05-23 16:40:24.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681150) con(0x26ed7c0) skgpid ospid 973 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:25.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:26.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:26.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:27.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:28.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:28.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:29.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:29.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:29.300 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:29.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c1002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:29.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:40:29.635 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:40:29.635 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:40:29.635 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:29.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c2002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:29.642 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:40:29.642 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:30.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:30.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:31.201 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:32.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:32.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:32.963 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:33.189 [1199044928] >TRACE: clssgmAllocProc: (0x2681150) allocated [ CSSD]2013-05-23 16:40:33.189 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:40:33.190 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2681150 - 1,2,3 [ CSSD]2013-05-23 16:40:33.190 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26ed7c0) proc(0x2681150) pid(926/926) version 11:1:1:4 [ CSSD]2013-05-23 16:40:33.197 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2681150), client(1/0x26816e0) [ CSSD]2013-05-23 16:40:33.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x26816e0) [ CSSD]2013-05-23 16:40:33.197 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:40:33.197 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:40:33.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:33.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:33.303 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:40:33.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c3002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:34.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:34.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:35.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:36.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:36.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:37.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:38.306 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:38.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:38.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:38.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:39.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:39.838 [1199044928] >TRACE: clssgmAllocProc: (0x26dea00) allocated [ CSSD]2013-05-23 16:40:39.839 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:40:39.840 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26dea00 - 1,2,3 [ CSSD]2013-05-23 16:40:39.840 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2681df0) proc(0x26dea00) pid(1115) version 11:1:1:4 [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x26dea00), client(1/0x26deee0) [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26deee0) [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26deee0 with con 0x26de8c0, requested num -1 [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26b3ea0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:40:39.845 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:39.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26deee0) [ CSSD]2013-05-23 16:40:39.851 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26deee0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:40:39.851 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x26b41a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:39.851 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x26b41a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:40:40.053 [1199044928] >TRACE: clssgmDeadProc: proc 0x26dea00 [ CSSD]2013-05-23 16:40:40.053 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26dea00) con(0x2681df0) skgpid ospid 1115 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:40.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:40.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:41.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:42.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:42.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:42.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:43.286 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:43.309 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:43.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:44.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c4002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:44.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:44.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:44.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c5002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:44.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:40:44.886 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:40:44.886 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:40:44.886 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:44.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c6002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:44.894 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:40:44.894 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:45.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:46.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:46.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:47.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:48.312 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:48.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:48.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:48.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:49.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:50.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:50.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x261c400) [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x261c400), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x261c400), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650920 [ CSSD]2013-05-23 16:40:50.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650920) con(0x2699ef0) skgpid 32039 ospid 32039 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:51.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:52.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:52.315 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:40:52.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:52.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:53.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:40:53.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:54.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06c7002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:54.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:54.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:55.086 [1199044928] >TRACE: clssgmAllocProc: (0x261c3b0) allocated [ CSSD]2013-05-23 16:40:55.087 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:40:55.087 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c3b0 - 1,2,3 [ CSSD]2013-05-23 16:40:55.087 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x26bba00) proc(0x261c3b0) pid(1289) version 11:1:1:4 [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261c3b0), client(1/0x26509e0) [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26509e0) [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26509e0 with con 0x2699f00, requested num -1 [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681aa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:40:55.094 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:55.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26509e0) [ CSSD]2013-05-23 16:40:55.100 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26509e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:40:55.100 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2681da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:40:55.100 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2681da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:40:55.302 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c3b0 [ CSSD]2013-05-23 16:40:55.302 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c3b0) con(0x26bba00) skgpid ospid 1289 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:40:55.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:56.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:56.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:57.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:40:57.318 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:40:57.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06c8002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:57.328 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:40:57.328 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:40:57.328 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:40:57.328 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:40:57.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06c9002c) incarnation(174631051) [ CSSD]2013-05-23 16:40:57.335 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:40:57.335 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:40:57.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:40:58.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:40:58.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:40:59.597 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:00.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ca002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:00.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:00.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:00.137 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:41:00.137 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:00.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cb002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:00.144 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:00.144 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:00.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:00.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:01.602 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:02.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:02.321 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:02.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:02.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:03.035 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:03.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:04.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06cc002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:04.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:04.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:05.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:06.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:06.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:07.324 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:07.324 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:07.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:08.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:08.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:09.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:10.341 [1199044928] >TRACE: clssgmAllocProc: (0x261c3b0) allocated [ CSSD]2013-05-23 16:41:10.342 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:41:10.342 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261c3b0 - 1,2,3 [ CSSD]2013-05-23 16:41:10.342 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x268b410) proc(0x261c3b0) pid(1429) version 11:1:1:4 [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261c3b0), client(1/0x2650aa0) [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2650aa0) [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2650aa0 with con 0x261cb40, requested num -1 [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x2681b70/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:41:10.348 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:10.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2650aa0) [ CSSD]2013-05-23 16:41:10.354 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2650aa0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:41:10.354 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c9c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:10.354 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c9c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:41:10.556 [1199044928] >TRACE: clssgmDeadProc: proc 0x261c3b0 [ CSSD]2013-05-23 16:41:10.556 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261c3b0) con(0x268b410) skgpid ospid 1429 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:10.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:10.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:10.963 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26aad20), client(2/0x268b340) [ CSSD]2013-05-23 16:41:10.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x268b340) [ CSSD]2013-05-23 16:41:10.963 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:41:10.963 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:41:11.672 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:12.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:12.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:12.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:12.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:13.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:13.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:14.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06cd002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:14.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:14.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:15.365 [1199044928] >TRACE: clssgmAllocProc: (0x2650920) allocated [ CSSD]2013-05-23 16:41:15.372 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:41:15.372 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x2650920 - 1,2,3 [ CSSD]2013-05-23 16:41:15.372 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2699f00) proc(0x2650920) pid(1504/1504) version 11:1:1:4 [ CSSD]2013-05-23 16:41:15.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ce002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:15.387 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:15.387 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:15.387 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:41:15.387 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:15.388 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x2650920), client(1/0x2681aa0) [ CSSD]2013-05-23 16:41:15.388 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x2681aa0) [ CSSD]2013-05-23 16:41:15.388 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:41:15.388 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:41:15.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06cf002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:15.395 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:15.395 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x2681aa0) [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x2681aa0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x2681aa0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmDeadProc: proc 0x2650920 [ CSSD]2013-05-23 16:41:15.436 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2650920) con(0x2699f00) skgpid 1504 ospid 1504 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:15.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:16.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:16.702 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:17.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:17.330 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:17.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:18.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d0002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:18.528 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:18.528 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:18.528 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:41:18.528 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:18.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d1002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:18.535 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:18.535 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:18.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:41:18.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:41:18.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:41:18.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:41:18.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:18.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:19.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:20.751 [1199044928] >TRACE: clssgmAllocProc: (0x261ca80) allocated [ CSSD]2013-05-23 16:41:20.751 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:41:20.752 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x261ca80 - 1,2,3 [ CSSD]2013-05-23 16:41:20.752 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2690a60) proc(0x261ca80) pid(1537) version 11:1:1:4 [ CSSD]2013-05-23 16:41:20.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:20.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:20.757 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x261ca80), client(1/0x2681d50) [ CSSD]2013-05-23 16:41:20.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x2681d50) [ CSSD]2013-05-23 16:41:20.757 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x2681d50 with con 0x2699e30, requested num -1 [ CSSD]2013-05-23 16:41:20.757 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:20.757 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26dc850/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:41:20.758 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:41:20.758 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:20.762 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x2681d50) [ CSSD]2013-05-23 16:41:20.762 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x2681d50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:41:20.762 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2650920) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:20.763 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2650920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:41:20.965 [1199044928] >TRACE: clssgmDeadProc: proc 0x261ca80 [ CSSD]2013-05-23 16:41:20.965 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261ca80) con(0x2690a60) skgpid ospid 1537 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:21.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:22.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:22.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:22.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:22.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:23.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:23.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e1090), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e1090), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:41:24.008 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x2660e70) skgpid 28625 ospid 28625 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:24.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d2002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:24.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d3002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:24.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:24.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:24.589 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:41:24.589 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:24.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d4002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:24.596 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:24.596 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:24.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:24.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:25.596 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:41:25.597 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:41:25.598 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:41:25.598 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26790b0) pid(1583) version 11:1:1:4 [ CSSD]2013-05-23 16:41:25.603 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:41:25.603 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:25.603 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1090 with con 0x2660e70, requested num -1 [ CSSD]2013-05-23 16:41:25.603 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:25.603 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:41:25.604 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:41:25.604 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:25.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:25.610 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:41:25.610 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x261c3b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:25.610 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x261c3b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:41:25.813 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:41:25.813 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x267d430) skgpid ospid 1583 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:25.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:26.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:26.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:27.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:27.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:27.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:28.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:28.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:29.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:30.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d5002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:30.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:30.638 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:30.638 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:41:30.638 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:30.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06d6002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:30.645 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:30.645 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:30.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:30.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:31.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:32.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:32.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:32.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:32.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:33.166 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:33.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:34.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d7002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:34.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:34.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:35.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:36.341 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:36.342 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:41:36.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:36.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:37.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:38.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:38.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:39.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:40.844 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:41:40.845 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:41:40.846 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:41:40.846 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26790b0) pid(1728) version 11:1:1:4 [ CSSD]2013-05-23 16:41:40.851 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:41:40.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:40.851 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1090 with con 0x266f180, requested num -1 [ CSSD]2013-05-23 16:41:40.851 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:40.851 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:41:40.852 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:41:40.852 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:40.858 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:40.858 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:41:40.858 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2699e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:40.858 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2699e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:41:40.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:40.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:41.061 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:41:41.061 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x2660e70) skgpid ospid 1728 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:41.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:41.345 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:41.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:42.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:42.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:43.190 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:43.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:44.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06d8002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:44.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:44.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:45.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06d9002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:45.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:41:45.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:41:45.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:41:45.898 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:45.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06da002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:45.905 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:41:45.905 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:41:45.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:46.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:46.348 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:46.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:46.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:47.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:48.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:48.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:50.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:50.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:50.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:51.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:51.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:52.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:53.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:53.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:53.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:41:54.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:54.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06db002c) incarnation(174631051) [ CSSD]2013-05-23 16:41:55.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:55.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:56.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:56.091 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:41:56.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:41:56.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:41:56.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x267d430) proc(0x26790b0) pid(1892) version 11:1:1:4 [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790b0), client(1/0x26e1090) [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x26e1090 with con 0x268f8a0, requested num -1 [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x26e89c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:41:56.098 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:41:56.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x26e1090) [ CSSD]2013-05-23 16:41:56.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x26e1090), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:41:56.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x2699e30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:41:56.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x2699e30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:41:56.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:41:56.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x267d430) skgpid ospid 1892 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:41:56.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:41:56.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:41:57.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:57.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:41:58.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:41:59.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:41:59.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:00.189 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:00.355 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:00.355 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:42:01.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:01.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:01.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06dc002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:01.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:01.158 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:01.158 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:01.158 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:01.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06dd002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:01.166 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:01.166 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:02.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:02.471 [1199044928] >TRACE: clssgmAllocProc: (0x26790b0) allocated [ CSSD]2013-05-23 16:42:02.472 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:42:02.472 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x26790b0 - 1,2,3 [ CSSD]2013-05-23 16:42:02.472 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x2660e70) proc(0x26790b0) pid(31557/31557) version 11:1:1:4 [ CSSD]2013-05-23 16:42:02.488 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x26790b0), client(1/0x7f82ac007b50) [ CSSD]2013-05-23 16:42:02.488 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac007b50) [ CSSD]2013-05-23 16:42:02.488 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:42:02.488 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:42:03.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:03.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:03.229 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:04.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06de002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:04.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:05.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:05.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:05.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:05.358 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:06.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:07.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:07.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:07.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06df002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:07.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:07.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:07.389 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:07.389 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:07.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e0002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:07.397 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:07.397 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:08.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:09.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:09.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:10.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:10.361 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:10.361 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:11.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:11.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:11.210 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0073d0) allocated [ CSSD]2013-05-23 16:42:11.210 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:42:11.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0073d0 - 1,2,3 [ CSSD]2013-05-23 16:42:11.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007a90) proc(0x7f82ac0073d0) pid(2075) version 11:1:1:4 [ CSSD]2013-05-23 16:42:11.337 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac012d60) allocated [ CSSD]2013-05-23 16:42:11.338 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:42:11.338 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac012d60 - 1,2,3 [ CSSD]2013-05-23 16:42:11.338 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006570) proc(0x7f82ac012d60) pid(2135) version 11:1:1:4 [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82ac012d60), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019c60 with con 0x7f82ac0035c0, requested num -1 [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac0132b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:42:11.344 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:11.351 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:11.351 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:42:11.351 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac003440) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:11.351 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac003440) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:42:11.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac012d60 [ CSSD]2013-05-23 16:42:11.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac012d60) con(0x7f82ac006570) skgpid ospid 2135 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:12.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:13.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:13.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:13.248 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:13.777 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0073d0 [ CSSD]2013-05-23 16:42:13.777 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0073d0) con(0x7f82ac007a90) skgpid ospid 2075 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:14.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e1002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:14.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:15.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:15.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:15.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:15.364 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:16.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:16.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e2002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:16.419 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:16.419 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:16.419 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:16.419 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:16.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e3002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:16.427 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:16.427 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:17.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:42:17.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:42:17.165 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:42:17.165 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:42:17.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e4002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:17.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:17.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:17.244 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac018ea0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:42:17.244 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:42:17.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e5002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:17.253 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:17.253 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:17.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:17.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:18.318 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:19.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:19.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:20.367 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:20.367 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:20.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:21.005 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005fe0) allocated [ CSSD]2013-05-23 16:42:21.006 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:42:21.006 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005fe0 - 1,2,3 [ CSSD]2013-05-23 16:42:21.006 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007060) proc(0x7f82ac005fe0) pid(2515) version 11:1:1:4 [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac005fe0), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019c60 with con 0x7f82ac077300, requested num -1 [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006730/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:42:21.012 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:21.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:21.018 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:42:21.018 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006a30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:21.018 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006a30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:42:21.221 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005fe0 [ CSSD]2013-05-23 16:42:21.221 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005fe0) con(0x7f82ac007060) skgpid ospid 2515 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:21.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:21.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:22.376 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:23.269 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:23.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:23.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:24.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06e6002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:24.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:24.370 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:42:24.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:24.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e7002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:24.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:24.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:24.854 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:24.854 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:24.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06e8002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:24.863 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:24.863 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:25.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:25.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:26.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:26.582 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005fe0) allocated [ CSSD]2013-05-23 16:42:26.582 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:42:26.583 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005fe0 - 1,2,3 [ CSSD]2013-05-23 16:42:26.583 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007060) proc(0x7f82ac005fe0) pid(2566) version 11:1:1:4 [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac005fe0), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019c60 with con 0x7f82ac077300, requested num -1 [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006730/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:42:26.589 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:26.596 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:26.596 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:42:26.596 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006a30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:26.596 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006a30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:42:26.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005fe0 [ CSSD]2013-05-23 16:42:26.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005fe0) con(0x7f82ac007060) skgpid ospid 2566 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:27.313 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:27.313 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:28.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:29.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:29.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:29.373 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:29.373 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:30.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:31.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:31.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:31.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06e9002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:31.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:31.666 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:31.666 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:31.666 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:31.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ea002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:31.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:31.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:32.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:33.290 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:33.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:33.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:34.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06eb002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:34.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:34.376 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:34.419 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:35.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:35.389 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:36.425 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:37.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:37.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:38.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:39.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:39.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:39.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:39.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:40.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:41.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:41.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:41.830 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0073d0) allocated [ CSSD]2013-05-23 16:42:41.831 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:42:41.832 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0073d0 - 1,2,3 [ CSSD]2013-05-23 16:42:41.832 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007a90) proc(0x7f82ac0073d0) pid(2712) version 11:1:1:4 [ CSSD]2013-05-23 16:42:41.838 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac0073d0), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:41.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:41.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019c60 with con 0x7f82ac077300, requested num -1 [ CSSD]2013-05-23 16:42:41.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:41.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006550/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:42:41.839 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:42:41.839 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:41.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:41.845 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:42:41.845 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006850) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:41.846 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006850) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:42:42.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0073d0 [ CSSD]2013-05-23 16:42:42.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0073d0) con(0x7f82ac007a90) skgpid ospid 2712 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:42.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:43.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:43.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:43.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:42:43.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:43.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:44.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ec002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:44.579 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:45.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:45.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:46.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:46.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06ed002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:46.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:42:46.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:42:46.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac018ea0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:42:46.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:46.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06ee002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:46.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:42:46.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac019270) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:42:47.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:47.473 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:48.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:48.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:48.608 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26cdda0) [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26cdda0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26cdda0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x261f300 [ CSSD]2013-05-23 16:42:49.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x261f300) con(0x26ee500) skgpid 29517 ospid 29517 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26e4ea0) [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26e4ea0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmDeadProc: proc 0x268c190 [ CSSD]2013-05-23 16:42:49.469 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x268c190) con(0x26ba140) skgpid 29521 ospid 29521 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:49.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:49.485 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:50.701 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:51.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:51.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:52.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:53.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:42:53.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:53.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:53.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:53.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:54.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ef002c) incarnation(174631051) [ CSSD]2013-05-23 16:42:54.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:55.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:55.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:56.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:57.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005fe0) allocated [ CSSD]2013-05-23 16:42:57.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:42:57.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005fe0 - 1,2,3 [ CSSD]2013-05-23 16:42:57.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007060) proc(0x7f82ac005fe0) pid(2882) version 11:1:1:4 [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac005fe0), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac019c60 with con 0x7f82ac077300, requested num -1 [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac006720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:42:57.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:42:57.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:57.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac019c60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:42:57.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac006a20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:42:57.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac006a20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:42:57.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005fe0 [ CSSD]2013-05-23 16:42:57.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005fe0) con(0x7f82ac007060) skgpid ospid 2882 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:42:57.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:57.525 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:42:58.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:42:58.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:42:58.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:42:59.242 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac005fe0) allocated [ CSSD]2013-05-23 16:42:59.243 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:42:59.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac005fe0 - 1,2,3 [ CSSD]2013-05-23 16:42:59.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007060) proc(0x7f82ac005fe0) pid(2831/2831) version 11:1:1:4 [ CSSD]2013-05-23 16:42:59.260 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac005fe0), client(1/0x7f82ac019c60) [ CSSD]2013-05-23 16:42:59.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:42:59.260 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:42:59.260 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:42:59.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:42:59.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:00.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:01.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:01.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:02.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f0002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:02.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:43:02.176 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:43:02.176 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:43:02.176 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:02.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f1002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:02.185 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:43:02.185 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac006340) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:43:02.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:02.395 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac007b50) [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac007b50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac007b50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmDeadProc: proc 0x26790b0 [ CSSD]2013-05-23 16:43:02.459 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26790b0) con(0x2660e70) skgpid 31557 ospid 31557 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:02.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:03.356 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:03.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:03.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:04.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f2002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:04.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:05.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:05.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:06.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:07.398 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:07.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:07.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:07.753 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:08.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:09.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:09.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:10.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:11.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:11.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:12.339 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006960) allocated [ CSSD]2013-05-23 16:43:12.340 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:43:12.341 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006960 - 1,2,3 [ CSSD]2013-05-23 16:43:12.341 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007bf0) proc(0x7f82ac006960) pid(3053) version 11:1:1:4 [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006960), client(1/0x7f82ac006d60) [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006d60) [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006d60 with con 0x7f82ac006400, requested num -1 [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:12.347 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:12.355 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006d60) [ CSSD]2013-05-23 16:43:12.355 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:43:12.355 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:12.355 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:12.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:12.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:12.557 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006960 [ CSSD]2013-05-23 16:43:12.557 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006960) con(0x7f82ac007bf0) skgpid ospid 3053 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:12.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:13.379 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:13.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:13.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:14.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f3002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:15.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:15.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:15.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:17.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:17.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:17.405 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:17.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f4002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:17.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:43:17.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:43:17.427 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:43:17.427 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:17.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f5002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:17.434 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:43:17.434 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007680) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:43:17.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:17.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:19.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:19.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:19.898 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:21.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:21.260 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003910) allocated [ CSSD]2013-05-23 16:43:21.261 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:43:21.262 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003910 - 1,2,3 [ CSSD]2013-05-23 16:43:21.262 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007c00) proc(0x7f82ac003910) pid(3151) version 11:1:1:4 [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac003910), client(1/0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0063f0 with con 0x7f82ac003a40, requested num -1 [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:21.268 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:21.274 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:21.274 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0063f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:43:21.274 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:21.274 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:21.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:21.408 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:43:21.477 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003910 [ CSSD]2013-05-23 16:43:21.477 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003910) con(0x7f82ac007c00) skgpid ospid 3151 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:21.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:21.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:23.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:23.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:23.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:23.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:24.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06f6002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:25.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:25.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f7002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:25.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:43:25.127 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:43:25.127 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:43:25.127 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:25.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06f8002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:25.135 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:43:25.135 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007680) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:43:25.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:25.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:26.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:26.411 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:27.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:27.587 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003910) allocated [ CSSD]2013-05-23 16:43:27.588 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:43:27.589 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003910 - 1,2,3 [ CSSD]2013-05-23 16:43:27.589 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007c00) proc(0x7f82ac003910) pid(3205) version 11:1:1:4 [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac003910), client(1/0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0063f0 with con 0x7f82ac003a40, requested num -1 [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:27.595 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:27.601 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:27.601 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0063f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:43:27.601 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:27.601 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:27.804 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003910 [ CSSD]2013-05-23 16:43:27.804 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003910) con(0x7f82ac007c00) skgpid ospid 3205 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:28.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:28.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:29.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:30.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:30.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:31.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:31.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:31.415 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:32.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:32.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:32.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06f9002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:32.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:43:32.679 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:43:32.679 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:43:32.679 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:32.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06fa002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:32.686 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:43:32.686 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007680) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:43:33.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:33.450 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:34.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:34.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:34.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fb002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:35.122 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:36.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:36.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:36.417 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:36.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:37.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:38.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:38.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:39.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:39.740 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003910) allocated [ CSSD]2013-05-23 16:43:39.741 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:43:39.742 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003910 - 1,2,3 [ CSSD]2013-05-23 16:43:39.742 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007c00) proc(0x7f82ac003910) pid(3327) version 11:1:1:4 [ CSSD]2013-05-23 16:43:39.748 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac003910), client(1/0x7f82ac003a40) [ CSSD]2013-05-23 16:43:39.748 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac003a40) [ CSSD]2013-05-23 16:43:39.748 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82ac003a40 with con 0x7f82ac0063f0, requested num -1 [ CSSD]2013-05-23 16:43:39.748 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:43:39.748 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:43:39.749 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:39.749 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:39.755 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac003a40) [ CSSD]2013-05-23 16:43:39.755 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac003a40), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:43:39.755 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:43:39.755 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:39.833 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0135b0) allocated [ CSSD]2013-05-23 16:43:39.834 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:43:39.835 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0135b0 - 1,2,3 [ CSSD]2013-05-23 16:43:39.835 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006dc0) proc(0x7f82ac0135b0) pid(3332) version 11:1:1:4 [ CSSD]2013-05-23 16:43:39.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:43:39.850 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:43:39.853 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:43:39.853 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0135b0 [ CSSD]2013-05-23 16:43:39.853 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0135b0) con(0x7f82ac006dc0) skgpid ospid 3332 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:39.957 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003910 [ CSSD]2013-05-23 16:43:39.957 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003910) con(0x7f82ac007c00) skgpid ospid 3327 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:40.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:40.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:40.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:40.421 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:43:41.010 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006960) allocated [ CSSD]2013-05-23 16:43:41.011 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:43:41.011 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006960 - 1,2,3 [ CSSD]2013-05-23 16:43:41.011 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007bf0) proc(0x7f82ac006960) pid(3355) version 11:1:1:4 [ CSSD]2013-05-23 16:43:41.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:41.502 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006960 [ CSSD]2013-05-23 16:43:41.502 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006960) con(0x7f82ac007bf0) skgpid ospid 3355 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:42.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:42.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:42.826 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac006960) allocated [ CSSD]2013-05-23 16:43:42.827 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:43:42.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac006960 - 1,2,3 [ CSSD]2013-05-23 16:43:42.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007bf0) proc(0x7f82ac006960) pid(3520) version 11:1:1:4 [ CSSD]2013-05-23 16:43:42.833 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac006960), client(1/0x7f82ac006d60) [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac006d60) [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac006d60 with con 0x7f82ac006400, requested num -1 [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:42.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:42.840 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac006d60) [ CSSD]2013-05-23 16:43:42.840 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac006d60), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:43:42.840 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:42.840 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:43.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac006960 [ CSSD]2013-05-23 16:43:43.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac006960) con(0x7f82ac007bf0) skgpid ospid 3520 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:43.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:43.477 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:44.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:44.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:44.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06fc002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:45.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:45.424 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:45.424 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:46.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:46.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:47.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:47.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(06fd002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:47.929 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:43:47.929 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:43:47.929 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:43:47.929 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:47.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(06fe002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:47.936 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:43:47.936 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007680) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:43:48.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:48.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:49.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:50.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:50.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:50.427 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:50.427 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:51.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:52.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:52.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:53.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:53.515 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:43:54.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:54.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:54.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(06ff002c) incarnation(174631051) [ CSSD]2013-05-23 16:43:55.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:55.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:55.430 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:43:56.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:56.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:57.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:58.076 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac003910) allocated [ CSSD]2013-05-23 16:43:58.076 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:43:58.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac003910 - 1,2,3 [ CSSD]2013-05-23 16:43:58.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac007c00) proc(0x7f82ac003910) pid(3692) version 11:1:1:4 [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac003910), client(1/0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0063f0 with con 0x7f82ac003a40, requested num -1 [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac013290/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:43:58.082 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:43:58.088 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0063f0) [ CSSD]2013-05-23 16:43:58.088 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0063f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:43:58.088 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac013590) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:43:58.088 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac013590) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:43:58.291 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac003910 [ CSSD]2013-05-23 16:43:58.291 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac003910) con(0x7f82ac007c00) skgpid ospid 3692 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:43:58.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:43:58.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:43:59.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:43:59.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:43:59.433 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:44:00.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:00.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:01.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:02.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:02.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:03.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0700002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:03.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:44:03.199 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:44:03.199 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac006580/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:44:03.199 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:03.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0701002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:03.207 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:44:03.207 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007680) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:44:03.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:03.535 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:04.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:04.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:04.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:04.436 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:04.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0702002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:04.697 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac005fe0), client(2/0x7f82ac007bf0) [ CSSD]2013-05-23 16:44:04.697 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82ac007bf0) [ CSSD]2013-05-23 16:44:04.697 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:44:04.697 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 16:44:04.806 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0039b0) allocated [ CSSD]2013-05-23 16:44:04.807 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:44:04.808 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0039b0 - 1,2,3 [ CSSD]2013-05-23 16:44:04.808 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac006a20) proc(0x7f82ac0039b0) pid(2829/2829) version 11:1:1:4 [ CSSD]2013-05-23 16:44:04.814 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82ac0039b0), client(1/0x7f82ac013490) [ CSSD]2013-05-23 16:44:04.814 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac013490) [ CSSD]2013-05-23 16:44:04.814 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:44:04.814 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:44:05.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:06.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:06.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:07.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:08.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:08.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:09.390 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:09.439 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:09.440 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:10.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:10.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:11.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:12.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:12.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:13.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc40) allocated [ CSSD]2013-05-23 16:44:13.334 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:44:13.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc40 - 1,2,3 [ CSSD]2013-05-23 16:44:13.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013b70) proc(0x7f82ac00fc40) pid(3858) version 11:1:1:4 [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fc40), client(1/0x7f82ac001520) [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001520 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:13.341 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:13.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:13.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001520), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:44:13.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:13.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:13.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:13.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc40 [ CSSD]2013-05-23 16:44:13.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc40) con(0x7f82ac013b70) skgpid ospid 3858 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:13.559 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:14.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:14.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:14.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:14.443 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:14.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0703002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:15.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:16.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:16.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:17.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:18.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0704002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:18.459 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:44:18.459 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:44:18.459 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013710/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:44:18.459 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:18.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:18.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:18.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0705002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:18.467 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:44:18.467 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:44:19.446 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:19.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:19.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:20.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:20.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:21.495 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:21.518 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fd10) allocated [ CSSD]2013-05-23 16:44:21.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:44:21.520 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fd10 - 1,2,3 [ CSSD]2013-05-23 16:44:21.520 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013c80) proc(0x7f82ac00fd10) pid(3961) version 11:1:1:4 [ CSSD]2013-05-23 16:44:21.524 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fd10), client(1/0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015e0 with con 0x7f82ac014230, requested num -1 [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:21.525 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:21.530 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:21.530 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:44:21.530 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:21.530 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:21.732 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fd10 [ CSSD]2013-05-23 16:44:21.732 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fd10) con(0x7f82ac013c80) skgpid ospid 3961 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:22.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:22.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:23.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:23.578 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:24.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:24.449 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:24.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:24.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:24.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0706002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:25.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0707002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:25.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:44:25.391 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:44:25.391 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:44:25.391 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:25.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0708002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:25.400 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:44:25.400 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:44:25.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:26.496 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fd10) allocated [ CSSD]2013-05-23 16:44:26.497 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:44:26.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fd10 - 1,2,3 [ CSSD]2013-05-23 16:44:26.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013c80) proc(0x7f82ac00fd10) pid(4006) version 11:1:1:4 [ CSSD]2013-05-23 16:44:26.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:26.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:26.622 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac0049d0) allocated [ CSSD]2013-05-23 16:44:26.623 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:44:26.624 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac0049d0 - 1,2,3 [ CSSD]2013-05-23 16:44:26.624 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac014230) proc(0x7f82ac0049d0) pid(4016) version 11:1:1:4 [ CSSD]2013-05-23 16:44:26.643 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:44:26.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:44:26.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0049d0 [ CSSD]2013-05-23 16:44:26.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0049d0) con(0x7f82ac014230) skgpid ospid 4016 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:26.727 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5349/0x7f82ac001520) [ CSSD]2013-05-23 16:44:26.727 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5349 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:26.727 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82ac001520 with con 0x7f82ac014230, requested num -1 [ CSSD]2013-05-23 16:44:26.727 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:44:26.727 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82ac001690/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:44:26.728 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:26.728 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:44:26.733 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5349 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:26.733 [1199044928] >TRACE: clssgmExitGrock: client 5349 (0x7f82ac001520), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:44:26.733 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001990) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:44:26.733 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82ac001990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:26.734 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fd10 [ CSSD]2013-05-23 16:44:26.734 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fd10) con(0x7f82ac013c80) skgpid ospid 4006 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:27.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:28.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:28.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:28.576 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc40) allocated [ CSSD]2013-05-23 16:44:28.577 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:44:28.578 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc40 - 1,2,3 [ CSSD]2013-05-23 16:44:28.578 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013b70) proc(0x7f82ac00fc40) pid(4041) version 11:1:1:4 [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fc40), client(1/0x7f82ac001520) [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001520 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:28.584 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:28.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:28.590 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001520), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:44:28.590 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:28.590 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:28.793 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc40 [ CSSD]2013-05-23 16:44:28.793 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc40) con(0x7f82ac013b70) skgpid ospid 4041 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:29.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:29.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:29.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:30.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:30.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:31.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:32.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:32.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:33.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:33.605 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:33.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0709002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:33.713 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:44:33.713 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:44:33.713 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013710/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:44:33.713 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:33.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(070a002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:33.720 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:44:33.720 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:44:34.454 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:34.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:34.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:34.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:34.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070b002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:35.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:36.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:36.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:37.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:38.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:38.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:39.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:39.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:39.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:40.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:40.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:41.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:42.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:42.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:43.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:43.461 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:44:43.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:43.626 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:43.825 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fd10) allocated [ CSSD]2013-05-23 16:44:43.826 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:44:43.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fd10 - 1,2,3 [ CSSD]2013-05-23 16:44:43.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013c80) proc(0x7f82ac00fd10) pid(4199) version 11:1:1:4 [ CSSD]2013-05-23 16:44:43.832 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fd10), client(1/0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:43.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:43.832 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015e0 with con 0x7f82ac014230, requested num -1 [ CSSD]2013-05-23 16:44:43.832 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:43.832 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:44:43.833 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:43.833 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:43.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:44:43.839 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:44:43.839 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:43.840 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:44.042 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fd10 [ CSSD]2013-05-23 16:44:44.042 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fd10) con(0x7f82ac013c80) skgpid ospid 4199 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:44.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070c002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:44.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:44.790 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:45.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:46.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:46.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:47.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:48.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:48.464 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:48.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:48.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:48.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(070d002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:48.962 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:44:48.962 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:44:48.962 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:44:48.962 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:48.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(070e002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:48.970 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:44:48.970 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:44:49.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:50.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:50.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:51.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:52.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:52.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:53.467 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:53.467 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:53.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:44:53.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:54.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(070f002c) incarnation(174631051) [ CSSD]2013-05-23 16:44:54.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:54.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:55.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:56.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:56.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:57.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:44:58.470 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:44:58.470 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:44:58.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:44:58.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:44:59.073 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc40) allocated [ CSSD]2013-05-23 16:44:59.074 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:44:59.074 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc40 - 1,2,3 [ CSSD]2013-05-23 16:44:59.074 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013b70) proc(0x7f82ac00fc40) pid(4361) version 11:1:1:4 [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fc40), client(1/0x7f82ac001520) [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001520 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:44:59.080 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:44:59.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:44:59.086 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001520), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:44:59.086 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:44:59.086 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:44:59.289 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc40 [ CSSD]2013-05-23 16:44:59.289 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc40) con(0x7f82ac013b70) skgpid ospid 4361 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:44:59.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:00.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:00.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:01.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:02.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:02.473 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:45:02.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:02.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:03.667 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:03.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:04.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0710002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:04.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:45:04.213 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:45:04.213 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013710/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:45:04.213 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:04.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0711002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:04.220 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:45:04.220 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:45:04.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0712002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:04.898 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc40) allocated [ CSSD]2013-05-23 16:45:04.898 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:45:04.899 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc40 - 1,2,3 [ CSSD]2013-05-23 16:45:04.899 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013b70) proc(0x7f82ac00fc40) pid(4455/4455) version 11:1:1:4 [ CSSD]2013-05-23 16:45:04.915 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fc40), client(1/0x7f82ac00fb70) [ CSSD]2013-05-23 16:45:04.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac00fb70) [ CSSD]2013-05-23 16:45:04.915 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:45:04.915 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:45:05.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:05.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac00fb70) [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac00fb70), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac00fb70), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc40 [ CSSD]2013-05-23 16:45:05.185 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc40) con(0x7f82ac013b70) skgpid 4455 ospid 4455 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:45:05.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:07.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:07.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:07.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:07.476 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:07.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:09.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:09.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:09.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:11.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:11.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:11.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:12.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:12.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:13.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:13.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:13.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:13.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:14.332 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fd70) allocated [ CSSD]2013-05-23 16:45:14.332 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:45:14.333 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fd70 - 1,2,3 [ CSSD]2013-05-23 16:45:14.333 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013c80) proc(0x7f82ac00fd70) pid(4513) version 11:1:1:4 [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fd70), client(1/0x7f82ac0015e0) [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0015e0 with con 0x7f82ac014230, requested num -1 [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001750/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:45:14.339 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:14.346 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0015e0) [ CSSD]2013-05-23 16:45:14.346 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0015e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:45:14.346 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001a50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:14.346 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:45:14.549 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fd70 [ CSSD]2013-05-23 16:45:14.549 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fd70) con(0x7f82ac013c80) skgpid ospid 4513 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:45:14.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0713002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:15.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:15.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:15.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:17.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:17.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:17.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:17.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:17.960 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:19.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:19.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:19.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0714002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:19.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:45:19.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:45:19.462 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac013600/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:45:19.462 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:19.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0715002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:19.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:45:19.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013320) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:45:20.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:21.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:21.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:21.485 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:21.486 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:45:21.781 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fc40) allocated [ CSSD]2013-05-23 16:45:21.782 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:45:21.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fc40 - 1,2,3 [ CSSD]2013-05-23 16:45:21.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac013b70) proc(0x7f82ac00fc40) pid(4638) version 11:1:1:4 [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac00fc40), client(1/0x7f82ac001520) [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001520 with con 0x7f82ac00fb70, requested num -1 [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac001690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:45:21.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:21.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001520) [ CSSD]2013-05-23 16:45:21.795 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001520), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:45:21.795 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac001990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:21.796 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac001990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:45:21.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fc40 [ CSSD]2013-05-23 16:45:21.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fc40) con(0x7f82ac013b70) skgpid ospid 4638 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:45:22.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:22.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac014030) allocated [ CSSD]2013-05-23 16:45:22.776 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:45:22.776 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac014030 - 1,2,3 [ CSSD]2013-05-23 16:45:22.776 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac002600) proc(0x7f82ac014030) pid(4624/4624) version 11:1:1:4 [ CSSD]2013-05-23 16:45:22.792 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82ac014030), client(1/0x7f82ac001670) [ CSSD]2013-05-23 16:45:22.792 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82ac001670) [ CSSD]2013-05-23 16:45:22.792 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:45:22.792 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:45:23.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:23.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:23.711 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:24.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:24.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0716002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:25.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:25.272 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:25.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0717002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:25.653 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:45:25.653 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:45:25.653 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0018b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:45:25.653 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:25.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0718002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:25.660 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:45:25.660 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:45:26.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:26.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:26.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:27.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:27.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:28.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:29.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:29.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:29.581 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe20) allocated [ CSSD]2013-05-23 16:45:29.582 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:45:29.582 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe20 - 1,2,3 [ CSSD]2013-05-23 16:45:29.582 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac001cb0) proc(0x7f82ac00fe20) pid(4701) version 11:1:1:4 [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac00fe20), client(1/0x7f82ac00ff50) [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ff50) [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ff50 with con 0x7f82ac00fcf0, requested num -1 [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005680/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:45:29.588 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:29.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ff50) [ CSSD]2013-05-23 16:45:29.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ff50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:45:29.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:29.595 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:45:29.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe20 [ CSSD]2013-05-23 16:45:29.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe20) con(0x7f82ac001cb0) skgpid ospid 4701 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:45:30.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:31.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:31.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:31.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:31.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:32.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:33.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:33.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:33.731 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:34.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:34.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0719002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:34.722 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:45:34.722 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:45:34.722 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0018b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:45:34.722 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:34.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(071a002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:34.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:45:34.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:45:34.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071b002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:35.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:35.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:36.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:36.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:36.495 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:37.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:37.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:38.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:39.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:39.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:40.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:40.498 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:40.498 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:45:41.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:41.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:42.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:43.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:43.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:43.756 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:44.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:44.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071c002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:44.826 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe70) allocated [ CSSD]2013-05-23 16:45:44.827 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:45:44.827 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe70 - 1,2,3 [ CSSD]2013-05-23 16:45:44.827 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017e0) proc(0x7f82ac00fe70) pid(4847) version 11:1:1:4 [ CSSD]2013-05-23 16:45:44.843 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac00fe70), client(1/0x7f82ac0054e0) [ CSSD]2013-05-23 16:45:44.843 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac0054e0) [ CSSD]2013-05-23 16:45:44.844 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac0054e0 with con 0x7f82ac001fd0, requested num -1 [ CSSD]2013-05-23 16:45:44.844 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:44.844 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005650/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:45:44.844 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:45:44.844 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:44.850 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac0054e0) [ CSSD]2013-05-23 16:45:44.850 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac0054e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:45:44.850 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005950) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:45:44.850 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005950) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:45:45.053 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe70 [ CSSD]2013-05-23 16:45:45.053 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe70) con(0x7f82ac0017e0) skgpid ospid 4847 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:45:45.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:45.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:45.501 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:45.501 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:46.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:47.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:47.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:48.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:49.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:49.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:49.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(071d002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:49.975 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:45:49.975 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:45:49.975 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:45:49.975 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:45:49.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(071e002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:49.982 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:45:49.982 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:45:50.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:50.504 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:50.505 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:51.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:51.486 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:52.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:53.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:53.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:53.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:45:54.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:54.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(071f002c) incarnation(174631051) [ CSSD]2013-05-23 16:45:55.508 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:55.508 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:45:55.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:55.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:56.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:57.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:57.528 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:45:58.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:45:59.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:45:59.510 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:45:59.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:45:59.581 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:00.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 16:46:00.086 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:46:00.087 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 16:46:00.087 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017e0) proc(0x7f82ac004f70) pid(5001) version 11:1:1:4 [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac004f70), client(1/0x7f82ac00ff20) [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac00ff20) [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac00ff20 with con 0x7f82ac00fda0, requested num -1 [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005620/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:46:00.092 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:00.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac00ff20) [ CSSD]2013-05-23 16:46:00.099 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac00ff20), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:46:00.099 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005920) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:00.099 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005920) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:46:00.301 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 16:46:00.301 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac0017e0) skgpid ospid 5001 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:00.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:01.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:01.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:02.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:03.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:03.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:03.790 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:04.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:04.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:04.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:04.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0720002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:05.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0721002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:05.225 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:05.225 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:05.225 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0018b0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:46:05.225 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:05.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0722002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:05.232 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:05.232 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:05.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:05.644 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:06.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:07.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:07.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:08.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:09.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:09.517 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:09.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:09.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:10.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:11.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:11.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:12.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:13.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:13.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:13.810 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:14.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:14.520 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:14.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:14.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0723002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:15.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac00fe70) allocated [ CSSD]2013-05-23 16:46:15.334 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:46:15.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac00fe70 - 1,2,3 [ CSSD]2013-05-23 16:46:15.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017e0) proc(0x7f82ac00fe70) pid(5430) version 11:1:1:4 [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac00fe70), client(1/0x7f82ac001fd0) [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82ac001fd0) [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82ac001fd0 with con 0x7f82ac00fda0, requested num -1 [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82ac005680/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:46:15.341 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:15.348 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82ac001fd0) [ CSSD]2013-05-23 16:46:15.348 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82ac001fd0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:46:15.348 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82ac005980) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:15.348 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82ac005980) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:46:15.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac00fe70 [ CSSD]2013-05-23 16:46:15.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac00fe70) con(0x7f82ac0017e0) skgpid ospid 5430 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:15.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:15.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:15.910 [1199044928] >TRACE: clssgmAllocProc: (0x7f82ac004f70) allocated [ CSSD]2013-05-23 16:46:15.911 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:46:15.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82ac004f70 - 1,2,3 [ CSSD]2013-05-23 16:46:15.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82ac0017e0) proc(0x7f82ac004f70) pid(5482/5482) version 11:1:1:4 [ CSSD]2013-05-23 16:46:15.927 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82ac004f70), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 16:46:15.927 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:46:15.927 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:46:15.927 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac004f70 [ CSSD]2013-05-23 16:46:15.945 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac004f70) con(0x7f82ac0017e0) skgpid 5482 ospid 5482 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:16.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:17.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:17.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:18.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:18.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0724002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:18.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:18.825 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:18.825 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:46:18.825 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:18.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0725002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:18.832 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:18.832 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:18.964 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:46:18.964 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:46:18.965 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:46:18.966 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:46:19.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:19.524 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:19.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:19.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:20.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0726002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:20.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:20.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:20.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:46:20.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:20.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0727002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:20.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:20.481 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:20.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:21.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:21.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:22.043 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:46:22.044 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:46:22.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:46:22.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(5521) version 11:1:1:4 [ CSSD]2013-05-23 16:46:22.050 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:46:22.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:46:22.050 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 16:46:22.050 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:22.050 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:46:22.051 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:46:22.051 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:22.057 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:46:22.057 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:46:22.057 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:22.057 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:46:22.259 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:46:22.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 5521 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:22.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:23.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:23.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:23.830 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:24.142 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x268b340) [ CSSD]2013-05-23 16:46:24.142 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x268b340), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:46:24.142 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x268b340), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:46:24.142 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 16:46:24.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ed180) [ CSSD]2013-05-23 16:46:24.146 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ed180), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:46:24.146 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ed180), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:46:24.146 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ec7d0) [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ec7d0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ec7d0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmDeadProc: proc 0x26aad20 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26aad20) con(0x269b5d0) skgpid 32305 ospid 32305 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26ecdc0) [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26ecdc0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26ecdc0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:46:24.149 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:46:24.150 [1199044928] >TRACE: clssgmDeadProc: proc 0x26e1460 [ CSSD]2013-05-23 16:46:24.150 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x26e1460) con(0x266f0d0) skgpid 32303 ospid 32303 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:24.526 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:24.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:24.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:24.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0728002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:25.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:25.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:25.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0729002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:25.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:25.922 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:25.922 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:46:25.922 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:25.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072a002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:25.930 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:25.930 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:26.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:27.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:27.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:28.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:29.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:29.530 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:29.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:29.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:30.590 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:46:30.591 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:46:30.591 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:46:30.591 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(5590) version 11:1:1:4 [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:46:30.598 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:30.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:46:30.605 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:46:30.605 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:30.605 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:46:30.808 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:46:30.808 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 5590 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:30.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:31.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:31.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:32.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:33.851 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:33.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:33.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:34.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:34.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:34.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072b002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:34.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:35.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072c002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:35.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:35.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:35.723 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:46:35.723 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:35.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(072d002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:35.730 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:35.730 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:35.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:35.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:36.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:37.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:37.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:38.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:39.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:39.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:39.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:39.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:41.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:41.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:41.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:43.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:43.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:43.539 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:46:43.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:44.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:44.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:44.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(072e002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:45.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:45.840 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:46:45.841 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:46:45.842 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:46:45.842 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(5743) version 11:1:1:4 [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:46:45.848 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:45.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:46:45.854 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:46:45.854 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:46:45.855 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:46:46.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:46.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:46.057 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:46:46.057 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 5743 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:46:47.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:48.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:48.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:48.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:48.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:49.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:50.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:50.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:50.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(072f002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:50.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:46:50.993 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:46:50.993 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:46:50.993 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:46:51.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0730002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:51.002 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:46:51.002 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:46:51.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:52.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:52.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:53.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:53.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:53.545 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:53.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:46:54.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:54.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:54.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0731002c) incarnation(174631051) [ CSSD]2013-05-23 16:46:55.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:56.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:56.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:57.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:46:58.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:46:58.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:46:58.548 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:46:58.548 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:46:59.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:00.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:00.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:01.090 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:01.091 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:47:01.091 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:01.091 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(5910) version 11:1:1:4 [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:01.097 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:01.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:47:01.102 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:01.102 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:01.102 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:01.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:01.304 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:01.304 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 5910 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:02.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:02.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:02.687 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:47:02.687 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:02.688 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:47:02.688 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(5978/5978) version 11:1:1:4 [ CSSD]2013-05-23 16:47:02.694 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 16:47:02.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:47:02.694 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:47:02.694 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:47:03.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:03.551 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:03.551 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:03.921 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:04.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:04.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:05.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0732002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:05.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:06.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:06.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:06.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0733002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:06.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:06.254 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:06.254 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:47:06.254 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:06.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0734002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:06.261 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:06.261 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:07.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:08.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:08.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:08.555 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:08.555 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:09.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:10.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:10.196 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:11.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:11.702 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:11.703 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:11.703 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:11.703 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4207a80) pid(6085) version 11:1:1:4 [ CSSD]2013-05-23 16:47:12.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:12.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:12.897 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42be580) allocated [ CSSD]2013-05-23 16:47:12.898 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:12.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42be580 - 1,2,3 [ CSSD]2013-05-23 16:47:12.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42be580) pid(6267) version 11:1:1:4 [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42be580), client(1/0x7f82b4204870) [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:12.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:12.912 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:47:12.912 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:12.912 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:12.912 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:13.115 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42be580 [ CSSD]2013-05-23 16:47:13.115 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42be580) con(0x7f82b42c6340) skgpid ospid 6267 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:13.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:13.558 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:13.558 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:13.951 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:14.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:14.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:14.354 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:14.354 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b41fa050) skgpid ospid 6085 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:15.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0735002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:15.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:16.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:16.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:16.336 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:16.337 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:47:16.337 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:16.338 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(6452) version 11:1:1:4 [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:16.344 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:16.350 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 16:47:16.350 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:16.350 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:16.350 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:16.553 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:16.553 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 6452 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:17.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:17.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:47:17.497 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:47:17.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:47:17.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:47:17.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0736002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:17.569 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:17.569 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:17.569 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac0017e0/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:47:17.569 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:47:17.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0737002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:17.577 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:17.577 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:18.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:18.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:18.561 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:18.561 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:19.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:20.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:20.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:21.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:21.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0738002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:21.518 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:21.518 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:21.518 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:47:21.518 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:21.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0739002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:21.526 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:21.526 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:22.297 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:22.298 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:22.299 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:22.299 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(6535) version 11:1:1:4 [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4285e90, requested num -1 [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:22.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:22.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:47:22.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:22.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:22.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:22.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:22.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:22.515 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:22.515 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 6535 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:22.564 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:22.564 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:47:23.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:23.972 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:24.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:24.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:25.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073a002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:25.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:26.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(073b002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:26.189 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:26.189 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:26.189 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:47:26.189 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:26.196 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073c002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:26.196 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:26.196 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:26.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:26.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:27.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:27.567 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:27.567 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:28.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:28.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:29.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:30.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:30.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:31.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:31.586 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:31.587 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:47:31.587 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:31.587 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285d70) proc(0x7f82b4207a80) pid(6641) version 11:1:1:4 [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4285e90, requested num -1 [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:31.593 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:31.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:47:31.600 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:31.600 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:31.600 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:31.802 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:31.802 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4285d70) skgpid ospid 6641 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:32.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:32.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:32.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:32.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:33.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:47:33.665 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid 5978 ospid 5978 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:33.992 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:34.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:34.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:35.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(073d002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:35.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:36.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:36.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:36.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(073e002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:36.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:36.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:36.769 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:47:36.769 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:36.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(073f002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:36.776 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:36.776 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:37.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:37.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:37.574 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:38.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:38.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:39.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:40.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:40.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:41.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:41.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:41.577 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:47:42.425 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:42.425 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:42.426 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:42.426 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(6758) version 11:1:1:4 [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:42.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:42.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:47:42.438 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:42.438 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:42.438 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:42.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:42.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:42.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:47:42.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 6758 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:43.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:44.012 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:44.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:44.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:45.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0740002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:45.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:46.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:46.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:46.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:46.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:46.842 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:47:46.843 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:47:46.843 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:47:46.843 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5440) pid(6800) version 11:1:1:4 [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:47:46.849 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:46.856 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:47:46.856 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:47:46.856 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:47:46.856 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:47:47.058 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:47:47.059 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c6340) skgpid ospid 6800 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:47.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:48.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:48.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:49.575 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:49.591 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x26816e0) [ CSSD]2013-05-23 16:47:49.591 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x26816e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:47:49.591 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x26816e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:47:49.591 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:47:49.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x2681150 [ CSSD]2013-05-23 16:47:49.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x2681150) con(0x26ed7c0) skgpid 926 ospid 926 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:47:49.982 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:47:49.982 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:47:49.983 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:47:49.983 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(6870/6870) version 11:1:1:4 [ CSSD]2013-05-23 16:47:49.988 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 16:47:49.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:47:49.989 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:47:49.989 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:47:50.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:50.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:51.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:51.582 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:51.582 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:52.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0741002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:52.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:47:52.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:47:52.019 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:47:52.019 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:47:52.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0742002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:52.027 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:47:52.027 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:47:52.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:52.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:53.585 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:54.032 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:47:54.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:54.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:55.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0743002c) incarnation(174631051) [ CSSD]2013-05-23 16:47:55.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:56.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:47:56.586 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:47:56.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:56.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:57.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:47:58.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:47:58.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:47:59.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:00.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:00.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:01.589 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:01.589 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:01.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:02.091 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:48:02.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:48:02.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:48:02.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5ce0) proc(0x7f82b42a5440) pid(6971) version 11:1:1:4 [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:02.098 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:02.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:48:02.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:48:02.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:02.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:02.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:48:02.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b5ce0) skgpid ospid 6971 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:02.750 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:48:02.751 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:02.751 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:48:02.751 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42a5440) pid(7018/7018) version 11:1:1:4 [ CSSD]2013-05-23 16:48:02.758 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 16:48:02.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:48:02.758 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:48:02.758 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:48:02.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:02.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:03.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:04.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:04.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:04.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:05.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0744002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:05.591 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:05.592 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:48:05.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:06.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:06.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:07.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0745002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:07.269 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:48:07.269 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:48:07.269 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:48:07.269 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:07.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0746002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:07.276 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:48:07.276 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:48:07.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:08.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:08.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:09.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:10.594 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:10.595 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:10.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:10.928 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:11.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:12.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:12.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:13.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:14.074 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:14.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:14.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:15.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0747002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:15.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:15.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:15.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:16.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:16.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:17.350 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 16:48:17.351 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:48:17.351 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 16:48:17.351 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42a3ea0) pid(7114) version 11:1:1:4 [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ea0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:17.357 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:17.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:48:17.364 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:48:17.364 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:17.364 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:17.567 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 16:48:17.567 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4257820) skgpid ospid 7114 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:17.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:19.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:19.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:19.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:20.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:20.601 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:21.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:21.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:21.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:22.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0748002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:22.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:48:22.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:48:22.519 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:48:22.519 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:22.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0749002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:22.527 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:48:22.527 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:48:22.559 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 16:48:22.560 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:22.561 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 16:48:22.561 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42833d0) pid(7212) version 11:1:1:4 [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:22.566 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:22.573 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:48:22.573 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:48:22.573 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:22.573 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:22.775 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 16:48:22.775 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b427d8a0) skgpid ospid 7212 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:23.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:23.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:23.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:24.093 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:24.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:24.603 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:48:25.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:25.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:25.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074a002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:25.938 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:26.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(074b002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:26.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:48:26.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:48:26.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:48:26.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:26.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(074c002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:26.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:48:26.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:48:27.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:27.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:27.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:29.079 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 16:48:29.080 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:29.081 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 16:48:29.081 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(7275/7275) version 11:1:1:4 [ CSSD]2013-05-23 16:48:29.086 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:48:29.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:48:29.086 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:48:29.086 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 16:48:29.129 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid 7275 ospid 7275 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:29.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:29.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:29.298 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 16:48:29.299 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:29.300 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 16:48:29.300 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42833d0) pid(7278/7278) version 11:1:1:4 [ CSSD]2013-05-23 16:48:29.305 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:48:29.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:48:29.305 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:48:29.305 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 16:48:29.352 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b427d8a0) skgpid 7278 ospid 7278 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:29.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:29.606 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:29.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:31.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:31.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:31.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:32.598 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 16:48:32.599 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:48:32.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 16:48:32.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(7301) version 11:1:1:4 [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:32.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:32.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:48:32.611 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:48:32.611 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:32.612 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:32.814 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 16:48:32.814 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid ospid 7301 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:33.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:33.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:33.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:34.113 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:34.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:34.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:35.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(074d002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:35.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:35.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:35.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:37.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:37.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:37.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(074e002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:37.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:48:37.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:48:37.771 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:48:37.771 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:37.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(074f002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:37.778 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:48:37.778 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:48:37.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:39.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:39.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:39.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:39.613 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:40.037 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 16:48:40.037 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:40.038 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 16:48:40.038 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42583a0) pid(7396) version 11:1:1:4 [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42583a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4204870 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:40.045 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:40.047 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:40.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:48:40.051 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:48:40.051 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:48:40.051 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:40.158 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 16:48:40.158 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:40.159 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 16:48:40.159 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ba8a0) pid(7401) version 11:1:1:4 [ CSSD]2013-05-23 16:48:40.174 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:48:40.176 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:48:40.178 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:48:40.179 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 16:48:40.179 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42cbf30) skgpid ospid 7401 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:40.253 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 16:48:40.253 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4257820) skgpid ospid 7396 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:41.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:41.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:41.505 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 16:48:41.506 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:41.506 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 16:48:41.506 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42c5f40) pid(7430) version 11:1:1:4 [ CSSD]2013-05-23 16:48:42.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:42.175 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 16:48:42.175 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257820) skgpid ospid 7430 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:43.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:43.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:44.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:44.143 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:44.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:44.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:45.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0750002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:45.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:45.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:46.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:47.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:47.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:47.846 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 16:48:47.847 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:48:47.847 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 16:48:47.847 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(7640) version 11:1:1:4 [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:48:47.854 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:47.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:48:47.861 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:48:47.861 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d2180) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:48:47.861 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d2180) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:48:48.063 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 16:48:48.063 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid ospid 7640 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:48:48.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:49.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:49.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:49.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:49.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:50.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:51.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:51.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:52.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:53.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0751002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:53.031 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:48:53.031 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:48:53.031 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:48:53.031 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:48:53.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0752002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:53.037 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:48:53.037 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:48:53.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:53.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:54.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:54.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:48:54.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:54.624 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:48:55.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0753002c) incarnation(174631051) [ CSSD]2013-05-23 16:48:55.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:55.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:56.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:57.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:57.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:58.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:48:58.601 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 16:48:58.602 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:48:58.602 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 16:48:58.602 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a3ea0) pid(7740/7740) version 11:1:1:4 [ CSSD]2013-05-23 16:48:58.608 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ea0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 16:48:58.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 16:48:58.608 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:48:58.608 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:48:59.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:48:59.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:48:59.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:48:59.627 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:00.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:01.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:01.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:02.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:03.107 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 16:49:03.108 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:49:03.108 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 16:49:03.108 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8a0) pid(7801) version 11:1:1:4 [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42ba8a0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:03.115 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:03.122 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:03.122 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:49:03.122 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:03.122 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:03.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 16:49:03.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b427d8a0) skgpid ospid 7801 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:03.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:03.503 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:03.629 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:03.630 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:49:04.184 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:04.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:05.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0754002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:05.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:05.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:06.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:07.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:07.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:08.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:08.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0755002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:08.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:49:08.281 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:49:08.281 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:49:08.281 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:08.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0756002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:08.287 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:49:08.287 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:49:08.633 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:08.634 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:09.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:09.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:10.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:11.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:11.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:12.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:13.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:13.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:13.637 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:13.637 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:14.204 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:14.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:15.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0757002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:15.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:15.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:16.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:17.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:17.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:18.359 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 16:49:18.360 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:49:18.360 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 16:49:18.360 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(7976) version 11:1:1:4 [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42ba8a0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:18.366 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:18.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:49:18.373 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:49:18.373 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:18.373 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:18.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:18.576 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 16:49:18.576 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid ospid 7976 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:18.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:18.641 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:19.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:19.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:20.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:21.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:21.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:22.395 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:22.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:22.643 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:49:22.820 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 16:49:22.821 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:49:22.822 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 16:49:22.822 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(8044) version 11:1:1:4 [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42ba8a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:22.839 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:22.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:49:22.846 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:49:22.846 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:22.846 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:23.049 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 16:49:23.049 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid ospid 8044 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:23.241 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 16:49:23.242 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:49:23.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 16:49:23.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42ba8a0) pid(7738/7738) version 11:1:1:4 [ CSSD]2013-05-23 16:49:23.248 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42ba8a0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 16:49:23.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 16:49:23.248 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:49:23.248 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:49:23.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0758002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:23.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:49:23.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:49:23.530 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:49:23.530 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:23.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0759002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:23.538 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:49:23.538 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:49:23.573 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8770) allocated [ CSSD]2013-05-23 16:49:23.574 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:49:23.574 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8770 - 1,2,3 [ CSSD]2013-05-23 16:49:23.574 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a8770) pid(7736/7736) version 11:1:1:4 [ CSSD]2013-05-23 16:49:23.589 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42a8770), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:49:23.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:49:23.589 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:49:23.589 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 16:49:23.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:23.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:24.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:24.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:25.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075a002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:25.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:25.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:26.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:26.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(075b002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:26.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:49:26.699 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:49:26.699 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:49:26.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:26.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(075c002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:26.707 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:49:26.707 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:49:26.815 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42827e0) allocated [ CSSD]2013-05-23 16:49:26.815 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:49:26.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42827e0 - 1,2,3 [ CSSD]2013-05-23 16:49:26.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8290) proc(0x7f82b42827e0) pid(8083) version 11:1:1:4 [ CSSD]2013-05-23 16:49:26.942 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3900) allocated [ CSSD]2013-05-23 16:49:26.944 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:49:26.944 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3900 - 1,2,3 [ CSSD]2013-05-23 16:49:26.944 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4ec0) proc(0x7f82b42d3900) pid(8093) version 11:1:1:4 [ CSSD]2013-05-23 16:49:26.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:49:26.961 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:49:26.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3900 [ CSSD]2013-05-23 16:49:26.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3900) con(0x7f82b42d4ec0) skgpid ospid 8093 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5350/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5350 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b4282700, requested num -1 [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b41fe430/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:27.036 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:49:27.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5350 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:49:27.042 [1199044928] >TRACE: clssgmExitGrock: client 5350 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:49:27.042 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4282580) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:49:27.042 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b4282580) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:27.043 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42827e0 [ CSSD]2013-05-23 16:49:27.043 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42827e0) con(0x7f82b42c8290) skgpid ospid 8083 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:27.646 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:27.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:27.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:27.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:28.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:29.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:29.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:30.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:31.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:31.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:32.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:32.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:32.650 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:33.606 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42827e0) allocated [ CSSD]2013-05-23 16:49:33.607 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:49:33.607 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42827e0 - 1,2,3 [ CSSD]2013-05-23 16:49:33.607 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7f60) proc(0x7f82b42827e0) pid(8147) version 11:1:1:4 [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42827e0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4282700, requested num -1 [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4f80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:33.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:33.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:49:33.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:49:33.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe430) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:33.630 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:33.833 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42827e0 [ CSSD]2013-05-23 16:49:33.833 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42827e0) con(0x7f82b42c7f60) skgpid ospid 8147 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:33.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:33.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:34.244 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:34.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:35.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(075d002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:35.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:35.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:36.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:37.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:37.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:37.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:37.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:38.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:38.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(075e002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:38.789 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:49:38.789 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:49:38.789 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:49:38.789 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:38.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(075f002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:38.797 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:49:38.797 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:49:39.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:39.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:40.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:41.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:41.655 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:49:41.944 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:41.944 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:42.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:43.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:43.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:44.265 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:44.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:45.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0760002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:45.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:45.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:46.658 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:46.658 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:46.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:47.480 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42a8770), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 16:49:47.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 16:49:47.480 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 16:49:47.480 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 16:49:48.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:48.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:48.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:48.869 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8df0) allocated [ CSSD]2013-05-23 16:49:48.870 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:49:48.870 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8df0 - 1,2,3 [ CSSD]2013-05-23 16:49:48.870 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8590) proc(0x7f82b42d8df0) pid(8291) version 11:1:1:4 [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42d8df0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:49:48.876 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:48.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:49:48.884 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:49:48.884 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4282860) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:49:48.884 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4282860) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:49:49.086 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8df0 [ CSSD]2013-05-23 16:49:49.086 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8df0) con(0x7f82b42d8590) skgpid ospid 8291 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:49:50.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:50.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:50.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:51.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:51.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:52.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:52.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:52.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:54.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:54.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:54.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0761002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:54.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:49:54.040 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:49:54.040 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:49:54.040 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:49:54.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0762002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:54.048 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:49:54.048 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:49:54.295 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:49:54.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:55.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0763002c) incarnation(174631051) [ CSSD]2013-05-23 16:49:56.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:56.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:56.664 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:49:56.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:49:56.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:49:58.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:49:58.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:49:58.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:00.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:00.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:00.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:01.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:01.668 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:02.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:02.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:02.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:04.123 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282530) allocated [ CSSD]2013-05-23 16:50:04.124 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:50:04.124 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282530 - 1,2,3 [ CSSD]2013-05-23 16:50:04.124 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8660) proc(0x7f82b4282530) pid(8637) version 11:1:1:4 [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b4282530), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:50:04.130 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:04.137 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:50:04.137 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:50:04.137 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:04.137 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:50:04.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:04.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:04.315 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:04.340 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282530 [ CSSD]2013-05-23 16:50:04.340 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282530) con(0x7f82b42d8660) skgpid ospid 8637 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:04.411 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:50:04.412 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:50:04.412 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:50:04.412 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b42822d0) pid(8690/8690) version 11:1:1:4 [ CSSD]2013-05-23 16:50:04.428 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42822d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:04.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:04.428 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:50:04.429 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 42 [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 41 [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:50:04.703 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42c8340) skgpid 8690 ospid 8690 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:04.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:05.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0764002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:06.223 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:06.223 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:06.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:06.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:06.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:08.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:08.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:08.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:09.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0765002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:09.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:09.291 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:09.291 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac0017e0/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:09.291 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:09.299 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0766002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:09.299 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:09.299 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac001510) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:10.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:10.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:10.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:11.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:11.674 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:12.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:12.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:12.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:14.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:14.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:14.338 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:14.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:15.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0767002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:16.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:16.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:16.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:16.678 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:16.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:18.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:18.315 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:18.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:19.385 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e50) allocated [ CSSD]2013-05-23 16:50:19.386 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:50:19.386 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e50 - 1,2,3 [ CSSD]2013-05-23 16:50:19.386 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8590) proc(0x7f82b42d8e50) pid(8804) version 11:1:1:4 [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42d8e50), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:50:19.393 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:19.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:50:19.400 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:50:19.400 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:19.401 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:50:19.603 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e50 [ CSSD]2013-05-23 16:50:19.603 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e50) con(0x7f82b42d8590) skgpid ospid 8804 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:19.640 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac013490) [ CSSD]2013-05-23 16:50:19.640 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac013490), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:50:19.640 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac013490), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:50:19.640 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 16:50:19.640 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac0039b0 [ CSSD]2013-05-23 16:50:19.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac0039b0) con(0x7f82ac006a20) skgpid 2829 ospid 2829 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:19.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82ac007bf0) [ CSSD]2013-05-23 16:50:19.643 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82ac007bf0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:50:19.643 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82ac007bf0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:50:19.643 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 16:50:19.645 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac019c60) [ CSSD]2013-05-23 16:50:19.645 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac019c60), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:50:19.645 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac019c60), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:50:19.645 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:50:19.645 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac005fe0 [ CSSD]2013-05-23 16:50:19.646 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac005fe0) con(0x7f82ac007060) skgpid 2831 ospid 2831 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:20.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:20.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:21.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:21.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:21.681 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:22.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:22.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:23.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:23.097 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8df0) allocated [ CSSD]2013-05-23 16:50:23.098 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:50:23.098 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8df0 - 1,2,3 [ CSSD]2013-05-23 16:50:23.099 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8590) proc(0x7f82b42d8df0) pid(8916) version 11:1:1:4 [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d8df0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42d8f20, requested num -1 [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:50:23.116 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:23.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:50:23.123 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:50:23.123 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:23.124 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:50:23.326 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8df0 [ CSSD]2013-05-23 16:50:23.326 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8df0) con(0x7f82b42d8590) skgpid ospid 8916 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:24.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:24.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:24.366 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:24.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0768002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:24.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:24.543 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:24.543 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:24.543 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:24.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0769002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:24.552 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:24.552 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:25.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:25.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076a002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:26.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:26.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:26.684 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:26.684 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:26.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(076b002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:26.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:26.965 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:26.965 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:26.965 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:26.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(076c002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:26.972 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:26.972 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:27.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:28.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:28.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:29.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:30.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:30.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:31.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:31.687 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:31.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:32.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:32.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:33.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:34.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:34.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:34.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:34.641 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:50:34.642 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:50:34.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:50:34.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d84b0) proc(0x7f82b42822d0) pid(9030) version 11:1:1:4 [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42822d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d8eb0, requested num -1 [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:50:34.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:34.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:50:34.656 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:50:34.656 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:34.656 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:50:34.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:50:34.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42d84b0) skgpid ospid 9030 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:35.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:35.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(076d002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:36.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:36.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:36.691 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:36.691 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:37.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:38.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:38.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:39.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:39.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(076e002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:39.794 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:39.794 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:39.794 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:39.794 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:39.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(076f002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:39.802 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:39.802 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:40.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:40.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:40.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:40.694 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:50:41.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:42.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:42.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:43.227 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:44.426 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:44.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:44.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:45.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:45.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0770002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:45.697 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:45.697 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:46.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:46.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:47.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:48.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:48.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:49.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:49.896 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282520) allocated [ CSSD]2013-05-23 16:50:49.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:50:49.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282520 - 1,2,3 [ CSSD]2013-05-23 16:50:49.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8660) proc(0x7f82b4282520) pid(9169) version 11:1:1:4 [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4282520), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:50:49.904 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:49.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:50:49.911 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:50:49.911 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4f50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:50:49.912 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4f50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:50:50.114 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282520 [ CSSD]2013-05-23 16:50:50.114 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282520) con(0x7f82b42d8660) skgpid ospid 9169 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:50:50.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:50.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:50.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:50.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:51.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:52.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:52.595 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:53.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:54.448 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:50:54.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:54.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:55.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0771002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:55.043 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:55.043 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:55.043 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:55.043 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:55.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0772002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:55.050 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:55.050 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:55.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:55.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0773002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:55.704 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:50:55.704 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:50:56.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:56.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:57.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:50:57.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0774002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:57.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:50:57.673 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:50:57.673 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:50:57.673 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:50:57.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0775002c) incarnation(174631051) [ CSSD]2013-05-23 16:50:57.680 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:50:57.680 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:50:58.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:50:58.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:50:59.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:00.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:00.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:00.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:00.707 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:01.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:02.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:02.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:03.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:04.467 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:04.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:04.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:05.151 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:51:05.152 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:51:05.152 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:51:05.152 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b42822d0) pid(9334) version 11:1:1:4 [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42822d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d8eb0, requested num -1 [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:51:05.159 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:05.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:51:05.166 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:51:05.166 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:05.167 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:51:05.369 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:51:05.369 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42c8340) skgpid ospid 9334 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:05.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:05.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0776002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:05.710 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:05.710 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:06.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:06.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:07.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:08.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:08.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:09.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:10.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0777002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:10.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:10.302 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:10.302 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:51:10.302 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:10.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0778002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:10.310 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:10.310 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:10.713 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:10.713 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:10.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:10.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:11.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:12.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:12.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:13.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:14.498 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:14.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:14.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:15.387 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:51:15.388 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:51:15.388 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:51:15.388 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b42822d0) pid(9439/9439) version 11:1:1:4 [ CSSD]2013-05-23 16:51:15.404 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42822d0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:51:15.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:51:15.404 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:51:15.404 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:51:15.432 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42c8340) skgpid 9439 ospid 9439 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:15.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:15.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:15.716 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:15.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0779002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:16.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:16.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:17.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:18.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:18.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:19.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077a002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:19.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:19.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:19.123 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:51:19.123 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:19.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077b002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:19.130 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:19.130 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:19.258 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:51:19.258 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:51:19.260 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:51:19.260 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:51:19.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:20.406 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282520) allocated [ CSSD]2013-05-23 16:51:20.407 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:51:20.407 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282520 - 1,2,3 [ CSSD]2013-05-23 16:51:20.407 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8660) proc(0x7f82b4282520) pid(9498) version 11:1:1:4 [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4282520), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:51:20.414 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:20.421 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:51:20.421 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:51:20.421 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4f50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:20.421 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4f50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:51:20.623 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282520 [ CSSD]2013-05-23 16:51:20.623 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282520) con(0x7f82b42d8660) skgpid ospid 9498 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:20.720 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:20.720 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:20.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:20.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:21.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:22.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:22.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:23.367 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:51:23.368 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:51:23.368 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:51:23.368 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8290) proc(0x7f82b42822d0) pid(9560) version 11:1:1:4 [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42822d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d8eb0, requested num -1 [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:51:23.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:23.383 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:51:23.383 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:51:23.383 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:23.383 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:51:23.586 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:51:23.586 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42c8290) skgpid ospid 9560 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:23.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:24.528 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:24.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:24.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:25.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077c002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:25.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:25.563 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:25.563 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:51:25.563 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:25.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(077d002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:25.571 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:25.571 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:25.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:25.723 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:25.724 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:25.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(077e002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:26.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:26.857 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:27.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(077f002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:27.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:27.244 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:27.244 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:51:27.245 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:27.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0780002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:27.253 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:27.253 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:27.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:28.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:28.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:29.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:30.727 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:30.727 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:30.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:30.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:31.677 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:32.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:32.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:33.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:34.548 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:34.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:34.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:35.661 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42822d0) allocated [ CSSD]2013-05-23 16:51:35.661 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:51:35.662 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42822d0 - 1,2,3 [ CSSD]2013-05-23 16:51:35.662 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d84b0) proc(0x7f82b42822d0) pid(9672) version 11:1:1:4 [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42822d0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d8eb0, requested num -1 [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4ad0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:51:35.668 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:35.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:51:35.675 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:51:35.675 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4dd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:35.675 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4dd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:51:35.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:35.731 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:35.731 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:35.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0781002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:35.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42822d0 [ CSSD]2013-05-23 16:51:35.877 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42822d0) con(0x7f82b42d84b0) skgpid ospid 9672 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:36.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:36.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:37.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:38.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:38.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:39.733 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:39.734 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:51:39.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:40.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0782002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:40.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:40.833 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:40.833 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:51:40.833 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:40.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0783002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:40.840 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:40.840 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:40.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:40.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:41.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:43.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:43.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:43.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:44.569 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:44.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:44.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:45.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:45.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:45.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:45.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0784002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:47.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:47.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:47.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:49.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:49.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:49.740 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:49.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:49.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:50.914 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282520) allocated [ CSSD]2013-05-23 16:51:50.915 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:51:50.916 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282520 - 1,2,3 [ CSSD]2013-05-23 16:51:50.916 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8660) proc(0x7f82b4282520) pid(9838) version 11:1:1:4 [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4282520), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4282450, requested num -1 [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4c50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:51:50.922 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:50.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:51:50.930 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:51:50.930 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4f50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:51:50.931 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4f50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:51:51.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:51.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:51.133 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282520 [ CSSD]2013-05-23 16:51:51.133 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282520) con(0x7f82b42d8660) skgpid ospid 9838 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:51:51.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:53.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:53.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:53.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:54.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:51:54.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:54.744 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:51:54.939 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282520) allocated [ CSSD]2013-05-23 16:51:54.940 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:51:54.940 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282520 - 1,2,3 [ CSSD]2013-05-23 16:51:54.940 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8660) proc(0x7f82b4282520) pid(9584/9584) version 11:1:1:4 [ CSSD]2013-05-23 16:51:54.957 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b4282520), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 16:51:54.957 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:51:54.957 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:51:54.957 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 16:51:55.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:55.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:55.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0785002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:55.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:56.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0786002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:56.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:51:56.082 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:51:56.082 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:51:56.082 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:51:56.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0787002c) incarnation(174631051) [ CSSD]2013-05-23 16:51:56.090 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:51:56.090 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:51:57.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:57.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:51:57.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:51:58.746 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:51:58.746 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:51:59.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:51:59.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:00.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:01.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:01.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:02.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:03.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:03.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:03.750 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:03.750 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:04.103 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:04.609 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:05.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:05.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:05.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0788002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:06.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:06.171 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb20) allocated [ CSSD]2013-05-23 16:52:06.172 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:52:06.173 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb20 - 1,2,3 [ CSSD]2013-05-23 16:52:06.173 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f70) proc(0x7f82b41fdb20) pid(10013) version 11:1:1:4 [ CSSD]2013-05-23 16:52:06.179 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b41fdb20), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:06.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:06.179 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:52:06.179 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:06.179 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:52:06.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:52:06.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:06.187 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:06.187 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:52:06.187 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:06.187 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:52:06.390 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb20 [ CSSD]2013-05-23 16:52:06.390 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb20) con(0x7f82b42d4f70) skgpid ospid 10013 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:07.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:07.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:07.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0789002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:07.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:07.723 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:07.723 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:07.723 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:07.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078a002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:07.731 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:07.731 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:08.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:08.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:08.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:09.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:09.240 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:10.193 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:11.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:11.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:11.307 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb20) allocated [ CSSD]2013-05-23 16:52:11.307 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:52:11.308 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb20 - 1,2,3 [ CSSD]2013-05-23 16:52:11.308 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b41fdb20) pid(10151) version 11:1:1:4 [ CSSD]2013-05-23 16:52:11.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078b002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:11.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:11.336 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:11.336 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:11.336 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:11.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078c002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:11.344 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:11.344 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:12.199 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:13.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:13.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:13.757 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:13.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:13.826 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb20 [ CSSD]2013-05-23 16:52:13.826 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb20) con(0x7f82b42c8340) skgpid ospid 10151 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:14.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:14.630 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:15.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:15.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:15.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(078d002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:16.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:17.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:17.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:17.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:17.759 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:52:17.816 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:52:17.817 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:52:17.818 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:52:17.818 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:52:17.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(078e002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:17.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:17.894 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:17.894 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:52:17.894 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:52:17.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(078f002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:17.901 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:17.901 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:18.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:19.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:19.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:20.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:21.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:21.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:21.428 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb20) allocated [ CSSD]2013-05-23 16:52:21.429 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:52:21.430 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb20 - 1,2,3 [ CSSD]2013-05-23 16:52:21.430 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b41fdb20) pid(10544) version 11:1:1:4 [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b41fdb20), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:52:21.437 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:21.445 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:52:21.445 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:52:21.445 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe1d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:21.445 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:52:21.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb20 [ CSSD]2013-05-23 16:52:21.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb20) con(0x7f82b42c8340) skgpid ospid 10544 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:22.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:22.762 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:22.762 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:23.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:23.338 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:23.624 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb20) allocated [ CSSD]2013-05-23 16:52:23.625 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:52:23.625 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb20 - 1,2,3 [ CSSD]2013-05-23 16:52:23.625 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b41fdb20) pid(10597) version 11:1:1:4 [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b41fdb20), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:52:23.632 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:23.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:52:23.639 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:52:23.639 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe1d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:23.639 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:52:23.842 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb20 [ CSSD]2013-05-23 16:52:23.842 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb20) con(0x7f82b42c8340) skgpid ospid 10597 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:24.310 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:24.649 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:25.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:25.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:25.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0790002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:26.316 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:26.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0791002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:26.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:26.593 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:26.593 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:26.593 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:26.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0792002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:26.601 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:26.601 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:27.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:27.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:27.503 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0793002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:27.503 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:27.503 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:27.503 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:27.503 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:27.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0794002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:27.510 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:27.510 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac013490) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:27.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:27.766 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:28.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:29.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:29.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:30.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:31.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:31.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:32.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:32.769 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:32.769 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:33.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:33.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:34.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:34.680 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:35.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:35.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:35.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0795002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:36.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:36.686 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb20) allocated [ CSSD]2013-05-23 16:52:36.687 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:52:36.687 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb20 - 1,2,3 [ CSSD]2013-05-23 16:52:36.687 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8290) proc(0x7f82b41fdb20) pid(10698) version 11:1:1:4 [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b41fdb20), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:52:36.694 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:36.702 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:52:36.702 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:52:36.702 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe1d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:36.702 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe1d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:52:36.772 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:36.772 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:52:36.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb20 [ CSSD]2013-05-23 16:52:36.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb20) con(0x7f82b42c8290) skgpid ospid 10698 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:37.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:37.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:38.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:39.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:39.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:40.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:41.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:41.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:41.776 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:41.776 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:41.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0796002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:41.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:41.843 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:41.843 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:41.843 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:41.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0797002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:41.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:41.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:42.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:43.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:43.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:44.501 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:44.711 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:45.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:45.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:45.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0798002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:46.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:46.779 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:46.779 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:47.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:47.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:48.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:49.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:49.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82ac001670) [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82ac001670), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82ac001670), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82ac014030 [ CSSD]2013-05-23 16:52:49.663 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82ac014030) con(0x7f82ac002600) skgpid 4624 ospid 4624 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:50.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:51.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:51.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:51.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:51.783 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:52:51.935 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:52:51.936 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:52:51.937 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:52:51.937 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c8340) proc(0x7f82b41fdb10) pid(10855) version 11:1:1:4 [ CSSD]2013-05-23 16:52:51.943 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fdb10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:52:51.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:52:51.943 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:52:51.943 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:51.943 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:52:51.944 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:52:51.944 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:51.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:52:51.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:52:51.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe1b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:52:51.952 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe1b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:52:52.154 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:52:52.154 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42c8340) skgpid ospid 10855 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:52:52.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:53.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:53.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:54.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:54.741 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:52:55.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:55.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:55.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:52:55.786 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:52:56.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0799002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:56.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:57.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(079a002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:57.091 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:52:57.091 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:52:57.091 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:52:57.091 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:52:57.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079b002c) incarnation(174631051) [ CSSD]2013-05-23 16:52:57.098 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:52:57.098 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:52:57.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:57.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:52:58.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:52:59.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:52:59.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:00.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:00.789 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:00.789 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:01.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:01.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:02.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:53:02.789 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41fa050) skgpid 7018 ospid 7018 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:03.740 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:03.740 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:04.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:04.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:05.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:05.765 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:05.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:05.793 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:06.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079c002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:06.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:07.189 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:53:07.189 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:53:07.190 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:53:07.190 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a41c0) proc(0x7f82b42a5440) pid(11007) version 11:1:1:4 [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42828a0, requested num -1 [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:07.197 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:07.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:53:07.204 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:53:07.204 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5020) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:07.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5020) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:07.406 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:53:07.406 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a41c0) skgpid ospid 11007 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:07.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:07.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:08.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:09.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:09.783 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:10.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:10.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:10.796 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:11.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:11.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:12.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(079d002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:12.361 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:53:12.361 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:53:12.361 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:53:12.361 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:12.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(079e002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:12.369 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:53:12.369 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:53:12.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:13.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:13.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:14.782 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:14.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:14.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:14.799 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:53:15.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:15.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:16.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(079f002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:16.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:17.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:17.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:18.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:19.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:19.802 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:19.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:19.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:20.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:21.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:21.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:22.444 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:53:22.445 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:53:22.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:53:22.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42a5440) pid(11141) version 11:1:1:4 [ CSSD]2013-05-23 16:53:22.452 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:22.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:22.452 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42828a0, requested num -1 [ CSSD]2013-05-23 16:53:22.452 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:22.452 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4d20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:53:22.453 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:22.453 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:22.460 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:22.460 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:53:22.460 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4282720) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:22.460 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4282720) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:22.662 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:53:22.662 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41fa050) skgpid ospid 11141 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:22.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:23.885 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:53:23.886 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:53:23.887 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:53:23.887 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257760) proc(0x7f82b42a5440) pid(11194) version 11:1:1:4 [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42828a0, requested num -1 [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ae7e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:23.894 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:23.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:53:23.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:53:23.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4282720) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:23.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4282720) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:23.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:23.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:24.104 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 16:53:24.104 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257760) skgpid ospid 11194 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:24.518 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 16:53:24.519 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:53:24.519 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 16:53:24.519 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a5440) pid(10841/10841) version 11:1:1:4 [ CSSD]2013-05-23 16:53:24.537 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 16:53:24.537 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 16:53:24.537 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:53:24.537 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:53:24.802 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:24.805 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:24.805 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:24.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:25.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:25.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:26.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a0002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:26.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:27.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a1002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:27.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:53:27.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:53:27.621 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:53:27.622 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:27.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a2002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:27.629 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:53:27.629 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:53:27.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a3002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:27.761 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:53:27.761 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:53:27.761 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:53:27.762 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:27.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a4002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:27.768 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:53:27.768 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:53:27.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:27.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:28.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:29.809 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:29.809 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:29.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:29.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:30.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:31.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:31.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:32.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:33.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:33.812 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:53:33.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:33.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:34.822 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:34.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:35.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:35.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:36.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a5002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:37.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:37.699 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdbe0) allocated [ CSSD]2013-05-23 16:53:37.700 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:53:37.700 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdbe0 - 1,2,3 [ CSSD]2013-05-23 16:53:37.700 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5040) proc(0x7f82b41fdbe0) pid(11302) version 11:1:1:4 [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fdbe0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b41fa050, requested num -1 [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:37.717 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:37.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:53:37.724 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:53:37.724 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:37.724 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:37.927 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdbe0 [ CSSD]2013-05-23 16:53:37.927 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdbe0) con(0x7f82b42d5040) skgpid ospid 11302 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:37.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:37.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:38.815 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:38.815 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:39.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:39.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:39.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:40.346 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:53:40.347 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:53:40.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:53:40.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f90) proc(0x7f82b41fdb10) pid(11362) version 11:1:1:4 [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fdb10), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427d5c0 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:40.356 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:40.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:53:40.363 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:53:40.363 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd8c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:53:40.363 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b41fd8c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:40.474 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 16:53:40.475 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:53:40.475 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 16:53:40.475 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe2a0) proc(0x7f82b42dc520) pid(11367) version 11:1:1:4 [ CSSD]2013-05-23 16:53:40.502 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:53:40.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:53:40.506 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:53:40.508 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 16:53:40.508 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b41fe2a0) skgpid ospid 11367 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:40.665 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:53:40.665 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42d4f90) skgpid ospid 11362 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:40.988 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:53:40.988 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:53:40.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:53:40.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9460) proc(0x7f82b41fd930) pid(11390) version 11:1:1:4 [ CSSD]2013-05-23 16:53:41.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:41.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:53:41.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42c9460) skgpid ospid 11390 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:42.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:42.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:42.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07a6002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:42.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:53:42.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:53:42.870 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:53:42.870 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:42.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07a7002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:42.877 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:53:42.877 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:53:43.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:43.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:43.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:44.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:44.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:44.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:45.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:46.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:46.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:46.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a8002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:47.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:47.821 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:47.822 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:53:48.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:48.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:49.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:50.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:50.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:51.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:52.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:52.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:52.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:52.825 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:52.963 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:53:52.965 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:53:52.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:53:52.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f90) proc(0x7f82b41fdb10) pid(11641) version 11:1:1:4 [ CSSD]2013-05-23 16:53:52.972 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fdb10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:53:52.972 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:53:52.972 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:53:52.972 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:52.972 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:53:52.973 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:53:52.973 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:52.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:53:52.979 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:53:52.979 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd8c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:53:52.979 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd8c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:53:53.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:53.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:53:53.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42d4f90) skgpid ospid 11641 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:54.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:54.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:54.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x26ecc50) [ CSSD]2013-05-23 16:53:54.284 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x26ecc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:53:54.284 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x26ecc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:53:54.284 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x269aed0) [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x269aed0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x269aed0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmDeadProc: proc 0x269aa90 [ CSSD]2013-05-23 16:53:54.290 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x269aa90) con(0x261ba90) skgpid 32299 ospid 32299 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:53:54.862 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:53:55.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:56.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07a9002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:56.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:56.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:57.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:53:57.828 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:53:57.828 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:53:58.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07aa002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:58.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:53:58.129 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:53:58.129 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:53:58.129 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:53:58.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ab002c) incarnation(174631051) [ CSSD]2013-05-23 16:53:58.137 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:53:58.137 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:53:58.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:53:58.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:53:59.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:00.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:00.255 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:01.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:02.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:02.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:02.831 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:02.831 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:03.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:54:03.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:54:03.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:54:03.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f90) proc(0x7f82b41fdb10) pid(11647/11647) version 11:1:1:4 [ CSSD]2013-05-23 16:54:03.023 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdb10), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 16:54:03.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:54:03.023 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:54:03.023 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:54:03.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:04.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:04.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:04.883 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:05.234 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:06.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ac002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:06.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:06.397 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:07.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:07.834 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:07.835 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:08.224 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf50) allocated [ CSSD]2013-05-23 16:54:08.225 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:54:08.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf50 - 1,2,3 [ CSSD]2013-05-23 16:54:08.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe280) proc(0x7f82b42caf50) pid(11845) version 11:1:1:4 [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42caf50), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42cae80, requested num -1 [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcba0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:08.243 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:08.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:54:08.250 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:54:08.250 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dcea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:08.251 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dcea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:08.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:08.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:08.453 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf50 [ CSSD]2013-05-23 16:54:08.453 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf50) con(0x7f82b41fe280) skgpid ospid 11845 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:09.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:10.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:10.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:11.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:11.837 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:11.837 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:54:12.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:12.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:13.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:13.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ad002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:13.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:54:13.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:54:13.390 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:54:13.390 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:13.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ae002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:13.397 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:54:13.397 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:54:14.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:14.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:14.906 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:15.417 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:16.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07af002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:16.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:16.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:16.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:16.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:17.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:18.552 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:18.552 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:19.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:20.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:20.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:21.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:21.844 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:21.844 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:22.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:22.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:23.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:23.497 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dc520) allocated [ CSSD]2013-05-23 16:54:23.498 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:54:23.498 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dc520 - 1,2,3 [ CSSD]2013-05-23 16:54:23.498 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9690) proc(0x7f82b42dc520) pid(11985) version 11:1:1:4 [ CSSD]2013-05-23 16:54:23.505 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dc520), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:54:23.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:54:23.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42caf30, requested num -1 [ CSSD]2013-05-23 16:54:23.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:23.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:54:23.506 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:23.506 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:23.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:54:23.513 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:54:23.513 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dced0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:23.513 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dced0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:23.716 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dc520 [ CSSD]2013-05-23 16:54:23.716 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dc520) con(0x7f82b42c9690) skgpid ospid 11985 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:24.144 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de610) allocated [ CSSD]2013-05-23 16:54:24.145 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:54:24.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de610 - 1,2,3 [ CSSD]2013-05-23 16:54:24.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fdf60) proc(0x7f82b42de610) pid(12026) version 11:1:1:4 [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42de610), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42de540, requested num -1 [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c98f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:24.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:24.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:54:24.172 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:54:24.172 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9bf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:24.172 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9bf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:24.375 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de610 [ CSSD]2013-05-23 16:54:24.375 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de610) con(0x7f82b41fdf60) skgpid ospid 12026 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:24.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:24.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:24.929 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:25.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:26.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b0002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:26.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:26.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:26.847 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:26.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:27.119 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf50) allocated [ CSSD]2013-05-23 16:54:27.120 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:54:27.120 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf50 - 1,2,3 [ CSSD]2013-05-23 16:54:27.120 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42caf50) pid(12060) version 11:1:1:4 [ CSSD]2013-05-23 16:54:27.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de440) allocated [ CSSD]2013-05-23 16:54:27.248 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:54:27.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de440 - 1,2,3 [ CSSD]2013-05-23 16:54:27.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcac0) proc(0x7f82b42de440) pid(12076) version 11:1:1:4 [ CSSD]2013-05-23 16:54:27.277 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:54:27.279 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:54:27.282 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de440 [ CSSD]2013-05-23 16:54:27.282 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de440) con(0x7f82b42dcac0) skgpid ospid 12076 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:27.442 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5351/0x7f82b4204870) [ CSSD]2013-05-23 16:54:27.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5351 (0x7f82b4204870) [ CSSD]2013-05-23 16:54:27.442 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4204870 with con 0x7f82b42cae80, requested num -1 [ CSSD]2013-05-23 16:54:27.442 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:54:27.442 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42dcb60/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:54:27.443 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:27.443 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:54:27.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5351 (0x7f82b4204870) [ CSSD]2013-05-23 16:54:27.450 [1199044928] >TRACE: clssgmExitGrock: client 5351 (0x7f82b4204870), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:54:27.450 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dce60) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:54:27.450 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42dce60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:27.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf50 [ CSSD]2013-05-23 16:54:27.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf50) con(0x7f82b41fa050) skgpid ospid 12060 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:27.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:28.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b1002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:28.022 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:54:28.022 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:54:28.022 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:54:28.022 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:28.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b2002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:28.031 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:54:28.031 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:54:28.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b3002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:28.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:54:28.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:54:28.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:54:28.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:28.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b4002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:28.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:54:28.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:54:28.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:28.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:29.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:30.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:30.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:30.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:30.850 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:54:31.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:32.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:32.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:54:33.114 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42d4f90) skgpid 11647 ospid 11647 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:33.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:34.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:34.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:34.952 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:35.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:35.854 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:35.854 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:36.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b5002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:36.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:36.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:37.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:38.757 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:54:38.758 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:54:38.759 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:54:38.759 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b41fdb10) pid(12159) version 11:1:1:4 [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdb10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:38.765 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:38.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:54:38.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:54:38.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd8c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:38.773 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd8c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:38.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:38.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:38.975 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:54:38.975 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b41fa050) skgpid ospid 12159 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:39.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:40.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:40.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:40.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:40.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:41.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:42.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:42.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:43.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:43.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07b6002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:43.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:54:43.906 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:54:43.906 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:54:43.906 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:43.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07b7002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:43.914 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:54:43.914 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:54:44.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:44.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:44.975 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:45.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:45.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:45.860 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:46.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b8002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:46.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:46.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:47.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:48.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:48.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:49.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:49.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:49.863 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:54:50.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:50.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:51.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:52.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:52.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:53.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:54.011 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdbe0) allocated [ CSSD]2013-05-23 16:54:54.012 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:54:54.013 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdbe0 - 1,2,3 [ CSSD]2013-05-23 16:54:54.013 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5060) proc(0x7f82b41fdbe0) pid(12309) version 11:1:1:4 [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdbe0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b41fdb10, requested num -1 [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:54:54.019 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:54.027 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:54:54.027 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:54:54.027 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:54:54.027 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:54:54.229 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdbe0 [ CSSD]2013-05-23 16:54:54.229 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdbe0) con(0x7f82b42d5060) skgpid ospid 12309 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:54:54.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:54.867 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:54.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:54.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:54.998 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:54:55.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:56.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07b9002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:56.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:56.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:57.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:54:58.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:54:58.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:54:59.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ba002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:59.168 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:54:59.168 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:54:59.168 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:54:59.168 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:54:59.176 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07bb002c) incarnation(174631051) [ CSSD]2013-05-23 16:54:59.176 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:54:59.177 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:54:59.870 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:54:59.870 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:54:59.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:00.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:00.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:01.922 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:03.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:03.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:03.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:04.873 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:04.874 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:04.918 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdbe0) allocated [ CSSD]2013-05-23 16:55:04.919 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:55:04.919 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdbe0 - 1,2,3 [ CSSD]2013-05-23 16:55:04.919 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5040) proc(0x7f82b41fdbe0) pid(12466/12466) version 11:1:1:4 [ CSSD]2013-05-23 16:55:04.936 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdbe0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 16:55:04.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:55:04.936 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:55:04.936 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:55:05.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:05.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:05.026 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:05.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:55:05.222 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:55:05.222 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:55:05.222 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:55:05.223 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdbe0 [ CSSD]2013-05-23 16:55:05.223 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdbe0) con(0x7f82b42d5040) skgpid 12466 ospid 12466 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:05.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:06.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bc002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:07.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:07.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:07.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:08.876 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:08.877 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:55:09.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:09.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:09.275 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:55:09.276 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:55:09.276 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:55:09.276 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4f90) proc(0x7f82b41fdb10) pid(12494) version 11:1:1:4 [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdb10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:55:09.283 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:09.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:55:09.290 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:55:09.290 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd8c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:09.290 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd8c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:55:09.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:55:09.493 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42d4f90) skgpid ospid 12494 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:09.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:11.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:11.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:12.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:13.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:13.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:13.880 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:13.880 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:14.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:14.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07bd002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:14.428 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:55:14.428 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:55:14.428 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:55:14.428 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:14.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07be002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:14.436 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:55:14.436 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:55:15.046 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:15.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:15.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:16.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:16.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07bf002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:17.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:17.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:18.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:18.883 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:18.884 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:19.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:19.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:55:19.717 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 6870 ospid 6870 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:20.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:21.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:21.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:22.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:23.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:23.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:23.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:23.887 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:24.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:24.419 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:55:24.420 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:55:24.421 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:55:24.421 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4207a80) pid(12656) version 11:1:1:4 [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42828a0, requested num -1 [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:55:24.438 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:24.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:55:24.446 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:55:24.446 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:24.446 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:55:24.531 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3830) allocated [ CSSD]2013-05-23 16:55:24.532 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:55:24.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3830 - 1,2,3 [ CSSD]2013-05-23 16:55:24.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4282720) proc(0x7f82b42d3830) pid(12664) version 11:1:1:4 [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3830), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d3760, requested num -1 [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9380/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:55:24.539 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:24.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:55:24.545 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:55:24.545 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9680) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:24.545 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9680) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:55:24.648 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:55:24.648 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b41fa050) skgpid ospid 12656 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:24.748 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3830 [ CSSD]2013-05-23 16:55:24.748 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3830) con(0x7f82b4282720) skgpid ospid 12664 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:25.069 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:25.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:25.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:26.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:26.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c0002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:27.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:27.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:28.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:28.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c1002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:28.277 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:55:28.277 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:55:28.277 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:55:28.277 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:28.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c2002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:28.284 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:55:28.284 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:55:28.890 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:28.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:29.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:29.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:29.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c3002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:29.678 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:55:29.678 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:55:29.678 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:55:29.678 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:29.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c4002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:29.685 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:55:29.685 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:55:30.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:31.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:31.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:32.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:33.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:33.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:33.894 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:33.894 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:34.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:35.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:35.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:35.388 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:36.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:36.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c5002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:37.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:37.394 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:38.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:38.897 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:38.898 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:39.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:39.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:39.785 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:55:39.786 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:55:39.787 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:55:39.787 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(12813) version 11:1:1:4 [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4d10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:55:39.794 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:39.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:55:39.803 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:55:39.803 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4282720) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:39.803 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4282720) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:55:40.005 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 16:55:40.005 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 12813 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:40.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:41.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:41.412 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:42.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:42.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:42.900 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:55:43.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:43.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:44.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:44.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07c6002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:44.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:55:44.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:55:44.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:55:44.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:44.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07c7002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:44.935 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:55:44.935 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:55:45.123 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:45.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:45.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:46.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:46.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c8002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:47.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:47.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:47.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:47.904 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:48.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:49.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:49.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:50.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:51.103 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 16:55:51.104 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:55:51.104 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 16:55:51.104 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(12630/12630) version 11:1:1:4 [ CSSD]2013-05-23 16:55:51.121 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 16:55:51.121 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 16:55:51.121 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:55:51.121 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:55:51.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:51.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:52.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:52.907 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:52.907 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:53.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:53.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:54.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:55.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdbe0) allocated [ CSSD]2013-05-23 16:55:55.043 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:55:55.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdbe0 - 1,2,3 [ CSSD]2013-05-23 16:55:55.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5060) proc(0x7f82b41fdbe0) pid(12962) version 11:1:1:4 [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdbe0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b41fdb10, requested num -1 [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:55:55.061 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:55:55.068 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:55:55.068 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:55:55.068 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c95b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:55:55.068 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c95b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:55:55.161 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:55:55.271 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdbe0 [ CSSD]2013-05-23 16:55:55.271 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdbe0) con(0x7f82b42d5060) skgpid ospid 12962 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:55:55.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:55.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:56.362 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:56.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07c9002c) incarnation(174631051) [ CSSD]2013-05-23 16:55:57.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:57.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:55:57.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:55:57.911 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:55:58.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:55:59.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:55:59.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:00.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ca002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:00.187 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:00.187 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:00.187 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:56:00.187 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:00.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07cb002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:00.194 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:00.194 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:00.420 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:01.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:01.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:01.914 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:01.914 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:56:02.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:03.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:03.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:04.438 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:05.183 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:05.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:05.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:06.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:06.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cc002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:06.917 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:06.918 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:07.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:07.635 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:08.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:09.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:09.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:10.305 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:56:10.306 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:56:10.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:56:10.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b41fdb10) pid(13125) version 11:1:1:4 [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdb10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b41fda40, requested num -1 [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:56:10.313 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:10.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:56:10.321 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:56:10.321 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd8c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:10.321 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd8c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:56:10.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:10.524 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:56:10.524 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b41fa050) skgpid ospid 13125 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:11.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:11.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:11.921 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:11.921 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:12.527 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:13.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:13.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:14.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:15.204 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:15.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07cd002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:15.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:15.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:15.438 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:56:15.438 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:15.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ce002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:15.445 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:15.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:15.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:15.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:15.892 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fdb10) allocated [ CSSD]2013-05-23 16:56:15.892 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:56:15.893 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fdb10 - 1,2,3 [ CSSD]2013-05-23 16:56:15.893 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b41fdb10) pid(13200/13200) version 11:1:1:4 [ CSSD]2013-05-23 16:56:15.909 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fdb10), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 16:56:15.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:56:15.909 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:56:15.909 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fdb10 [ CSSD]2013-05-23 16:56:15.926 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fdb10) con(0x7f82b42ccc30) skgpid 13200 ospid 13200 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:16.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07cf002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:16.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:16.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:16.924 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:17.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:17.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:18.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:19.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d0002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:19.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:19.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:19.418 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 16:56:19.418 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:19.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d1002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:19.426 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:19.426 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:19.555 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:56:19.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:56:19.557 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:56:19.558 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:56:19.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:19.717 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:20.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:20.927 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:20.927 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:56:21.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:21.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:22.627 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:23.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:23.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:24.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 16:56:24.322 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 16:56:24.322 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 16:56:24.322 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8770 [ CSSD]2013-05-23 16:56:24.324 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8770) con(0x7f82b427d8a0) skgpid 7736 ospid 7736 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 16:56:24.328 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4207cd0) skgpid 7738 ospid 7738 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:24.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:24.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 16:56:24.693 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:56:24.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 16:56:24.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42b3cd0) pid(13277) version 11:1:1:4 [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3cd0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c7f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:56:24.701 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:24.709 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:56:24.709 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:56:24.709 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:24.709 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:56:24.911 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 16:56:24.911 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42d9750) skgpid ospid 13277 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:25.225 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:25.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 16:56:25.566 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:56:25.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 16:56:25.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42b3cd0) pid(13294) version 11:1:1:4 [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3cd0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c7f60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:56:25.583 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:25.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:56:25.590 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:56:25.590 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:25.590 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:56:25.793 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 16:56:25.793 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b4207cd0) skgpid ospid 13294 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:25.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:25.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:25.930 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:25.930 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:26.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d2002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:26.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:27.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:27.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:28.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d3002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:28.540 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:28.540 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:28.540 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:56:28.541 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:28.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d4002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:28.549 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:28.549 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:28.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:29.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:29.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:30.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d5002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:30.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:30.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:30.703 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:56:30.703 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:30.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d6002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:30.710 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:30.710 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:30.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:30.934 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:30.934 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:31.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:31.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:32.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:33.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:33.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:34.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:35.247 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:35.364 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 16:56:35.364 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:56:35.365 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 16:56:35.365 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42b3cd0) pid(13275/13275) version 11:1:1:4 [ CSSD]2013-05-23 16:56:35.380 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b3cd0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 16:56:35.380 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 16:56:35.380 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:56:35.380 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 16:56:35.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:35.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:35.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:35.938 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:36.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07d7002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:36.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:37.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:37.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:38.373 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf950) allocated [ CSSD]2013-05-23 16:56:38.374 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:56:38.374 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf950 - 1,2,3 [ CSSD]2013-05-23 16:56:38.374 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42cf950) pid(13273/13273) version 11:1:1:4 [ CSSD]2013-05-23 16:56:38.390 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cf950), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 16:56:38.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 16:56:38.390 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 16:56:38.390 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 16:56:38.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:39.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:39.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:39.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:39.940 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:56:40.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:40.836 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:56:40.837 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:56:40.838 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:56:40.838 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b41fd930) pid(13444) version 11:1:1:4 [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:56:40.845 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:40.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 16:56:40.851 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:56:40.851 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:40.851 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:56:41.054 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:56:41.054 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42b59d0) skgpid ospid 13444 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:41.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:41.924 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:42.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:43.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:43.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:44.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:44.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:44.944 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:45.269 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:45.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07d8002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:45.974 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:56:45.974 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:56:45.974 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:56:45.974 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:45.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:45.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:45.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07d9002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:45.982 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:56:45.982 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:56:46.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07da002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:46.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:48.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:48.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:48.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:49.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:49.947 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:50.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:50.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:50.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:52.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:52.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:52.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:54.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:54.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:54.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:54.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:54.950 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:56:55.289 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:56:56.090 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:56:56.091 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:56:56.091 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:56:56.091 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b41fd930) pid(13585) version 11:1:1:4 [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:56:56.098 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:56:56.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:56.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:56.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 16:56:56.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:56:56.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:56:56.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:56:56.307 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:56:56.307 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42ba970) skgpid ospid 13585 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:56:56.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07db002c) incarnation(174631051) [ CSSD]2013-05-23 16:56:56.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:56:58.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:56:58.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:56:58.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:56:58.953 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:56:58.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:00.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:00.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:01.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:01.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07dc002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:01.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:01.224 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:01.224 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:57:01.224 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:01.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07dd002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:01.232 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:01.232 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:02.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:02.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:03.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:03.956 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:03.957 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:04.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:04.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:05.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:05.310 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:06.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:06.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:06.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07de002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:07.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:08.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:08.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:08.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:08.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:09.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:10.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:10.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:11.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:11.356 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:11.357 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:57:11.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:11.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b41fd930) pid(13767) version 11:1:1:4 [ CSSD]2013-05-23 16:57:11.363 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 16:57:11.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:57:11.363 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 16:57:11.363 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:11.363 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:11.364 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:11.364 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:11.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 16:57:11.371 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:11.371 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:11.371 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:11.574 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:11.574 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42b59d0) skgpid ospid 13767 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:11.723 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a87f0) allocated [ CSSD]2013-05-23 16:57:11.723 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:57:11.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a87f0 - 1,2,3 [ CSSD]2013-05-23 16:57:11.724 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a87f0) pid(13786) version 11:1:1:4 [ CSSD]2013-05-23 16:57:12.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:12.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:12.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:12.963 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:57:13.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:13.241 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dbe20) allocated [ CSSD]2013-05-23 16:57:13.242 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:57:13.243 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dbe20 - 1,2,3 [ CSSD]2013-05-23 16:57:13.243 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42dbe20) pid(14023) version 11:1:1:4 [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dbe20), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc400/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:13.249 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:13.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:13.257 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:13.257 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc700) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:13.257 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc700) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:13.460 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dbe20 [ CSSD]2013-05-23 16:57:13.460 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dbe20) con(0x7f82b42c80f0) skgpid ospid 14023 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:14.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:14.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:14.420 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a87f0 [ CSSD]2013-05-23 16:57:14.420 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a87f0) con(0x7f82b42a9150) skgpid ospid 13786 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:15.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:15.332 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:16.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:16.322 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:16.474 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07df002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:16.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:16.474 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:16.474 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:57:16.474 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:16.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e0002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:16.481 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:16.482 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:16.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e1002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:17.259 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:17.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:17.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:18.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:57:18.122 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:57:18.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:57:18.124 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:57:18.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e2002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:18.205 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:18.205 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:18.205 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 16:57:18.205 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 16:57:18.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e3002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:18.214 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:18.214 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:18.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:18.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:19.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:20.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:20.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:21.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:22.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:22.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:22.970 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:22.970 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:23.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:24.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:24.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:24.958 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:24.958 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:57:24.959 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:24.959 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b41fd930) pid(14218) version 11:1:1:4 [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:24.965 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:24.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:57:24.973 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:24.973 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:24.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:25.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:25.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42b59d0) skgpid ospid 14218 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:25.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:25.353 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:26.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:26.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:26.613 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:26.613 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:57:26.614 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:26.614 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b41fd930) pid(14241) version 11:1:1:4 [ CSSD]2013-05-23 16:57:26.620 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:57:26.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:57:26.620 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 16:57:26.620 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:26.620 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:26.621 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:26.621 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:26.627 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:57:26.627 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:26.627 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:26.628 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:26.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e4002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:26.830 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:26.830 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a1810) skgpid ospid 14241 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:27.358 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:27.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:27.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:28.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:28.446 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:28.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e5002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:28.808 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:28.808 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:28.808 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:57:28.808 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:28.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e6002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:28.815 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:28.815 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:29.369 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:30.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:30.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:31.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:31.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07e7002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:31.727 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:31.727 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:31.727 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:57:31.727 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:31.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07e8002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:31.735 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:31.735 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:31.976 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:31.976 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:57:32.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:32.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:33.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:34.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:34.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:35.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:35.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:36.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:36.534 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:36.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07e9002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:36.980 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:36.980 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:37.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:38.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:38.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:39.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:40.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:40.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:41.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:41.864 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:41.865 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:57:41.865 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:41.865 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b41fd930) pid(14390) version 11:1:1:4 [ CSSD]2013-05-23 16:57:41.882 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:57:41.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:57:41.882 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 16:57:41.882 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:41.882 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:41.883 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:41.883 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:41.889 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:57:41.889 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:41.889 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:41.890 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:41.983 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:41.983 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:42.092 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:42.092 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42ccc30) skgpid ospid 14390 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:42.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:42.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:42.769 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:42.769 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:57:42.770 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:42.770 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b41fd930) pid(14437) version 11:1:1:4 [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:42.787 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:42.794 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:57:42.794 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:42.794 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:42.794 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:42.997 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:42.997 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42d9750) skgpid ospid 14437 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:43.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:44.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:44.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:45.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:45.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:46.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:46.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:46.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ea002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:46.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07eb002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:46.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:57:46.977 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:57:46.977 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:57:46.977 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:46.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ec002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:46.985 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:57:46.985 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:57:46.986 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:46.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:47.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:48.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:48.687 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:49.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:50.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:50.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:50.989 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:50.989 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:57:51.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:52.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:52.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:53.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:54.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:54.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:55.426 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:57:55.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:55.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:57:55.993 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:57:56.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:56.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:56.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07ed002c) incarnation(174631051) [ CSSD]2013-05-23 16:57:57.120 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:57:57.121 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:57:57.122 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:57:57.122 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b41fd930) pid(14575) version 11:1:1:4 [ CSSD]2013-05-23 16:57:57.128 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:57:57.128 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:57:57.128 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:57:57.128 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:57.128 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:57:57.129 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:57:57.129 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:57:57.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:57:57.135 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:57:57.135 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:57:57.135 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:57:57.338 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:57:57.338 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42b59d0) skgpid ospid 14575 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:57:57.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:57:58.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:57:58.808 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:57:59.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:00.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:00.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:00.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:00.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:01.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:02.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07ee002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:02.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:58:02.226 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:58:02.226 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:58:02.226 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:02.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ef002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:02.233 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:58:02.233 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:58:02.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:02.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:03.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:04.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:04.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:05.448 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:05.704 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:05.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:06.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:06.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f0002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:06.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:06.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:07.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:08.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:08.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:09.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:10.002 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:10.003 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:58:10.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:10.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:11.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:12.382 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:12.383 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:58:12.384 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:12.384 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b41fd930) pid(14733) version 11:1:1:4 [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:12.390 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:12.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:58:12.398 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:58:12.398 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:12.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:12.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:12.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a9150) skgpid ospid 14733 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:12.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:12.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:13.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:14.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:14.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:15.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:15.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:15.469 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:15.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:16.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f1002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:16.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:16.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:17.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f2002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:17.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:58:17.475 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:58:17.475 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:58:17.475 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:17.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f3002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:17.483 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:58:17.483 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:58:17.781 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:18.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:18.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:19.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:20.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:20.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:21.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:21.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:21.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:23.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:23.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:23.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:25.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:25.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:25.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:25.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:25.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:25.229 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:58:25.230 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:25.230 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b41fd930) pid(14884) version 11:1:1:4 [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:25.237 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:25.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:25.244 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:58:25.244 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:25.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:25.447 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:25.447 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42ccc30) skgpid ospid 14884 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:25.489 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:25.856 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:26.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f4002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:27.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:27.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:27.641 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:27.642 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:58:27.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:27.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b41fd930) pid(14910) version 11:1:1:4 [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:27.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:27.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:27.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:58:27.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:27.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:27.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:27.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a1810) skgpid ospid 14910 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:27.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:29.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:29.015 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:58:29.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f5002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:29.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:58:29.067 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:58:29.067 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:58:29.067 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:29.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f6002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:29.074 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:58:29.074 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:58:29.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:29.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:29.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:31.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:31.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:31.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:32.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07f7002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:32.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:58:32.726 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:58:32.727 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:58:32.727 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:32.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07f8002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:32.735 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:58:32.735 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:58:33.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:33.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:33.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:34.018 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:34.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:35.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:35.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:35.509 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:35.996 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:36.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07f9002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:37.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:37.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:38.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:39.022 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:39.022 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:39.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:39.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:40.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:40.748 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:40.749 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:58:40.749 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:40.749 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b41fd930) pid(15039) version 11:1:1:4 [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4207960 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:40.757 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:40.765 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:58:40.766 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 16:58:40.766 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 16:58:40.766 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:40.880 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cad90) allocated [ CSSD]2013-05-23 16:58:40.881 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:58:40.882 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cad90 - 1,2,3 [ CSSD]2013-05-23 16:58:40.882 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42cad90) pid(15044) version 11:1:1:4 [ CSSD]2013-05-23 16:58:40.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:58:40.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:58:40.904 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:58:40.905 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cad90 [ CSSD]2013-05-23 16:58:40.905 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cad90) con(0x7f82b42ccc30) skgpid ospid 15044 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:40.968 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:40.968 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a9150) skgpid ospid 15039 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:41.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:41.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:41.480 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:41.481 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:58:41.481 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:41.482 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b41fd930) pid(15073) version 11:1:1:4 [ CSSD]2013-05-23 16:58:42.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:42.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a1810) skgpid ospid 15073 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:42.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:42.894 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd930) allocated [ CSSD]2013-05-23 16:58:42.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:58:42.895 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd930 - 1,2,3 [ CSSD]2013-05-23 16:58:42.895 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b41fd930) pid(15175) version 11:1:1:4 [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd930), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:42.901 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:42.907 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 16:58:42.907 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:58:42.907 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c92b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:42.907 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c92b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:43.110 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd930 [ CSSD]2013-05-23 16:58:43.110 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd930) con(0x7f82b42a9150) skgpid ospid 15175 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:43.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:43.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:44.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:44.025 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:44.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:45.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:45.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:45.531 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:46.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:46.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07fa002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:47.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:47.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:47.978 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07fb002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:47.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:58:47.978 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:58:47.978 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:58:47.978 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:47.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07fc002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:47.985 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:58:47.985 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:58:48.028 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:48.028 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:58:48.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:49.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:49.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:50.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:51.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:51.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:52.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:53.031 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:53.031 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:53.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:53.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:54.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:54.342 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 16:58:54.342 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 16:58:54.342 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 16:58:54.343 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 16:58:54.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282520 [ CSSD]2013-05-23 16:58:54.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282520) con(0x7f82b42d8660) skgpid 9584 ospid 9584 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:55.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:55.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:55.553 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:58:56.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:57.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(07fd002c) incarnation(174631051) [ CSSD]2013-05-23 16:58:57.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:57.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:58:58.035 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:58:58.035 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:58:58.143 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:58:58.144 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:58:58.145 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:58:58.145 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d8de0) pid(15392) version 11:1:1:4 [ CSSD]2013-05-23 16:58:58.150 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:58.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:58.150 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b59d0, requested num -1 [ CSSD]2013-05-23 16:58:58.150 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:58.150 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe500/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:58:58.151 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:58:58.151 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:58:58.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:58:58.158 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:58:58.158 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:58:58.158 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:58:58.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:58:58.360 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:58:58.360 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42ccc30) skgpid ospid 15392 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:58:59.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:58:59.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:00.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:01.445 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:01.445 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:02.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:03.038 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:03.038 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:03.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(07fe002c) incarnation(174631051) [ CSSD]2013-05-23 16:59:03.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:59:03.228 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:59:03.228 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:59:03.228 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:03.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(07ff002c) incarnation(174631051) [ CSSD]2013-05-23 16:59:03.236 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:59:03.236 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:59:03.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:03.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:04.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:05.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:05.524 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:05.574 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:06.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:07.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:07.041 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:59:07.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0000002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:07.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:07.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:08.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:09.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:09.541 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:10.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:11.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:11.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:12.045 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:12.045 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:12.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:13.393 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:59:13.394 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:59:13.394 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:59:13.394 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8de0) pid(15555) version 11:1:1:4 [ CSSD]2013-05-23 16:59:13.400 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:59:13.400 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:59:13.400 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 16:59:13.400 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:13.400 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe500/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:59:13.401 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:13.401 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:13.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:59:13.408 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:59:13.408 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:13.408 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:13.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:13.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:13.610 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:59:13.610 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42a9150) skgpid ospid 15555 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:14.393 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:15.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:15.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:15.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:16.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:17.049 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:17.049 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:17.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0001002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:17.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:17.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:18.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:18.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0002002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:18.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:59:18.491 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:59:18.491 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:59:18.491 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:18.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0003002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:18.498 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:59:18.498 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:59:19.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:19.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:20.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:21.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:21.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:22.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:22.052 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:22.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:23.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:23.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:24.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:25.483 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:59:25.484 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:59:25.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:59:25.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42d8de0) pid(15674) version 11:1:1:4 [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe500/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:25.501 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:25.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:59:25.508 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:59:25.508 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:25.508 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:25.619 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:25.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:25.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:25.711 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:59:25.711 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42d9750) skgpid ospid 15674 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:26.055 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:26.055 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 16:59:26.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:27.113 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0004002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:27.523 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:59:27.524 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:59:27.525 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:59:27.525 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8de0) pid(15697) version 11:1:1:4 [ CSSD]2013-05-23 16:59:27.643 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd6e0) allocated [ CSSD]2013-05-23 16:59:27.644 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 16:59:27.644 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd6e0 - 1,2,3 [ CSSD]2013-05-23 16:59:27.644 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b41fd6e0) pid(15707) version 11:1:1:4 [ CSSD]2013-05-23 16:59:27.672 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:59:27.674 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 16:59:27.677 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd6e0 [ CSSD]2013-05-23 16:59:27.677 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd6e0) con(0x7f82b42d9750) skgpid ospid 15707 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:27.711 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:27.711 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5352/0x7f82b41bf650) [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5352 (0x7f82b41bf650) [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b41fe430/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:27.847 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 16:59:27.854 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5352 (0x7f82b41bf650) [ CSSD]2013-05-23 16:59:27.854 [1199044928] >TRACE: clssgmExitGrock: client 5352 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 16:59:27.854 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe820) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 16:59:27.855 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b41fe820) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:27.856 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:59:27.856 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42a9150) skgpid ospid 15697 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:28.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:28.648 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c8020) allocated [ CSSD]2013-05-23 16:59:28.649 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:59:28.650 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c8020 - 1,2,3 [ CSSD]2013-05-23 16:59:28.650 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c8020) pid(15727) version 11:1:1:4 [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42c8020), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:28.667 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:28.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 16:59:28.674 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:59:28.674 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42822d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:28.674 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42822d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:28.877 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c8020 [ CSSD]2013-05-23 16:59:28.877 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c8020) con(0x7f82b42d9750) skgpid ospid 15727 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:29.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0005002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:29.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:59:29.323 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:59:29.323 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:59:29.323 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:29.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0006002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:29.331 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:59:29.331 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:59:29.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:29.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:30.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:31.058 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:31.058 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:31.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:31.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:32.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:33.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0007002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:33.744 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:59:33.744 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:59:33.744 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:59:33.744 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:33.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0008002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:33.752 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:59:33.752 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:59:33.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:33.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:34.504 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:35.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:35.828 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:35.828 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:36.062 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:36.062 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:36.510 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:37.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0009002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:37.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:37.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:38.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:39.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:39.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:40.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:41.065 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:41.066 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:41.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:41.851 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:42.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:43.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:43.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:43.910 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:59:43.911 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:59:43.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:59:43.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b42d8de0) pid(15870) version 11:1:1:4 [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b59d0, requested num -1 [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe500/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:43.918 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:43.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 16:59:43.926 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:59:43.926 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:43.926 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:44.128 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:59:44.128 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42a1810) skgpid ospid 15870 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:44.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:45.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:45.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:45.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:46.069 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:46.069 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:46.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:47.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000a002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:47.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:47.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:48.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:48.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000b002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:48.999 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 16:59:48.999 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 16:59:48.999 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 16:59:48.999 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:49.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000c002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:49.007 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 16:59:49.007 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 16:59:49.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:49.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:50.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:51.073 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:51.073 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:51.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:51.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:52.712 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:53.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:53.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:54.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:55.685 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 16:59:55.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:55.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:56.076 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 16:59:56.076 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 16:59:56.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:57.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(000d002d) incarnation(174631051) [ CSSD]2013-05-23 16:59:57.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:57.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 16:59:58.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 16:59:59.161 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 16:59:59.162 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 16:59:59.163 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 16:59:59.163 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8de0) pid(16012) version 11:1:1:4 [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe500/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 16:59:59.169 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 16:59:59.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 16:59:59.177 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 16:59:59.177 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe800) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 16:59:59.177 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe800) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 16:59:59.379 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 16:59:59.379 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42a9150) skgpid ospid 16012 with 0 clients, refcount 0 [ CSSD]2013-05-23 16:59:59.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 16:59:59.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:00.079 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:00.079 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:00:00.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:02.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:02.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:02.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:03.257 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:00:03.257 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:03.258 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd6e0) allocated [ CSSD]2013-05-23 17:00:03.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:00:03.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b42d8de0) pid(14657/14657) version 11:1:1:4 [ CSSD]2013-05-23 17:00:03.258 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:03.259 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd6e0 - 1,2,3 [ CSSD]2013-05-23 17:00:03.259 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b41fd6e0) pid(16272/16272) version 11:1:1:4 [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd6e0), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:00:03.264 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:00:04.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:04.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:04.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(000e002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:04.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:04.256 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:04.256 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:04.256 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:04.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(000f002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:04.263 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:04.263 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:04.610 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cac60) allocated [ CSSD]2013-05-23 17:00:04.610 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:04.611 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cac60 - 1,2,3 [ CSSD]2013-05-23 17:00:04.611 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8d30) proc(0x7f82b42cac60) pid(16292/16292) version 11:1:1:4 [ CSSD]2013-05-23 17:00:04.617 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42cac60), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:00:04.617 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:00:04.617 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:00:04.617 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:00:04.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cac60 [ CSSD]2013-05-23 17:00:04.903 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cac60) con(0x7f82b42d8d30) skgpid 16292 ospid 16292 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:05.082 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:05.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:05.705 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:06.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:06.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:06.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:07.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0010002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:08.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:08.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:08.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:10.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:10.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:10.086 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:10.086 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:10.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:12.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:12.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:12.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:14.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:14.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:14.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cac40) allocated [ CSSD]2013-05-23 17:00:14.413 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:00:14.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cac40 - 1,2,3 [ CSSD]2013-05-23 17:00:14.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8d30) proc(0x7f82b42cac40) pid(16350) version 11:1:1:4 [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42cac40), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc770/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:00:14.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:14.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:00:14.428 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:00:14.428 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dca70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:14.428 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dca70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:00:14.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cac40 [ CSSD]2013-05-23 17:00:14.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cac40) con(0x7f82b42d8d30) skgpid ospid 16350 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:14.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:15.090 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:15.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:15.734 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:16.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:16.058 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:16.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:17.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0011002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:18.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:18.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:18.978 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:19.093 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:19.093 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:00:19.510 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0012002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:19.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:19.511 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:19.511 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:19.511 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:19.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0013002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:19.518 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:19.518 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:19.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:00:19.764 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:00:19.764 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:00:19.764 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:00:19.764 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:19.765 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b0d30) skgpid 10841 ospid 10841 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:20.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:20.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:20.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:22.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:22.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:23.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:24.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:24.097 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:24.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:24.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:25.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:25.753 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:00:25.754 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:25.755 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:00:25.755 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(16474) version 11:1:1:4 [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:00:25.761 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:25.766 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:25.768 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:00:25.768 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:00:25.768 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdc00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:25.768 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdc00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:00:25.971 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:25.971 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid ospid 16474 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:26.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:26.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:27.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:27.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0014002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:28.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:28.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:29.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:29.100 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:29.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:29.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0015002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:29.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:29.587 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:29.587 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:29.587 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:29.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0016002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:29.594 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:29.594 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:29.660 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:00:29.661 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:00:29.661 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:00:29.661 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a5440) pid(16507) version 11:1:1:4 [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c92b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:00:29.667 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:29.674 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:00:29.674 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:00:29.674 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdc00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:29.674 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdc00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:00:29.876 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:29.876 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b0d30) skgpid ospid 16507 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:30.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:30.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:31.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:32.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:32.162 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:33.058 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:00:33.059 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:33.060 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:00:33.060 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8d30) proc(0x7f82b42a5440) pid(16573/16573) version 11:1:1:4 [ CSSD]2013-05-23 17:00:33.076 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:00:33.076 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:00:33.076 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:00:33.076 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:00:33.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:33.240 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a5440), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 17:00:33.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 17:00:33.240 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:00:33.240 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 17:00:33.830 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:00:33.830 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:00:33.830 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:00:33.830 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:00:33.831 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd6e0 [ CSSD]2013-05-23 17:00:33.831 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd6e0) con(0x7f82b42ccc30) skgpid 16272 ospid 16272 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:34.104 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:34.104 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:34.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:34.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:34.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0017002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:34.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:34.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:34.769 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:34.769 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:34.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0018002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:34.775 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:34.776 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:35.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:35.792 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:36.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:36.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:37.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:37.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0019002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:38.310 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:38.310 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:39.107 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:39.108 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:39.178 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:40.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:40.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:41.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:42.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:42.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:42.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 17:00:42.552 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:00:42.552 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:00:42.552 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:42.562 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d8d30) skgpid 16573 ospid 16573 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:42.580 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:00:42.580 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:00:42.581 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:00:42.581 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a5440) pid(16637/16637) version 11:1:1:4 [ CSSD]2013-05-23 17:00:42.597 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:00:42.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:00:42.597 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:00:42.597 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:00:43.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:44.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:44.111 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:44.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:00:44.143 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:00:44.143 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:00:44.143 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:00:44.143 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:44.144 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a9150) skgpid 16637 ospid 16637 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:44.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:44.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:44.909 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:00:44.910 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:00:44.911 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:00:44.911 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(16662) version 11:1:1:4 [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:00:44.917 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:44.924 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:00:44.925 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:00:44.925 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:00:44.925 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:00:45.127 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:00:45.127 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 16662 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:00:45.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:45.819 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:46.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:46.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:47.222 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:47.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001a002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:48.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:48.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:49.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:49.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:49.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:50.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001b002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:50.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:50.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:50.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:50.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:50.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001c002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:50.031 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:50.031 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:50.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:50.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:51.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:52.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:52.424 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:53.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:53.118 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:00:53.287 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:54.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:54.434 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:55.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:55.847 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:00:56.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:56.439 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:57.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:00:57.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(001d002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:58.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(001e002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:58.029 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:00:58.029 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:00:58.029 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:00:58.029 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:00:58.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(001f002d) incarnation(174631051) [ CSSD]2013-05-23 17:00:58.037 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:00:58.037 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:00:58.122 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:00:58.122 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:00:58.451 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:00:58.451 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:00:59.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:00.159 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:00.160 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:01:00.161 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:00.161 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a5440) pid(16832) version 11:1:1:4 [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:01:00.178 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:00.185 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:01:00.185 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:01:00.185 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:00.185 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:01:00.388 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:00.388 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a9150) skgpid ospid 16832 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:00.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:00.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:01.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:02.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:02.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:03.125 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:03.126 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:03.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:04.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:04.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:05.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0020002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:05.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:05.284 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:05.284 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:01:05.284 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:05.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0021002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:05.291 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:05.291 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:05.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:05.871 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:06.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:06.522 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:07.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:07.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0022002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:08.129 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:08.130 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:08.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:08.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:09.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:10.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:10.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:11.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:12.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:12.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:13.133 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:13.133 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:13.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:14.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:14.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:15.382 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:15.382 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:01:15.383 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:15.383 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a5440) pid(16993/16993) version 11:1:1:4 [ CSSD]2013-05-23 17:01:15.390 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:01:15.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:01:15.390 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:01:15.390 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:15.410 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a9150) skgpid 16993 ospid 16993 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:15.422 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:15.422 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:01:15.423 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:15.423 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a5440) pid(16995) version 11:1:1:4 [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42b5ce0, requested num -1 [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:01:15.429 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:15.436 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:01:15.436 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:01:15.436 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:15.436 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:01:15.480 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:15.638 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:15.638 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b0d30) skgpid ospid 16995 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:15.894 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:16.561 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:16.561 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:17.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0023002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:17.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:18.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:18.136 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:18.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:18.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:19.497 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:19.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0024002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:19.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:19.715 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:19.715 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:01:19.715 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:19.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0025002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:19.722 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:19.722 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:19.849 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:01:19.850 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:01:19.851 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:01:19.852 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:01:20.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0026002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:20.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:20.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:20.541 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:01:20.541 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:20.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0027002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:20.548 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:20.548 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:20.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:20.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:21.503 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:22.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:22.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:23.140 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:23.140 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:23.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:24.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:24.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:25.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:25.920 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:26.011 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:26.012 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:01:26.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:26.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a5440) pid(17133) version 11:1:1:4 [ CSSD]2013-05-23 17:01:26.018 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:01:26.018 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:01:26.018 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:01:26.018 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:26.018 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:01:26.019 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:01:26.019 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:26.025 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:01:26.025 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:01:26.025 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:26.025 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:01:26.228 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:26.228 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b0d30) skgpid ospid 17133 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:26.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:26.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:27.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:27.143 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:01:27.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0028002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:27.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:28.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:28.643 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:29.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:29.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0029002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:29.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:29.846 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:29.847 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:01:29.847 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:29.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002a002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:29.855 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:29.855 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:30.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:30.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:30.716 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:30.717 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:01:30.717 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:30.717 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(17178) version 11:1:1:4 [ CSSD]2013-05-23 17:01:30.723 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:01:30.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:01:30.723 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:01:30.723 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:30.723 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:01:30.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:01:30.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:30.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:01:30.731 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:01:30.731 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:30.731 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:01:30.934 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:30.934 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 17178 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:31.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:32.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:32.146 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:32.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:32.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:33.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:34.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:34.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:35.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:35.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002b002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:35.801 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:35.801 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:35.801 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:01:35.801 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:35.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(002c002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:35.809 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:35.809 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:35.948 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:36.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:36.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:37.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:37.149 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:37.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002d002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:37.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:38.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:38.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:39.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:40.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:40.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:41.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:42.152 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:42.153 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:42.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:42.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:43.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:44.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:44.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:45.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:45.966 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:01:45.967 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:01:45.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:01:45.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b42a5440) pid(17322) version 11:1:1:4 [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42b5ce0, requested num -1 [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:01:45.974 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:45.979 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:45.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:01:45.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:01:45.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:01:45.981 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:01:46.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:46.156 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:01:46.184 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:01:46.184 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a1810) skgpid ospid 17322 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:01:46.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:46.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:47.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(002e002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:47.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:48.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:48.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:49.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:50.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:50.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:51.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(002f002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:51.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:01:51.068 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:01:51.068 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:01:51.068 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:01:51.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0030002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:51.076 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:01:51.076 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:01:51.159 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:51.159 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:51.825 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:52.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:52.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:53.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:54.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:54.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:55.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:56.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:01:56.163 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:01:56.163 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:01:56.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:56.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:57.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0031002d) incarnation(174631051) [ CSSD]2013-05-23 17:01:57.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:01:58.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:01:58.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:01:59.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:00.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:00.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:01.166 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:01.166 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:01.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:01.221 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:02:01.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:01.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(17478) version 11:1:1:4 [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:02:01.228 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:01.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:02:01.234 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:02:01.234 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:01.234 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:02:01.437 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:01.437 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 17478 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:01.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:02.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:02.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:03.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:04.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:04.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:05.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:05.169 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:02:05.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:06.072 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:06.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0032002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:06.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:06.326 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:06.326 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:06.326 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:06.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0033002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:06.333 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:06.333 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:06.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:06.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:07.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0034002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:07.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:08.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0035002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:08.077 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:08.077 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:08.077 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:08.077 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:08.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0036002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:08.084 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:08.084 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:09.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:09.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:09.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:10.172 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:10.172 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:11.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:11.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:11.229 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:11.230 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:02:11.230 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:11.230 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(17640) version 11:1:1:4 [ CSSD]2013-05-23 17:02:11.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:13.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:13.063 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:13.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:13.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid ospid 17640 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:13.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:15.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:15.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:15.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:15.175 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:16.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:16.094 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:16.470 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:16.471 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:02:16.471 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:16.471 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5ce0) proc(0x7f82b42a5440) pid(17981) version 11:1:1:4 [ CSSD]2013-05-23 17:02:16.477 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:02:16.477 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:02:16.477 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:02:16.477 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:16.477 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:02:16.478 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:02:16.478 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:16.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:02:16.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:02:16.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:16.485 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:02:16.688 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:16.688 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42b5ce0) skgpid ospid 17981 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:17.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:17.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:17.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0037002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:18.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:18.452 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:02:18.452 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:02:18.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:02:18.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:02:18.524 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0038002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:18.524 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:18.524 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:18.524 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:02:18.524 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:02:18.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0039002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:18.533 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:18.533 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:19.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:19.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:20.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:20.179 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:20.179 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:21.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:21.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:21.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003a002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:21.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:21.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:21.590 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:21.590 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:21.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003b002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:21.598 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:21.598 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:21.884 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:21.885 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:02:21.886 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:21.886 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b42a5440) pid(18057/18057) version 11:1:1:4 [ CSSD]2013-05-23 17:02:21.892 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:02:21.892 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:02:21.892 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:02:21.892 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:21.919 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a1810) skgpid 18057 ospid 18057 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:22.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:23.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:23.142 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:24.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:24.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:24.182 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:02:25.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:25.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:26.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:26.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:26.261 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:26.262 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:02:26.262 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:26.262 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(18088) version 11:1:1:4 [ CSSD]2013-05-23 17:02:26.268 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 17:02:26.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:02:26.268 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42a1810, requested num -1 [ CSSD]2013-05-23 17:02:26.268 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:26.268 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:02:26.269 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:02:26.269 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:26.276 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:02:26.276 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:02:26.276 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:26.276 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:02:26.479 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:26.479 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid ospid 18088 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:27.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:27.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:27.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(003c002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:28.138 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:29.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:29.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:29.185 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:29.186 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:30.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003d002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:30.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:30.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:30.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:30.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:30.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(003e002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:30.111 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:30.111 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:30.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:31.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:31.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:31.722 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:31.723 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:02:31.724 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:31.724 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a1810) proc(0x7f82b42a5440) pid(18158) version 11:1:1:4 [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:02:31.730 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:31.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:02:31.738 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:02:31.738 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:31.738 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:02:31.941 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:31.941 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a1810) skgpid ospid 18158 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:32.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:33.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:33.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:34.189 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:34.190 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:34.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:35.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:35.231 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:36.140 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:36.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:36.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(003f002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:36.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:36.844 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:36.844 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:36.844 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:36.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0040002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:36.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:36.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:37.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:37.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:37.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0041002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:38.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:39.193 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:39.193 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:39.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:39.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:40.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:41.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:41.242 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:42.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:43.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:43.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:44.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:44.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:44.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:45.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:45.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:46.163 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:46.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:46.976 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:46.977 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:02:46.977 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:46.977 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42a5440) pid(18312) version 11:1:1:4 [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42b5ce0, requested num -1 [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:02:46.984 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:46.992 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:02:46.992 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:02:46.992 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:02:46.993 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:02:47.195 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:02:47.195 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42a9150) skgpid ospid 18312 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:47.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:47.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:47.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0042002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:48.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:49.200 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:49.200 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:49.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:49.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:02:49.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid 12630 ospid 12630 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:02:50.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:51.085 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:02:51.086 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:02:51.087 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:02:51.087 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(18375/18375) version 11:1:1:4 [ CSSD]2013-05-23 17:02:51.093 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:02:51.093 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:02:51.093 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:02:51.093 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:02:51.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:51.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:52.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0043002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:52.098 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:02:52.098 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:02:52.098 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:02:52.098 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:02:52.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0044002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:52.106 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:02:52.106 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:02:52.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:53.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:53.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:54.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:54.204 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:02:54.590 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:55.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:55.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:56.184 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:02:56.596 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:57.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:57.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:02:57.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0045002d) incarnation(174631051) [ CSSD]2013-05-23 17:02:58.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:02:58.207 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:02:58.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:02:59.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:02:59.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:00.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:01.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:01.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:02.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:03:02.228 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:03:02.229 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:03:02.229 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b4207a80) pid(18459) version 11:1:1:4 [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:02.236 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:02.243 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:03:02.243 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:03:02.243 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:02.243 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:02.445 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:03:02.445 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42b0d30) skgpid ospid 18459 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:02.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:03.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:03.210 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:03.315 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42ba970) skgpid 14657 ospid 14657 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:03.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:03.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:03.385 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:03:03.386 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:03.386 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:03:03.386 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b4207a80) pid(18506/18506) version 11:1:1:4 [ CSSD]2013-05-23 17:03:03.403 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:03:03.403 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:03:03.403 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:03:03.403 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:03:04.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:05.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:05.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:06.214 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:06.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:07.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0046002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:07.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:03:07.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:03:07.353 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:03:07.353 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:07.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0047002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:07.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:03:07.360 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:03:07.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:07.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:07.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0048002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:08.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:08.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:08.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:09.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:09.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:10.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:11.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:11.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:12.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:13.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:13.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:13.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:13.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:14.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:15.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:15.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:16.242 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:16.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:17.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:17.220 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:03:17.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:17.467 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:17.479 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:03:17.480 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:03:17.480 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:03:17.480 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42d8de0) pid(18599) version 11:1:1:4 [ CSSD]2013-05-23 17:03:17.487 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:03:17.487 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:03:17.487 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:03:17.487 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:17.487 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:03:17.488 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:17.488 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:17.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:03:17.495 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:03:17.495 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe730) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:17.495 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe730) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:17.697 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:17.697 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42b59d0) skgpid ospid 18599 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:17.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0049002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:18.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:19.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:19.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:20.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:21.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:21.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:22.224 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:22.224 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:22.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004a002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:22.617 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:03:22.617 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:03:22.617 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:03:22.617 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:22.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004b002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:22.625 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:03:22.625 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:03:22.901 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:23.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:23.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:24.912 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:25.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:25.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:26.273 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:26.520 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:03:26.521 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:26.521 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:03:26.521 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42d8de0) pid(18699) version 11:1:1:4 [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:26.528 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:26.535 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:03:26.535 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:03:26.535 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe730) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:26.536 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe730) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:26.738 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:26.738 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42b59d0) skgpid ospid 18699 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:26.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:27.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:27.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:27.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:27.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:27.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004c002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:28.579 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:03:28.580 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:28.581 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:03:28.581 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42d8de0) pid(18722/18722) version 11:1:1:4 [ CSSD]2013-05-23 17:03:28.597 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:28.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:28.597 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:03:28.597 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:28.764 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42b59d0) skgpid 18722 ospid 18722 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:28.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:28.947 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:03:28.947 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:28.948 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:03:28.948 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5720) proc(0x7f82b42d8de0) pid(18725/18725) version 11:1:1:4 [ CSSD]2013-05-23 17:03:28.954 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:03:28.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:03:28.954 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:03:28.954 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:29.010 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42b5720) skgpid 18725 ospid 18725 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:29.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:29.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:30.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(004d002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:30.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:03:30.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:03:30.360 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:03:30.360 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:30.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(004e002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:30.366 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:03:30.366 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:03:30.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:31.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:31.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:32.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:32.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:32.731 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8de0) allocated [ CSSD]2013-05-23 17:03:32.732 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:03:32.732 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8de0 - 1,2,3 [ CSSD]2013-05-23 17:03:32.732 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b59d0) proc(0x7f82b42d8de0) pid(18759) version 11:1:1:4 [ CSSD]2013-05-23 17:03:32.738 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8de0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:03:32.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:03:32.738 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:03:32.738 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:32.738 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:03:32.739 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:32.739 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:32.745 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:03:32.745 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:03:32.745 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe730) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:32.745 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe730) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:32.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:32.948 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8de0 [ CSSD]2013-05-23 17:03:32.948 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8de0) con(0x7f82b42b59d0) skgpid ospid 18759 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:33.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:03:33.465 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:33.465 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:33.465 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:03:33.466 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:03:33.466 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a9150) skgpid 18506 ospid 18506 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:33.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:33.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:34.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:35.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:35.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:36.233 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:36.233 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:03:36.348 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:36.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:37.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:37.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:37.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(004f002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:37.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0050002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:37.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:03:37.875 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:03:37.875 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:03:37.875 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:37.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0051002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:37.882 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:03:37.882 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:03:38.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:39.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:39.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:41.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:41.019 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:03:41.020 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:41.020 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:03:41.020 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b4207a80) pid(18868) version 11:1:1:4 [ CSSD]2013-05-23 17:03:41.050 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8250) allocated [ CSSD]2013-05-23 17:03:41.051 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:41.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8250 - 1,2,3 [ CSSD]2013-05-23 17:03:41.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5720) proc(0x7f82b42d8250) pid(18905) version 11:1:1:4 [ CSSD]2013-05-23 17:03:41.058 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8250), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:03:41.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:03:41.058 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b429dca0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:03:41.058 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:03:41.058 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42823c0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:03:41.059 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:41.059 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:41.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:03:41.065 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:03:41.065 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe430) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:03:41.065 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b41fe430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:41.173 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c90) allocated [ CSSD]2013-05-23 17:03:41.174 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:03:41.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c90 - 1,2,3 [ CSSD]2013-05-23 17:03:41.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b42d3c90) pid(18919) version 11:1:1:4 [ CSSD]2013-05-23 17:03:41.190 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:03:41.192 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:03:41.195 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:03:41.196 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c90 [ CSSD]2013-05-23 17:03:41.196 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c90) con(0x7f82b42ba970) skgpid ospid 18919 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:41.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:41.237 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:41.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8250 [ CSSD]2013-05-23 17:03:41.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8250) con(0x7f82b42b5720) skgpid ospid 18905 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:41.593 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:03:41.593 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a9150) skgpid ospid 18868 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:41.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:41.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:43.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:43.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:43.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:45.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:45.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:45.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:46.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:46.241 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:46.384 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:47.046 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:47.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:47.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:47.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0052002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:47.992 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:03:47.993 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:03:47.993 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:03:47.993 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b4207a80) pid(19081) version 11:1:1:4 [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b5720, requested num -1 [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d87c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:03:48.000 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:48.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:03:48.007 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:03:48.007 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42827e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:03:48.008 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42827e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:03:48.211 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:03:48.211 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ba970) skgpid ospid 19081 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:49.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:49.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:49.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:51.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:51.244 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:51.244 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:51.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:51.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:53.111 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:53.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0053002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:53.124 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:03:53.124 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:03:53.124 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:03:53.124 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:03:53.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0054002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:53.130 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:03:53.130 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:03:53.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:53.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf950 [ CSSD]2013-05-23 17:03:54.434 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf950) con(0x7f82b427d8a0) skgpid 13273 ospid 13273 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:54.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:03:54.439 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:54.439 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:54.440 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 17:03:54.440 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:03:54.440 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b4257120) skgpid 7740 ospid 7740 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:03:54.442 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b4207cd0) skgpid 13275 ospid 13275 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:03:55.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:55.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:55.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:56.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:03:56.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:03:56.415 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:03:57.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:57.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:57.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:03:57.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0055002d) incarnation(174631051) [ CSSD]2013-05-23 17:03:59.235 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:03:59.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:03:59.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:01.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:01.251 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:01.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:01.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:01.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:03.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:03.253 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:04:03.254 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:04:03.255 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:04:03.255 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b4207a80) pid(19266) version 11:1:1:4 [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:03.261 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:03.268 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:04:03.268 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:04:03.268 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:03.268 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:03.471 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:04:03.471 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257820) skgpid ospid 19266 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:03.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:03.848 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:05.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:05.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:05.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:06.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:06.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:06.437 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:07.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:07.865 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:07.865 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:07.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0056002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:08.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0057002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:08.386 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:04:08.386 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:04:08.387 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:04:08.387 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:08.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0058002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:08.393 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:04:08.394 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:04:09.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:09.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:09.872 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:10.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:10.257 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:04:11.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:11.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:11.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:13.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:13.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:13.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:15.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:15.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:15.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:15.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:15.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:17.401 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:17.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:17.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:17.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:17.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0059002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:18.503 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:04:18.504 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:04:18.505 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:04:18.505 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(19424) version 11:1:1:4 [ CSSD]2013-05-23 17:04:18.511 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:04:18.511 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:04:18.511 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:04:18.511 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:18.511 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:04:18.512 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:18.512 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:18.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:04:18.518 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:04:18.518 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0d30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:18.518 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0d30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:18.721 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:04:18.721 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 19424 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:19.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:19.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:19.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:20.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:20.264 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:21.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:21.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:21.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:23.193 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:04:23.193 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:04:23.194 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:04:23.194 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(19186/19186) version 11:1:1:4 [ CSSD]2013-05-23 17:04:23.200 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:04:23.200 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:04:23.200 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:04:23.200 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 17:04:23.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:23.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005a002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:23.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:04:23.636 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:04:23.636 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:04:23.636 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:23.643 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005b002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:23.643 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:04:23.643 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:04:23.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:23.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:24.290 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:04:24.291 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:04:24.291 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:04:24.291 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ae300) pid(19184/19184) version 11:1:1:4 [ CSSD]2013-05-23 17:04:24.308 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ae300), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:04:24.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:04:24.308 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:04:24.308 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 17:04:25.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:25.268 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:25.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:25.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:25.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:26.783 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:04:26.783 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:04:26.784 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:04:26.784 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42ba8a0) pid(19545) version 11:1:1:4 [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:26.790 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:26.797 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:04:26.797 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:04:26.797 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:26.797 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:26.999 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:04:26.999 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4257820) skgpid ospid 19545 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:27.422 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:27.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:27.935 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:04:27.936 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:04:27.936 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:04:27.936 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42ba8a0) pid(19562) version 11:1:1:4 [ CSSD]2013-05-23 17:04:27.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:27.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:27.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005c002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:28.054 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:04:28.055 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:04:28.055 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:04:28.055 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42a8840) pid(19572) version 11:1:1:4 [ CSSD]2013-05-23 17:04:28.073 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:04:28.075 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:04:28.078 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:04:28.078 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b4257820) skgpid ospid 19572 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5353/0x7f82b4207960) [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5353 (0x7f82b4207960) [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207960 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42cfca0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:28.158 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:04:28.164 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5353 (0x7f82b4207960) [ CSSD]2013-05-23 17:04:28.164 [1199044928] >TRACE: clssgmExitGrock: client 5353 (0x7f82b4207960), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:04:28.164 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8fc0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:04:28.164 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a8fc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:28.166 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:04:28.166 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42a9150) skgpid ospid 19562 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:29.270 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:29.270 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:04:29.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:29.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:29.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:30.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(005d002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:30.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:04:30.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:04:30.631 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:04:30.631 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:30.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(005e002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:30.639 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:04:30.639 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:04:31.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:31.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:31.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:33.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:33.758 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:04:33.759 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:04:33.759 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:04:33.759 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(19623) version 11:1:1:4 [ CSSD]2013-05-23 17:04:33.776 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:04:33.776 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:04:33.776 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:04:33.776 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:33.776 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:04:33.777 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:33.777 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:33.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:04:33.784 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:04:33.784 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:33.785 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:33.987 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:04:33.987 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid ospid 19623 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:34.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:34.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:34.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:34.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:35.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:36.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:36.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:37.449 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:37.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:38.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(005f002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:38.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:38.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:38.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0060002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:38.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:04:38.897 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:04:38.897 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:04:38.897 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:38.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0061002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:38.904 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:04:38.904 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:04:39.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:39.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:39.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:40.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:40.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:41.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:42.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:42.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:43.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:44.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:44.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:44.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:44.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:45.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:46.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:46.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:47.472 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:47.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:48.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0062002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:48.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:48.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:48.283 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:48.284 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:04:49.031 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:04:49.032 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:04:49.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:04:49.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a3ea0) pid(19770) version 11:1:1:4 [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ea0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:04:49.049 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:49.056 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:04:49.056 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:04:49.056 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:04:49.057 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:04:49.259 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:04:49.259 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427c5d0) skgpid ospid 19770 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:04:49.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:50.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:50.153 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:51.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:52.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:52.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:53.287 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:53.287 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:53.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:54.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0063002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:54.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:04:54.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:04:54.151 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:04:54.152 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:04:54.159 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0064002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:54.159 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:04:54.159 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:04:54.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:54.170 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:55.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:56.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:56.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:57.591 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:04:57.762 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:04:58.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0065002d) incarnation(174631051) [ CSSD]2013-05-23 17:04:58.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:04:58.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:04:58.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:04:58.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:04:59.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:00.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:00.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:01.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:02.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:02.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:03.294 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:03.294 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:03.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:04.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:04.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:04.302 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:05:04.303 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:05:04.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:05:04.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ba8a0) pid(19929) version 11:1:1:4 [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:05:04.310 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:04.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:05:04.316 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:05:04.316 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:04.316 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:05:04.519 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:05:04.519 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42cbf30) skgpid ospid 19929 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:04.900 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:05:04.900 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:05:04.901 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:05:04.901 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(19978/19978) version 11:1:1:4 [ CSSD]2013-05-23 17:05:04.917 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:05:04.917 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:05:04.917 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:05:04.917 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:05:05.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid 19978 ospid 19978 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:05.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:06.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:06.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:07.297 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:07.297 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:05:07.611 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:07.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:08.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0066002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:08.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:08.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:09.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0067002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:09.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:05:09.418 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:05:09.418 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:05:09.418 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:09.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0068002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:09.425 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:05:09.425 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:05:09.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:10.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:10.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:11.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:12.281 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:12.281 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:12.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:12.300 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:13.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:14.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:14.290 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:15.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:16.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:16.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:17.303 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:17.304 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:17.634 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:17.942 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:18.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0069002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:18.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:18.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:19.552 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 17:05:19.553 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:05:19.553 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 17:05:19.553 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42583a0) pid(20083) version 11:1:1:4 [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42583a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:05:19.560 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:19.567 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:05:19.567 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:05:19.567 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:19.567 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:05:19.770 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 17:05:19.770 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42be650) skgpid ospid 20083 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:20.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:20.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:20.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:22.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:22.307 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:22.307 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:22.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:22.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:24.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:24.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:24.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:24.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006a002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:24.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:05:24.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:05:24.671 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:05:24.671 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:24.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006b002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:24.679 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:05:24.679 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:05:25.585 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:05:25.585 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:05:25.586 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:05:25.586 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42ba8a0) pid(20147/20147) version 11:1:1:4 [ CSSD]2013-05-23 17:05:25.602 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:05:25.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:05:25.602 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:05:25.602 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:05:26.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:26.310 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:26.310 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:05:26.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:26.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:27.042 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:05:27.043 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:05:27.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:05:27.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a8840) pid(20191) version 11:1:1:4 [ CSSD]2013-05-23 17:05:27.050 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:05:27.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:05:27.050 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:05:27.050 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:27.050 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:05:27.051 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:05:27.051 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:27.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:05:27.058 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:05:27.058 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:27.058 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:05:27.261 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:05:27.261 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b427c5d0) skgpid ospid 20191 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:27.655 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:28.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:28.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006c002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:28.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:28.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:30.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:30.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:30.385 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:30.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(006d002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:30.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:05:30.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:05:30.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:05:30.898 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:30.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(006e002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:30.905 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:05:30.905 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:05:31.313 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:31.313 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:32.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:32.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:32.391 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:34.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:34.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:34.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:34.804 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:05:34.805 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:05:34.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:05:34.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a8840) pid(20253) version 11:1:1:4 [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a3f90, requested num -1 [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:05:34.811 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:34.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:05:34.819 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:05:34.819 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:34.819 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:05:35.022 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:05:35.022 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b42cbf30) skgpid ospid 20253 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:36.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:36.317 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:36.317 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:36.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:36.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:37.677 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:38.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(006f002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:38.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:38.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:38.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:39.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0070002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:39.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:05:39.924 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:05:39.924 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:05:39.924 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:39.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0071002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:39.931 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:05:39.931 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:05:40.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:40.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:40.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:41.320 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:41.320 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:42.260 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:42.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:42.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:44.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:44.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:44.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:45.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:45.323 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:05:46.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:46.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:46.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:47.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:48.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0072002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:48.344 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:48.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:48.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:50.055 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:05:50.055 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:05:50.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:05:50.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a8840) pid(20403) version 11:1:1:4 [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:05:50.062 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:50.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:05:50.069 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:05:50.069 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:05:50.069 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:05:50.271 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:05:50.271 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b427c5d0) skgpid ospid 20403 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:05:50.327 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:50.327 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:50.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:50.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:50.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:52.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:52.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:52.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:54.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:54.563 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:54.563 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:55.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0073002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:55.181 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:05:55.181 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:05:55.181 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:05:55.181 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:05:55.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0074002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:55.188 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:05:55.188 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:05:55.331 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:55.331 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:05:56.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:56.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:56.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:57.726 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:05:58.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0075002d) incarnation(174631051) [ CSSD]2013-05-23 17:05:58.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:05:58.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:05:58.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:05:59.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:05:59.334 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:06:00.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:00.587 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:00.587 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:02.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:02.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:02.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:04.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:04.337 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:04.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:04.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:04.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:05.304 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:06:05.305 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:06:05.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:06:05.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42a8840) pid(20548) version 11:1:1:4 [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42a3f90, requested num -1 [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:06:05.312 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:05.319 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:06:05.319 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:06:05.319 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:05.319 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:06:05.522 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:06:05.522 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b427c5d0) skgpid ospid 20548 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:06.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:06.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:06.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:07.747 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:08.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0076002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:08.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:08.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:08.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:09.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:09.341 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:10.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0077002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:10.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:10.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:10.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:06:10.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:10.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0078002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:10.462 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:10.462 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:10.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:10.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:10.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:12.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:12.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:12.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:14.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:14.344 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:14.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:14.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:14.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:15.877 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:06:15.877 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:06:15.878 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:06:15.878 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a8840) pid(20653/20653) version 11:1:1:4 [ CSSD]2013-05-23 17:06:15.895 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:06:15.895 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:06:15.895 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:06:15.895 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:06:15.916 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b42cbf30) skgpid 20653 ospid 20653 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:16.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:16.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:16.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:17.768 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:18.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0079002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:18.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:18.347 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:06:18.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:18.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:18.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:20.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007a002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:20.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:20.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:20.008 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:06:20.009 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:20.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007b002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:20.015 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:20.015 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:20.151 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:06:20.151 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:06:20.153 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:06:20.153 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:06:20.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:06:20.566 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:06:20.566 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:06:20.566 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42a8840) pid(20688) version 11:1:1:4 [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:06:20.583 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:20.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:06:20.590 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:06:20.590 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:20.590 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:06:20.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:20.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:20.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:20.793 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:06:20.793 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b42a3f90) skgpid ospid 20688 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:22.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:22.714 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:22.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:23.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:23.351 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:24.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:24.764 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:24.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:25.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007c002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:25.713 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:25.713 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:25.713 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:06:25.713 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:25.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(007d002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:25.720 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:25.720 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:26.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:26.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:26.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:27.306 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8840) allocated [ CSSD]2013-05-23 17:06:27.307 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:06:27.308 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8840 - 1,2,3 [ CSSD]2013-05-23 17:06:27.308 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a8840) pid(20776) version 11:1:1:4 [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8840), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a3f90, requested num -1 [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:06:27.314 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:27.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:06:27.321 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:06:27.321 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:27.321 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:06:27.417 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8180) allocated [ CSSD]2013-05-23 17:06:27.418 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:06:27.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8180 - 1,2,3 [ CSSD]2013-05-23 17:06:27.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42d8180) pid(20756/20756) version 11:1:1:4 [ CSSD]2013-05-23 17:06:27.424 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8180), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:06:27.424 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:06:27.424 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:06:27.424 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:06:27.523 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8840 [ CSSD]2013-05-23 17:06:27.523 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8840) con(0x7f82b42cbf30) skgpid ospid 20776 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:27.794 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:28.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(007e002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:28.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:28.354 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:28.838 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:28.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:28.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:30.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:30.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:30.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:31.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(007f002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:31.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:31.163 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:31.163 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:06:31.163 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:31.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0080002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:31.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:31.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:32.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:32.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:32.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:33.357 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:33.357 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:34.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:34.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:34.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:35.837 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:06:35.837 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:06:35.838 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:06:35.838 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42a1760) pid(20842) version 11:1:1:4 [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1760), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:06:35.844 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:35.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:06:35.851 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:06:35.851 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:35.852 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:06:36.054 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:06:36.054 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b41febc0) skgpid ospid 20842 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:36.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:36.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:36.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:37.360 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:37.360 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:06:37.821 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:38.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0081002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:38.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:38.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:38.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:40.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:40.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:40.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:40.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0082002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:40.973 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:40.973 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:40.973 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:06:40.973 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:40.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0083002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:40.981 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:40.981 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:42.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:42.364 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:42.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:42.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:42.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:44.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:44.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:45.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:47.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:47.003 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:47.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:47.367 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:47.368 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:47.846 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:48.412 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0084002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:49.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:49.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:49.039 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:51.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:51.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:51.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:51.088 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:06:51.088 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:06:51.089 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:06:51.089 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42d9290) pid(21000) version 11:1:1:4 [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d9290), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:06:51.095 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:51.103 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:06:51.103 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:06:51.103 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:06:51.103 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:06:51.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:06:51.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42cbf30) skgpid ospid 21000 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:06:52.371 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:52.371 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:06:53.089 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:53.089 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:53.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:55.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:55.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:55.147 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:56.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0085002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:56.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:06:56.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:06:56.229 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:06:56.229 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:06:56.238 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0086002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:56.238 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:06:56.238 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:06:56.374 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:06:56.374 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:06:57.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:57.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:06:57.153 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:57.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:06:58.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0087002d) incarnation(174631051) [ CSSD]2013-05-23 17:06:59.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:06:59.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:06:59.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:01.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:01.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:01.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:01.377 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:01.378 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:03.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:03.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:03.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:05.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:05.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:05.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:06.343 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:07:06.343 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:07:06.344 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:07:06.344 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a1760) pid(21169) version 11:1:1:4 [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1760), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:06.361 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:06.367 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:07:06.367 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:06.367 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:06.368 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:06.381 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:06.381 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:06.570 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:07:06.570 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b42cbf30) skgpid ospid 21169 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:07.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:07.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:07.253 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:07.891 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:08.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0088002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:09.214 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:09.214 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:09.258 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:10.384 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:10.384 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:07:11.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:11.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:11.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:11.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0089002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:11.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:11.496 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:11.496 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:07:11.496 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:11.504 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008a002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:11.504 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:11.504 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:11.731 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:07:11.731 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:07:11.732 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:07:11.732 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42a1760) pid(21294) version 11:1:1:4 [ CSSD]2013-05-23 17:07:13.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:13.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:13.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:13.582 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d38e0) allocated [ CSSD]2013-05-23 17:07:13.583 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:07:13.584 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d38e0 - 1,2,3 [ CSSD]2013-05-23 17:07:13.584 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d38e0) pid(21538) version 11:1:1:4 [ CSSD]2013-05-23 17:07:13.590 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d38e0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:13.590 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:13.590 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:07:13.590 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:13.590 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fd930/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:13.591 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:13.591 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:13.598 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:13.598 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:13.598 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:13.598 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:13.801 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d38e0 [ CSSD]2013-05-23 17:07:13.801 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d38e0) con(0x7f82b427c5d0) skgpid ospid 21538 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:14.405 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:07:14.405 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b41febc0) skgpid ospid 21294 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:15.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:15.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:15.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:15.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:15.387 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:17.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:17.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:17.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:17.913 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:18.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(008b002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:18.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:07:18.760 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:07:18.761 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:07:18.762 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:07:18.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008c002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:18.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:18.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:18.837 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:07:18.837 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:07:18.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008d002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:18.844 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:18.844 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:19.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:19.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:19.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:20.390 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:20.390 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:21.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:21.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:21.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:21.605 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:07:21.606 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:07:21.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:07:21.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a1760) pid(21701) version 11:1:1:4 [ CSSD]2013-05-23 17:07:21.622 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1760), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:07:21.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:07:21.622 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b41febc0, requested num -1 [ CSSD]2013-05-23 17:07:21.622 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:21.622 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:21.623 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:21.623 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:21.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:07:21.629 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:21.629 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:21.629 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:21.831 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:07:21.831 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b42cbf30) skgpid ospid 21701 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:23.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:23.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:23.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:25.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:25.394 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:25.394 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:25.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:25.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:26.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(008e002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:26.747 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:26.747 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:26.747 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:07:26.747 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:26.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(008f002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:26.754 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:26.754 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:27.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:27.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:27.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:27.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:07:27.566 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:07:27.566 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:07:27.566 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42d9290) pid(21772) version 11:1:1:4 [ CSSD]2013-05-23 17:07:27.572 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d9290), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:07:27.572 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:07:27.572 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:07:27.572 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:27.572 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:27.573 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:27.573 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:27.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:07:27.579 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:27.579 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:27.579 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:27.781 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:07:27.781 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b41febc0) skgpid ospid 21772 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:27.941 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:28.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0090002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:29.397 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:29.397 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:07:29.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:29.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:29.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:31.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0091002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:31.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:31.420 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:31.420 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:07:31.420 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:31.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:31.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:31.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0092002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:31.427 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:31.427 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:31.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:33.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:33.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:33.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:34.400 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:34.400 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:35.479 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:35.479 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:35.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:36.864 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:07:36.865 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:07:36.865 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:07:36.866 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42a1760) pid(21848) version 11:1:1:4 [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1760), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:36.873 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:36.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:07:36.881 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:36.881 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:36.881 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:37.083 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:07:37.083 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b41febc0) skgpid ospid 21848 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:37.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:37.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:37.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:37.963 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:38.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0093002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:39.404 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:39.404 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:39.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:39.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:39.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:41.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:41.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:41.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:42.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0094002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:42.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:42.004 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:42.004 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:07:42.004 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:42.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0095002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:42.014 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:42.014 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:43.126 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:07:43.127 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:07:43.127 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:07:43.127 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d9290) pid(21932) version 11:1:1:4 [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d9290), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b41febc0, requested num -1 [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:43.134 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:43.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:07:43.141 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:43.141 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:43.141 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:43.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:07:43.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b427c5d0) skgpid ospid 21932 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:43.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:43.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:43.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:44.407 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:44.407 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:45.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:45.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:45.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:47.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:47.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:47.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:47.984 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:48.410 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:48.410 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:07:48.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0096002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:49.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:49.577 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:49.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:51.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:51.583 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:51.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:52.116 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1760) allocated [ CSSD]2013-05-23 17:07:52.117 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:07:52.117 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1760 - 1,2,3 [ CSSD]2013-05-23 17:07:52.117 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a1760) pid(22003) version 11:1:1:4 [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a1760), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42d9340, requested num -1 [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a8540/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:07:52.124 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:52.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:07:52.131 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:07:52.131 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:07:52.131 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:07:52.333 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1760 [ CSSD]2013-05-23 17:07:52.333 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1760) con(0x7f82b42cbf30) skgpid ospid 22003 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:07:53.413 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:53.414 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:53.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:53.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:53.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:55.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:55.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:55.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:57.272 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0097002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:57.272 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:07:57.272 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:07:57.272 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:07:57.272 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:07:57.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0098002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:57.280 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:07:57.280 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:07:57.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:57.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:57.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:07:58.025 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:07:58.417 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:07:58.417 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:07:58.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0099002d) incarnation(174631051) [ CSSD]2013-05-23 17:07:59.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:07:59.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:07:59.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:01.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:01.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:01.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:03.420 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:03.421 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:03.639 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:08:03.640 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:03.640 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:08:03.640 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d9290) pid(22124/22124) version 11:1:1:4 [ CSSD]2013-05-23 17:08:03.657 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d9290), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:08:03.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:08:03.657 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:08:03.657 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:08:03.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:03.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:03.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:05.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:05.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:05.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:07.366 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c60) allocated [ CSSD]2013-05-23 17:08:07.367 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:08:07.367 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c60 - 1,2,3 [ CSSD]2013-05-23 17:08:07.367 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42d3c60) pid(22152) version 11:1:1:4 [ CSSD]2013-05-23 17:08:07.374 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c60), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:08:07.374 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:08:07.374 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d3b90, requested num -1 [ CSSD]2013-05-23 17:08:07.374 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:07.374 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdc50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:08:07.375 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:07.375 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:07.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:08:07.381 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:08:07.381 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdf50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:07.381 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdf50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:07.423 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:07.423 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:08:07.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c60 [ CSSD]2013-05-23 17:08:07.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c60) con(0x7f82b42cbf30) skgpid ospid 22152 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:07.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:07.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:07.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:08.047 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:08.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(009a002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:09.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:09.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:09.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:11.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:11.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:11.864 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:12.426 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:12.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:12.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009b002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:12.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:08:12.530 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:08:12.530 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:08:12.530 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:12.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009c002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:12.537 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:08:12.537 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:08:13.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:13.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:13.869 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:15.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:15.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:15.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:17.430 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:17.430 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:17.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:17.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:17.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:18.070 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:18.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(009d002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:19.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:19.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:19.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:21.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:21.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:21.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:22.433 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:22.433 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:22.616 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c60) allocated [ CSSD]2013-05-23 17:08:22.617 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:08:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c60 - 1,2,3 [ CSSD]2013-05-23 17:08:22.618 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8300) proc(0x7f82b42d3c60) pid(22301) version 11:1:1:4 [ CSSD]2013-05-23 17:08:22.634 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c60), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:08:22.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:08:22.634 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42d3b90, requested num -1 [ CSSD]2013-05-23 17:08:22.634 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:22.634 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdc50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:08:22.635 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:22.635 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:22.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:08:22.642 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:08:22.642 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdf50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:22.642 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdf50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:22.844 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c60 [ CSSD]2013-05-23 17:08:22.845 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c60) con(0x7f82b42a8300) skgpid ospid 22301 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:23.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:23.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:23.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:25.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:25.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:26.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:26.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:26.436 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:08:27.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(009e002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:27.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:08:27.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:08:27.796 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:08:27.796 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:27.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(009f002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:27.804 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:08:27.804 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:08:27.817 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c60) allocated [ CSSD]2013-05-23 17:08:27.818 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:27.818 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c60 - 1,2,3 [ CSSD]2013-05-23 17:08:27.818 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42d3c60) pid(22381) version 11:1:1:4 [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c60), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a8300, requested num -1 [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdb80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:27.825 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:27.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:08:27.832 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:08:27.832 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fde80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:27.832 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fde80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:27.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:27.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:28.034 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c60 [ CSSD]2013-05-23 17:08:28.034 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c60) con(0x7f82b41febc0) skgpid ospid 22381 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:28.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:28.091 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:28.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a0002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:29.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:29.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:30.059 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:31.440 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:31.440 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:31.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a1002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:31.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:08:31.681 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:08:31.681 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:08:31.681 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:31.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a2002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:31.689 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:08:31.689 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:08:31.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:31.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:32.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:33.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:33.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:34.090 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:35.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:35.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:36.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:36.444 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:36.444 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:37.877 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c60) allocated [ CSSD]2013-05-23 17:08:37.878 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:08:37.879 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c60 - 1,2,3 [ CSSD]2013-05-23 17:08:37.879 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8300) proc(0x7f82b42d3c60) pid(22466) version 11:1:1:4 [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c60), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42d3b90, requested num -1 [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdc50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:37.885 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:37.891 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:08:37.891 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:08:37.891 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fdf50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:37.891 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fdf50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:37.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:37.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:38.094 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c60 [ CSSD]2013-05-23 17:08:38.094 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c60) con(0x7f82b42a8300) skgpid ospid 22466 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:38.117 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:38.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:38.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a3002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:40.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:40.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:40.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:41.070 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5130) allocated [ CSSD]2013-05-23 17:08:41.071 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:41.071 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5130 - 1,2,3 [ CSSD]2013-05-23 17:08:41.071 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4a00) proc(0x7f82b42d5130) pid(22532/22532) version 11:1:1:4 [ CSSD]2013-05-23 17:08:41.077 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d5130), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:08:41.077 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:08:41.077 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:08:41.077 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5130 [ CSSD]2013-05-23 17:08:41.092 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5130) con(0x7f82b42d4a00) skgpid 22532 ospid 22532 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:41.346 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd290) allocated [ CSSD]2013-05-23 17:08:41.347 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:41.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd290 - 1,2,3 [ CSSD]2013-05-23 17:08:41.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b41fd290) pid(22584) version 11:1:1:4 [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd290), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4207960 with con 0x7f82b41fd1c0, requested num -1 [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3860/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:41.356 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:41.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:08:41.363 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:08:41.363 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3b60) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:08:41.363 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42d3b60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:41.447 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:41.448 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:41.469 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caaf0) allocated [ CSSD]2013-05-23 17:08:41.470 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:41.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caaf0 - 1,2,3 [ CSSD]2013-05-23 17:08:41.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd1c0) proc(0x7f82b42caaf0) pid(22597) version 11:1:1:4 [ CSSD]2013-05-23 17:08:41.487 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:08:41.489 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:08:41.490 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:08:41.492 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caaf0 [ CSSD]2013-05-23 17:08:41.492 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caaf0) con(0x7f82b41fd1c0) skgpid ospid 22597 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:41.502 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dbf50) allocated [ CSSD]2013-05-23 17:08:41.502 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:41.503 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dbf50 - 1,2,3 [ CSSD]2013-05-23 17:08:41.503 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd1c0) proc(0x7f82b42dbf50) pid(22582/22582) version 11:1:1:4 [ CSSD]2013-05-23 17:08:41.519 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dbf50), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:08:41.519 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:08:41.519 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:08:41.519 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:08:41.531 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de4d0) allocated [ CSSD]2013-05-23 17:08:41.531 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:08:41.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de4d0 - 1,2,3 [ CSSD]2013-05-23 17:08:41.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcb50) proc(0x7f82b42de4d0) pid(22549) version 11:1:1:4 [ CSSD]2013-05-23 17:08:41.565 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd290 [ CSSD]2013-05-23 17:08:41.565 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd290) con(0x7f82b42cbf30) skgpid ospid 22584 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:42.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:42.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:42.087 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de4d0 [ CSSD]2013-05-23 17:08:42.087 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de4d0) con(0x7f82b42dcb50) skgpid ospid 22549 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:42.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:43.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a4002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:43.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:08:43.056 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:08:43.056 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:08:43.056 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:43.063 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a5002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:43.063 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:08:43.063 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:08:44.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:44.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:44.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:46.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:46.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:46.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:46.451 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:46.451 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:48.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:48.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:48.141 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:48.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:48.764 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a6002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:50.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:50.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:50.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:51.454 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:51.455 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:52.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:52.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:52.295 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:53.128 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd360) allocated [ CSSD]2013-05-23 17:08:53.129 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:08:53.129 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd360 - 1,2,3 [ CSSD]2013-05-23 17:08:53.129 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8300) proc(0x7f82b41fd360) pid(22792) version 11:1:1:4 [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fd360), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b41fcf10, requested num -1 [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc810/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:08:53.136 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:53.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:08:53.143 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:08:53.143 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dcb10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:08:53.143 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dcb10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:08:53.345 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd360 [ CSSD]2013-05-23 17:08:53.345 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd360) con(0x7f82b42a8300) skgpid ospid 22792 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:08:54.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:54.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:54.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:56.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:56.132 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:56.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:56.457 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:08:56.458 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:08:58.167 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:08:58.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:08:58.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:08:58.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00a7002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:58.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:08:58.317 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:08:58.317 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:08:58.317 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:08:58.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00a8002d) incarnation(174631051) [ CSSD]2013-05-23 17:08:58.324 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:08:58.324 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:08:58.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:08:58.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00a9002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:00.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:00.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:00.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:01.460 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:01.461 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:02.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:02.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:02.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:04.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:04.226 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:04.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:05.463 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:05.463 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:09:06.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:06.232 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:06.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:08.197 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:08.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:08.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:08.378 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd360) allocated [ CSSD]2013-05-23 17:09:08.379 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:09:08.379 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd360 - 1,2,3 [ CSSD]2013-05-23 17:09:08.379 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b41fd360) pid(22956) version 11:1:1:4 [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fd360), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dc810/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:08.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:08.393 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:09:08.393 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:09:08.393 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fcd90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:08.393 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fcd90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:08.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:08.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd360 [ CSSD]2013-05-23 17:09:08.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd360) con(0x7f82b41febc0) skgpid ospid 22956 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:08.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00aa002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:10.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:10.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:10.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:10.466 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:10.466 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:12.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:12.296 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:12.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:13.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ab002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:13.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:09:13.588 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:09:13.588 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:09:13.588 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:13.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ac002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:13.595 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:09:13.595 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:09:14.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:14.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:14.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:15.032 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c92b0) allocated [ CSSD]2013-05-23 17:09:15.033 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:09:15.033 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c92b0 - 1,2,3 [ CSSD]2013-05-23 17:09:15.033 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc2a0) proc(0x7f82b42c92b0) pid(22849/22849) version 11:1:1:4 [ CSSD]2013-05-23 17:09:15.039 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:09:15.039 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:09:15.039 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:09:15.039 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:09:15.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:15.468 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:16.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:16.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:16.485 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:18.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:18.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:18.405 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:18.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:18.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ad002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:20.411 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:20.411 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:20.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:20.471 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:20.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:22.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:22.417 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:22.507 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:23.628 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de5d0) allocated [ CSSD]2013-05-23 17:09:23.629 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:09:23.629 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de5d0 - 1,2,3 [ CSSD]2013-05-23 17:09:23.629 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcc50) proc(0x7f82b42de5d0) pid(23093) version 11:1:1:4 [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de5d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42de4f0, requested num -1 [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42df720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:23.636 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:23.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:23.642 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:09:23.643 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:23.643 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:23.845 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de5d0 [ CSSD]2013-05-23 17:09:23.845 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de5d0) con(0x7f82b42dcc50) skgpid ospid 23093 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:24.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:24.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:24.559 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:25.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:25.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:26.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:26.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:26.565 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:28.078 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de5d0) allocated [ CSSD]2013-05-23 17:09:28.079 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:09:28.080 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de5d0 - 1,2,3 [ CSSD]2013-05-23 17:09:28.080 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcc50) proc(0x7f82b42de5d0) pid(23159) version 11:1:1:4 [ CSSD]2013-05-23 17:09:28.097 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de5d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:28.097 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:28.097 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42de4f0, requested num -1 [ CSSD]2013-05-23 17:09:28.097 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:28.097 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42df720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:09:28.098 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:28.098 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:28.105 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:28.105 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:09:28.105 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:28.105 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:28.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e1450) allocated [ CSSD]2013-05-23 17:09:28.240 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:09:28.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e1450 - 1,2,3 [ CSSD]2013-05-23 17:09:28.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42df730) proc(0x7f82b42e1450) pid(23168) version 11:1:1:4 [ CSSD]2013-05-23 17:09:28.247 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:28.308 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de5d0 [ CSSD]2013-05-23 17:09:28.308 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de5d0) con(0x7f82b42dcc50) skgpid ospid 23159 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:28.368 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dddf0) allocated [ CSSD]2013-05-23 17:09:28.369 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:09:28.370 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dddf0 - 1,2,3 [ CSSD]2013-05-23 17:09:28.370 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42dddf0) pid(23180) version 11:1:1:4 [ CSSD]2013-05-23 17:09:28.397 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:09:28.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:09:28.402 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dddf0 [ CSSD]2013-05-23 17:09:28.402 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dddf0) con(0x7f82b41febc0) skgpid ospid 23180 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:28.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:28.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:28.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5354/0x7f82b4207960) [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5354 (0x7f82b4207960) [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207960 with con 0x7f82b41fcfe0, requested num -1 [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42de780/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:28.571 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:09:28.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5354 (0x7f82b4207960) [ CSSD]2013-05-23 17:09:28.578 [1199044928] >TRACE: clssgmExitGrock: client 5354 (0x7f82b4207960), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:09:28.578 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de630) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:09:28.579 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42de630) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:28.580 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e1450 [ CSSD]2013-05-23 17:09:28.580 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e1450) con(0x7f82b42df730) skgpid ospid 23168 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:28.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ae002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:28.842 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:09:28.842 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:09:28.842 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:09:28.842 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:28.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00af002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:28.850 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:09:28.850 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:09:28.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b0002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:29.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:29.477 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:09:30.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:30.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:30.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:31.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b1002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:31.935 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:09:31.935 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:09:31.935 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:09:31.936 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:31.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b2002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:31.942 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:09:31.942 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:09:32.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:32.508 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:32.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:34.480 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:34.480 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:34.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:34.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:34.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:36.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:36.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:36.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:38.279 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:38.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:38.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:38.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:38.882 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de570) allocated [ CSSD]2013-05-23 17:09:38.883 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:09:38.884 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de570 - 1,2,3 [ CSSD]2013-05-23 17:09:38.884 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcbf0) proc(0x7f82b42de570) pid(23266) version 11:1:1:4 [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de570), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42de490, requested num -1 [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42df660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:38.890 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:38.897 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:09:38.897 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:09:38.897 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42df960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:38.897 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42df960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:38.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b3002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:39.100 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de570 [ CSSD]2013-05-23 17:09:39.100 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de570) con(0x7f82b42dcbf0) skgpid ospid 23266 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:39.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:39.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:40.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:40.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:40.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:42.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:42.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:42.687 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:44.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b4002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:44.109 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:09:44.109 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:09:44.109 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:09:44.109 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:44.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b5002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:44.117 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:09:44.117 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:09:44.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:44.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:44.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:44.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:44.700 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:46.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:46.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:46.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:48.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:48.488 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:48.489 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:09:48.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:48.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:48.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:48.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b6002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:50.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:50.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:50.763 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:52.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:52.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:52.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:53.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:53.492 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:54.132 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de5d0) allocated [ CSSD]2013-05-23 17:09:54.133 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:09:54.133 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de5d0 - 1,2,3 [ CSSD]2013-05-23 17:09:54.133 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dcc50) proc(0x7f82b42de5d0) pid(23417) version 11:1:1:4 [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de5d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42de4f0, requested num -1 [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42df720/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:09:54.139 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:54.146 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:09:54.146 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:09:54.146 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:09:54.146 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:09:54.348 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de5d0 [ CSSD]2013-05-23 17:09:54.349 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de5d0) con(0x7f82b42dcc50) skgpid ospid 23417 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:09:54.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:54.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:54.780 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:56.647 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:56.647 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:56.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:58.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:09:58.495 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:09:58.496 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:09:58.697 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:09:58.697 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:09:58.811 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:09:58.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00b7002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:59.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00b8002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:59.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:09:59.360 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:09:59.360 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:09:59.360 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:09:59.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00b9002d) incarnation(174631051) [ CSSD]2013-05-23 17:09:59.368 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:09:59.368 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:00.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:00.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:00.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:02.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:02.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:02.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:03.499 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:03.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:04.432 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de4c0) allocated [ CSSD]2013-05-23 17:10:04.433 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:10:04.433 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de4c0 - 1,2,3 [ CSSD]2013-05-23 17:10:04.433 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42de4c0) pid(23731/23731) version 11:1:1:4 [ CSSD]2013-05-23 17:10:04.450 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de4c0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:10:04.450 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:10:04.450 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:10:04.450 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 17:10:04.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:04.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de4c0 [ CSSD]2013-05-23 17:10:04.724 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de4c0) con(0x7f82b41febc0) skgpid 23731 ospid 23731 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:04.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:06.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:06.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:06.905 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:07.501 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:07.501 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:10:07.725 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42c92b0), client(2/0x7f82b4207960) [ CSSD]2013-05-23 17:10:07.725 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 17:10:07.725 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:10:07.725 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 17:10:08.346 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:08.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:08.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:08.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:08.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ba002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:09.382 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df330) allocated [ CSSD]2013-05-23 17:10:09.383 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:10:09.383 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df330 - 1,2,3 [ CSSD]2013-05-23 17:10:09.383 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42df330) pid(23778) version 11:1:1:4 [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42df330), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42df250, requested num -1 [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfa60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:10:09.389 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:09.396 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:09.396 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:10:09.396 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dfd60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:09.396 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dfd60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:10:09.598 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df330 [ CSSD]2013-05-23 17:10:09.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df330) con(0x7f82b42cbf30) skgpid ospid 23778 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:10.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:10.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:10.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:12.504 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:12.504 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:12.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:12.810 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:12.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:14.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00bb002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:14.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:10:14.613 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:10:14.613 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:10:14.613 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:14.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00bc002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:14.620 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:10:14.620 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:14.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:14.820 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:14.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:16.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:16.826 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:16.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:17.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:17.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:18.380 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:18.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:18.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:18.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:18.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00bd002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:10:19.960 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid 18375 ospid 18375 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:20.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:20.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:20.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:22.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:22.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:22.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:22.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:23.001 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:24.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:10:24.643 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:10:24.643 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:10:24.643 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42a5440) pid(23947) version 11:1:1:4 [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:10:24.650 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:24.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:10:24.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:10:24.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:24.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:10:24.860 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:10:24.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41febc0) skgpid ospid 23947 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:24.903 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:24.903 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:25.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:26.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:26.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:27.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:27.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:27.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:28.357 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:10:28.358 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:10:28.359 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:10:28.359 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(24012) version 11:1:1:4 [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:10:28.366 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:28.373 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:10:28.373 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:10:28.373 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:28.373 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:10:28.403 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:28.576 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:10:28.576 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid ospid 24012 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:28.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:28.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:29.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00be002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:29.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:29.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00bf002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:29.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:10:29.876 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:10:29.876 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:10:29.876 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:29.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c0002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:29.885 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:10:29.885 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:31.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:31.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:31.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:32.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c1002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:32.202 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:10:32.202 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:10:32.202 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:10:32.202 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:32.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c2002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:32.209 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:10:32.209 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:32.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:32.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:33.081 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:33.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:33.097 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:35.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:35.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:35.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:37.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:37.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:37.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:37.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:37.521 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:38.423 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:39.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c3002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:39.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:39.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:39.200 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:39.900 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:10:39.901 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:10:39.901 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:10:39.901 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41febc0) proc(0x7f82b42a5440) pid(24100) version 11:1:1:4 [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:10:39.908 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:39.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:10:39.915 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:10:39.915 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:39.916 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:10:40.118 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:10:40.118 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b41febc0) skgpid ospid 24100 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:41.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:41.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:41.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:42.525 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:42.525 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:43.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:43.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:43.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:45.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c4002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:45.133 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:10:45.133 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:10:45.133 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:10:45.133 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:45.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c5002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:45.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:10:45.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:45.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:45.325 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:45.325 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:46.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:46.528 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:10:47.279 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:47.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:47.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:48.444 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:49.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c6002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:49.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:49.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:49.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:51.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:51.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:51.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:51.532 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:51.532 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:53.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:53.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:53.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:55.152 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:10:55.153 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:10:55.154 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:10:55.154 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a5440) pid(24252) version 11:1:1:4 [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42c80f0, requested num -1 [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:10:55.160 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:55.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:10:55.167 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:10:55.167 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:10:55.167 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:10:55.370 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:10:55.370 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42cbf30) skgpid ospid 24252 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:10:55.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:55.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:55.415 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:56.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:10:56.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:10:57.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:57.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:57.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:10:58.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00c7002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:58.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:10:58.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:10:58.381 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:10:58.381 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:10:58.388 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00c8002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:58.388 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:10:58.388 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:10:58.483 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:10:59.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00c9002d) incarnation(174631051) [ CSSD]2013-05-23 17:10:59.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:10:59.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:10:59.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:00.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ca002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:00.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:00.385 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:00.386 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:11:00.386 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:00.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00cb002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:00.393 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:00.393 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:00.539 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:00.539 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:11:01.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:01.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:01.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:03.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:03.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:03.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:05.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:05.456 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:05.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:05.542 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:05.542 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:07.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:07.462 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:07.481 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:08.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:09.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cc002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:09.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:09.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:09.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:10.403 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:11:10.404 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:11:10.404 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:11:10.404 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(24400) version 11:1:1:4 [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b41febc0, requested num -1 [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dcd80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:11:10.411 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:10.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:11:10.418 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:11:10.418 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:10.418 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:11:10.545 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:10.546 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:10.621 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:11:10.621 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid ospid 24400 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:11.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:11.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:11.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:13.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:13.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:13.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:15.377 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:11:15.378 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:11:15.378 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:11:15.378 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c80f0) proc(0x7f82b42a5440) pid(24486/24486) version 11:1:1:4 [ CSSD]2013-05-23 17:11:15.384 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42a5440), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:11:15.384 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:11:15.384 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:11:15.384 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:11:15.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:11:15.402 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:11:15.402 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:11:15.403 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:11:15.403 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:11:15.403 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42c80f0) skgpid 24486 ospid 24486 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:15.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:15.549 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:15.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:15.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:15.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:15.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00cd002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:15.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:15.646 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:15.646 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:11:15.646 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:15.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ce002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:15.654 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:15.655 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dbf50 [ CSSD]2013-05-23 17:11:17.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dbf50) con(0x7f82b41fd1c0) skgpid 22582 ospid 22582 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:17.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:17.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:17.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:18.541 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:19.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00cf002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:19.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:19.552 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:11:19.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:19.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:19.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:20.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d0002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:20.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:20.311 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:20.311 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:11:20.311 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:20.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d1002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:20.319 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:20.319 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:20.453 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:11:20.453 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:11:20.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:11:20.455 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:11:21.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:21.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:21.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:23.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:23.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:23.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:24.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:24.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:11:24.575 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid 19186 ospid 19186 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:11:24.583 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b427d8a0) skgpid 19184 ospid 19184 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:25.646 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:25.654 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:11:25.655 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:11:25.656 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:11:25.656 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(24579) version 11:1:1:4 [ CSSD]2013-05-23 17:11:25.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:25.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:25.662 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a5440), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:11:25.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:11:25.662 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:11:25.662 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:25.662 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dbbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:11:25.663 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:11:25.663 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:25.669 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:11:25.669 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:11:25.669 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:25.669 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:11:25.871 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:11:25.871 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 24579 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:27.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:27.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:27.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:28.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:28.614 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:11:28.615 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:11:28.615 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:11:28.615 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(24642) version 11:1:1:4 [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b41febc0, requested num -1 [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dbbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:11:28.622 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:28.630 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:11:28.630 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:11:28.630 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:28.630 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:11:28.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:11:28.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 24642 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:29.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d2002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:29.560 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:29.560 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:29.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:29.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:29.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:30.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d3002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:30.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:30.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:30.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:11:30.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:30.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d4002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:30.900 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:30.900 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:31.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:31.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:31.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:32.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d5002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:32.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:32.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:32.468 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:11:32.468 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:32.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d6002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:32.476 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:32.476 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:32.592 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:11:32.593 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:11:32.594 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:11:32.594 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ae300) pid(24571/24571) version 11:1:1:4 [ CSSD]2013-05-23 17:11:32.600 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ae300), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:11:32.600 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:11:32.600 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:11:32.600 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:11:33.695 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:33.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:33.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:34.563 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:34.563 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:35.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:35.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:35.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:37.731 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:37.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:37.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:38.566 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:38.566 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:11:38.589 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:39.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00d7002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:39.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:39.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:39.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:40.907 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:11:40.908 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:11:40.909 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:11:40.909 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a5440) pid(24740) version 11:1:1:4 [ CSSD]2013-05-23 17:11:40.915 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:11:40.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:11:40.915 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:11:40.915 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:40.915 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dbbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:11:40.916 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:11:40.916 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:40.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:11:40.922 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:11:40.922 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:40.923 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:11:41.125 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:11:41.125 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b4257120) skgpid ospid 24740 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:41.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:41.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:41.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:43.570 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:43.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:43.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:43.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:43.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:45.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:45.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:45.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:46.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00d8002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:46.152 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:11:46.152 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:11:46.152 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:11:46.152 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:46.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00d9002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:46.160 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:11:46.160 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:11:47.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:47.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:47.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:48.573 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:48.574 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:48.616 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:49.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00da002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:49.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:49.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:49.915 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:51.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:51.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:51.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:52.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:52.577 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:11:53.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:53.932 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:53.932 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:55.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:55.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:55.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:56.159 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:11:56.160 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:11:56.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:11:56.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(24877) version 11:1:1:4 [ CSSD]2013-05-23 17:11:56.166 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:11:56.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:11:56.166 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:11:56.166 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:56.166 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dbbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:11:56.167 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:11:56.167 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:11:56.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:11:56.173 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:11:56.173 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:11:56.173 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:11:56.376 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:11:56.376 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 24877 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:11:57.580 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:11:57.580 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:11:57.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:11:57.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:57.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:58.641 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:11:59.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00db002d) incarnation(174631051) [ CSSD]2013-05-23 17:11:59.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:11:59.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:11:59.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:01.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00dc002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:01.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:01.424 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:01.424 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:01.424 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:01.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00dd002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:01.431 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:01.431 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:01.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:01.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:01.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:02.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:02.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:04.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:04.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:04.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:06.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:06.019 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:06.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:07.587 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:07.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:08.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:08.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:08.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:08.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00de002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:08.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:08.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:08.441 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:08.441 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:08.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00df002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:08.448 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:08.448 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:08.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:09.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e0002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:10.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:10.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:10.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:11.181 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 17:12:11.182 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:12:11.182 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 17:12:11.182 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(25066) version 11:1:1:4 [ CSSD]2013-05-23 17:12:11.418 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:12:11.419 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:12:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:12:11.419 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a41c0) proc(0x7f82b4207a80) pid(25118) version 11:1:1:4 [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42cbe70, requested num -1 [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dbbd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:12:11.425 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:11.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:12:11.431 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:12:11.431 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42af3a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:11.431 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42af3a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:12:11.634 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:12:11.634 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a41c0) skgpid ospid 25118 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:12.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:12.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:12.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:12.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:12.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:13.680 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 17:12:13.681 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 25066 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:14.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:14.062 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:14.096 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:16.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:16.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:16.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:16.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e1002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:16.676 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:16.676 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:16.676 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:16.676 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:16.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e2002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:16.684 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:16.684 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:17.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:17.593 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:18.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:18.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:18.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:18.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:19.080 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:12:19.081 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:12:19.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:12:19.083 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:12:19.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e3002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:19.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:19.155 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:19.155 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:12:19.155 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:12:19.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e4002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:19.162 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:19.162 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:19.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e5002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:20.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:20.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:20.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:22.131 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:22.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:22.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:22.150 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ae300), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:12:22.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:12:22.150 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:12:22.150 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 17:12:22.167 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:12:22.168 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:12:22.169 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:12:22.169 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(24569/24569) version 11:1:1:4 [ CSSD]2013-05-23 17:12:22.185 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:12:22.185 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:12:22.185 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:12:22.185 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:12:22.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:22.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:24.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:24.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:24.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:26.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:26.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:26.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:26.671 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd4d0) allocated [ CSSD]2013-05-23 17:12:26.672 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:12:26.672 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd4d0 - 1,2,3 [ CSSD]2013-05-23 17:12:26.672 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b41fd4d0) pid(25511) version 11:1:1:4 [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd4d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42dc990, requested num -1 [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:12:26.678 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:26.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:12:26.684 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:12:26.684 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:26.685 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:12:26.887 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd4d0 [ CSSD]2013-05-23 17:12:26.887 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd4d0) con(0x7f82b4207cd0) skgpid ospid 25511 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:27.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:27.600 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:28.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:28.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:28.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:28.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:28.880 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd4d0) allocated [ CSSD]2013-05-23 17:12:28.881 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:12:28.881 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd4d0 - 1,2,3 [ CSSD]2013-05-23 17:12:28.881 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207c10) proc(0x7f82b41fd4d0) pid(25572) version 11:1:1:4 [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd4d0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42dc990, requested num -1 [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:12:28.887 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:28.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:28.894 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:12:28.894 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dc810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:28.894 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dc810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:12:29.096 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd4d0 [ CSSD]2013-05-23 17:12:29.096 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd4d0) con(0x7f82b4207c10) skgpid ospid 25572 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:29.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00e6002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:30.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:30.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:30.248 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:31.603 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:31.603 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:12:31.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e7002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:31.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:31.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:31.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:31.928 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:31.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00e8002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:31.936 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:31.936 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:32.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:32.254 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:32.254 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:32.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00e9002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:32.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:32.741 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:32.741 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:32.741 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:32.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ea002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:32.748 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:32.748 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:34.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:34.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:34.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:36.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:36.270 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:36.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:36.606 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:36.606 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:38.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:38.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:38.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:38.731 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:39.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00eb002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:40.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:40.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:40.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:41.609 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:41.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:41.919 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd160) allocated [ CSSD]2013-05-23 17:12:41.920 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:12:41.920 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd160 - 1,2,3 [ CSSD]2013-05-23 17:12:41.920 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a2930) proc(0x7f82b41fd160) pid(25681) version 11:1:1:4 [ CSSD]2013-05-23 17:12:41.937 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd160), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:12:41.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:12:41.937 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42dc810, requested num -1 [ CSSD]2013-05-23 17:12:41.937 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:41.937 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:12:41.938 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:12:41.938 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:41.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:12:41.945 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:12:41.945 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:41.945 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:12:42.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd160 [ CSSD]2013-05-23 17:12:42.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd160) con(0x7f82b42a2930) skgpid ospid 25681 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:42.333 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:42.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:42.335 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:44.345 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:44.345 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:44.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:46.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:46.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:46.360 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:46.613 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:46.613 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:47.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00ec002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:47.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:12:47.186 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:12:47.186 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:12:47.186 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:47.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00ed002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:47.194 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:12:47.194 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:12:48.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:48.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:48.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:48.752 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:49.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ee002d) incarnation(174631051) [ CSSD]2013-05-23 17:12:50.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:50.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:50.377 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:50.616 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:50.616 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:12:52.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:52.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:52.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:54.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:54.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:54.425 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:55.620 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:12:55.620 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:12:56.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:56.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:56.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:57.189 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd160) allocated [ CSSD]2013-05-23 17:12:57.190 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:12:57.191 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd160 - 1,2,3 [ CSSD]2013-05-23 17:12:57.191 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbe70) proc(0x7f82b41fd160) pid(25847) version 11:1:1:4 [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd160), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42dc810, requested num -1 [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d1e80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:12:57.198 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:12:57.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:12:57.206 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:12:57.206 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd5a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:12:57.206 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd5a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:12:57.409 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd160 [ CSSD]2013-05-23 17:12:57.409 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd160) con(0x7f82b42cbe70) skgpid ospid 25847 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:12:57.815 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd160) allocated [ CSSD]2013-05-23 17:12:57.815 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:12:57.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd160 - 1,2,3 [ CSSD]2013-05-23 17:12:57.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b41fd160) pid(25798/25798) version 11:1:1:4 [ CSSD]2013-05-23 17:12:57.822 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd160), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:12:57.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:12:57.822 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:12:57.822 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:12:58.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:12:58.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:12:58.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:12:58.773 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:12:59.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ef002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:00.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:00.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:00.530 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:00.623 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:00.624 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:02.438 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f0002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:02.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:13:02.438 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:13:02.438 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:13:02.438 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:02.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f1002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:02.447 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:13:02.447 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:13:02.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:02.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:02.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:13:03.670 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b427c5d0) skgpid 22124 ospid 22124 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:04.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:04.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:04.546 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:05.627 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:05.628 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:06.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:06.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:06.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:08.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:08.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:08.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:08.795 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:09.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f2002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:09.631 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:09.631 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:13:10.548 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:10.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:10.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:12.442 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 17:13:12.443 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:13:12.443 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 17:13:12.443 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d91c0) pid(26024) version 11:1:1:4 [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d91c0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:12.449 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:12.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:13:12.456 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:13:12.456 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:12.456 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:12.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:12.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:12.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:12.659 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 17:13:12.659 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b42c6340) skgpid ospid 26024 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:14.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:14.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:14.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:14.634 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:14.634 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:16.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:16.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:16.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:17.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f3002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:17.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:13:17.694 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:13:17.694 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:13:17.694 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:17.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f4002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:17.700 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:13:17.700 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:13:18.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:18.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:18.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:18.816 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:19.457 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f5002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:19.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:19.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:20.648 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:20.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:20.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:22.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:22.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:22.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:24.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:24.641 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:24.706 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:24.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:24.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:26.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:26.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:26.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:27.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 17:13:27.692 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:13:27.693 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 17:13:27.693 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42d91c0) pid(26187) version 11:1:1:4 [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d91c0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:27.699 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:27.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:13:27.706 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:13:27.706 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:27.706 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:27.908 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 17:13:27.908 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b42a29f0) skgpid ospid 26187 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:28.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:28.643 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:13:28.718 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:28.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:28.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:28.837 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:29.132 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 17:13:29.133 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:29.133 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 17:13:29.133 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d91c0) pid(26236) version 11:1:1:4 [ CSSD]2013-05-23 17:13:29.140 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d91c0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:13:29.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:13:29.140 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:13:29.141 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:29.141 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:13:29.141 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:29.141 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:29.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:13:29.148 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:13:29.148 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:29.148 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:29.351 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 17:13:29.351 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b427c5d0) skgpid ospid 26236 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:29.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00f6002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:30.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:30.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:30.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:32.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:32.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:32.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:32.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f7002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:32.949 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:13:32.949 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:13:32.949 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:13:32.949 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:32.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00f8002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:32.956 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:13:32.956 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:13:33.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00f9002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:33.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:13:33.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:13:33.003 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:13:33.003 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:33.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fa002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:33.011 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:13:33.011 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:13:33.647 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:33.647 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:34.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:34.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:34.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:36.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:36.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:36.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:38.650 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:38.651 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:38.819 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:38.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:38.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:38.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:39.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fb002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:40.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:40.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:40.862 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:40.994 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d91c0) allocated [ CSSD]2013-05-23 17:13:40.995 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:40.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d91c0 - 1,2,3 [ CSSD]2013-05-23 17:13:40.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42d91c0) pid(26342) version 11:1:1:4 [ CSSD]2013-05-23 17:13:41.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d91c0 [ CSSD]2013-05-23 17:13:41.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d91c0) con(0x7f82b42a29f0) skgpid ospid 26342 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:41.644 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427d410) allocated [ CSSD]2013-05-23 17:13:41.644 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:41.645 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427d410 - 1,2,3 [ CSSD]2013-05-23 17:13:41.645 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b427d410) pid(26443) version 11:1:1:4 [ CSSD]2013-05-23 17:13:41.651 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b427d410), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42cbf40 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:41.652 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:41.658 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:13:41.658 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:13:41.658 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:13:41.658 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:41.765 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cacb0) allocated [ CSSD]2013-05-23 17:13:41.765 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:41.766 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cacb0 - 1,2,3 [ CSSD]2013-05-23 17:13:41.766 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42cacb0) pid(26448) version 11:1:1:4 [ CSSD]2013-05-23 17:13:41.782 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:13:41.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:13:41.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:13:41.787 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cacb0 [ CSSD]2013-05-23 17:13:41.787 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cacb0) con(0x7f82b42a29f0) skgpid ospid 26448 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:41.861 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427d410 [ CSSD]2013-05-23 17:13:41.861 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427d410) con(0x7f82b427c5d0) skgpid ospid 26443 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:42.653 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:42.654 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:13:42.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:42.868 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:42.868 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:42.944 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 17:13:42.945 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:13:42.945 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 17:13:42.945 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a1690) pid(26513) version 11:1:1:4 [ CSSD]2013-05-23 17:13:42.951 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:13:42.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:13:42.951 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b427c5d0, requested num -1 [ CSSD]2013-05-23 17:13:42.951 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:42.951 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:13:42.952 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:42.952 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:42.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:13:42.958 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:13:42.958 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d0090) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:42.958 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d0090) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:43.160 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 17:13:43.160 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42c6340) skgpid ospid 26513 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:44.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:44.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:44.907 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:46.284 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a1690) allocated [ CSSD]2013-05-23 17:13:46.284 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:46.285 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a1690 - 1,2,3 [ CSSD]2013-05-23 17:13:46.285 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a1690) pid(26581/26581) version 11:1:1:4 [ CSSD]2013-05-23 17:13:46.301 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a1690), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:13:46.301 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:13:46.301 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:13:46.301 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:13:46.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:46.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:46.913 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:47.657 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:47.657 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:48.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(00fc002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:48.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:13:48.198 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:13:48.198 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:13:48.198 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:48.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(00fd002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:48.206 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:13:48.206 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:13:48.886 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:48.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:48.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:48.935 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:49.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00fe002d) incarnation(174631051) [ CSSD]2013-05-23 17:13:50.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:50.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:50.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:52.070 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fd160), client(2/0x7f82b42cbf40) [ CSSD]2013-05-23 17:13:52.070 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:13:52.070 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:13:52.070 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 17:13:52.661 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:52.661 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:52.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:52.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:52.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8180 [ CSSD]2013-05-23 17:13:54.599 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8180) con(0x7f82b42a3f90) skgpid 20756 ospid 20756 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:54.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:54.960 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:55.008 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:55.363 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8180) allocated [ CSSD]2013-05-23 17:13:55.364 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:13:55.364 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8180 - 1,2,3 [ CSSD]2013-05-23 17:13:55.364 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42d8180) pid(26657/26657) version 11:1:1:4 [ CSSD]2013-05-23 17:13:55.370 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8180), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:13:55.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:13:55.370 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:13:55.370 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:13:56.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:56.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:57.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:57.664 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:13:57.664 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:13:58.204 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:13:58.205 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:13:58.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:13:58.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5c0) proc(0x7f82b42dcd80) pid(26677) version 11:1:1:4 [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a90a0 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:13:58.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:13:58.218 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:13:58.218 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a90a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:13:58.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:13:58.219 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:13:58.421 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:13:58.421 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5c0) skgpid ospid 26677 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:13:58.919 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:13:58.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:13:58.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:13:59.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:13:59.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(00ff002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:00.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:00.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:01.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:01.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:01.668 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:14:03.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:03.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:03.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:03.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0100002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:03.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:14:03.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:14:03.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:14:03.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:03.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0101002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:03.460 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:14:03.461 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:14:05.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:05.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:05.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:06.671 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:06.671 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:07.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:07.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:07.114 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:08.943 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:09.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:09.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:09.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:09.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0102002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:11.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:11.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:11.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:11.674 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:11.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:13.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:13.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:13.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:13.455 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:14:13.456 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:14:13.456 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:14:13.456 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5e0) proc(0x7f82b42dcd80) pid(26830) version 11:1:1:4 [ CSSD]2013-05-23 17:14:13.462 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:14:13.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:14:13.462 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:14:13.462 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:13.462 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd510/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:14:13.463 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:13.463 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:13.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:14:13.470 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:14:13.470 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:13.470 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:13.672 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:14:13.672 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5e0) skgpid ospid 26830 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:15.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:15.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:15.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:16.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:16.678 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:17.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:17.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:17.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:18.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0103002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:18.705 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:14:18.705 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:14:18.705 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:14:18.705 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:18.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0104002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:18.713 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:14:18.713 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:14:18.965 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:19.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:19.137 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:19.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:19.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0105002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:20.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:20.681 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:14:21.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:21.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:21.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:23.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:23.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:23.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:25.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:25.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:25.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:25.684 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:25.685 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:27.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:27.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:27.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:28.655 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea00) allocated [ CSSD]2013-05-23 17:14:28.656 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:14:28.657 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea00 - 1,2,3 [ CSSD]2013-05-23 17:14:28.657 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b41fea00) pid(26994) version 11:1:1:4 [ CSSD]2013-05-23 17:14:28.705 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de3f0) allocated [ CSSD]2013-05-23 17:14:28.706 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:14:28.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de3f0 - 1,2,3 [ CSSD]2013-05-23 17:14:28.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd510) proc(0x7f82b42de3f0) pid(27006) version 11:1:1:4 [ CSSD]2013-05-23 17:14:28.712 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42de3f0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:14:28.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:14:28.713 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42de310, requested num -1 [ CSSD]2013-05-23 17:14:28.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:28.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0030/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:14:28.713 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:28.713 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:28.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:14:28.719 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:14:28.719 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0330) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:28.719 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0330) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:28.788 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e1380) allocated [ CSSD]2013-05-23 17:14:28.789 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:14:28.789 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e1380 - 1,2,3 [ CSSD]2013-05-23 17:14:28.789 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42e0030) proc(0x7f82b42e1380) pid(27010) version 11:1:1:4 [ CSSD]2013-05-23 17:14:28.810 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:14:28.812 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:14:28.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e1380 [ CSSD]2013-05-23 17:14:28.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e1380) con(0x7f82b42e0030) skgpid ospid 27010 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:28.922 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de3f0 [ CSSD]2013-05-23 17:14:28.922 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de3f0) con(0x7f82b42dd510) skgpid ospid 27006 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5355/0x7f82b42cd480) [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5355 (0x7f82b42cd480) [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cd480 with con 0x7f82b42dcfd0, requested num -1 [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42e0b90/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:28.979 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:14:28.986 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5355 (0x7f82b42cd480) [ CSSD]2013-05-23 17:14:28.986 [1199044928] >TRACE: clssgmExitGrock: client 5355 (0x7f82b42cd480), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:14:28.986 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0e90) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:14:28.986 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42e0e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:28.987 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:28.987 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea00 [ CSSD]2013-05-23 17:14:28.988 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea00) con(0x7f82b42a3f90) skgpid ospid 26994 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:29.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:29.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:29.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:29.390 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea20) allocated [ CSSD]2013-05-23 17:14:29.391 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:14:29.391 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea20 - 1,2,3 [ CSSD]2013-05-23 17:14:29.391 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fea20) pid(27058) version 11:1:1:4 [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b41fea20), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b42dcdc0, requested num -1 [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:29.398 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:29.404 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:14:29.404 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:14:29.404 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:29.405 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:29.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea20 [ CSSD]2013-05-23 17:14:29.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea20) con(0x7f82b427c5d0) skgpid ospid 27058 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:29.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0106002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:30.688 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:30.688 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:31.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:31.263 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:31.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:33.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0107002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:33.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:14:33.267 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:14:33.267 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:14:33.267 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:33.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0108002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:33.274 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:14:33.274 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:14:33.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:33.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:33.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:33.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0109002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:33.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:14:33.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:14:33.963 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:14:33.963 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:33.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010a002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:33.970 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:14:33.970 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:14:35.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:35.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:35.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:35.692 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:35.692 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:37.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:37.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:37.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:39.009 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:39.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:39.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:39.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:39.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010b002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:40.695 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:40.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:41.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:41.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:41.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:43.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:43.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:43.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:43.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:14:43.961 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:14:43.961 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:14:43.961 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5c0) proc(0x7f82b42dcd80) pid(27176) version 11:1:1:4 [ CSSD]2013-05-23 17:14:43.977 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:14:43.977 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:14:43.977 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:14:43.978 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:43.978 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:14:43.978 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:43.978 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:43.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:14:43.985 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:14:43.985 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:43.985 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:44.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:14:44.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5c0) skgpid ospid 27176 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:45.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:45.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:45.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:45.699 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:45.699 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:47.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:47.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:47.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:49.029 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:49.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(010c002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:49.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:14:49.229 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:14:49.229 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:14:49.229 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:49.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(010d002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:49.235 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:14:49.235 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:14:49.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:49.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:49.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:49.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010e002d) incarnation(174631051) [ CSSD]2013-05-23 17:14:50.702 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:50.702 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:51.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:51.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:51.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:53.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:53.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:53.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:54.704 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:54.705 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:14:55.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:55.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:55.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:57.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:57.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:57.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:59.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:14:59.220 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:14:59.221 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:14:59.222 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:14:59.222 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5e0) proc(0x7f82b42dcd80) pid(27314) version 11:1:1:4 [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd510/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:14:59.228 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:14:59.235 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:14:59.235 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:14:59.235 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd810) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:14:59.235 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:14:59.438 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:14:59.438 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5e0) skgpid ospid 27314 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:14:59.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:14:59.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:14:59.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:14:59.708 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:14:59.708 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:14:59.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(010f002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:01.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:01.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:01.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:03.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:03.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:03.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:04.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0110002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:04.484 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:15:04.484 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:15:04.484 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:15:04.484 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:04.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0111002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:04.492 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:15:04.492 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:15:04.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:04.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:04.891 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:15:04.892 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:15:04.892 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:15:04.892 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42dcd80) pid(27414/27414) version 11:1:1:4 [ CSSD]2013-05-23 17:15:04.909 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:04.909 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:04.909 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:15:04.909 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:15:05.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:05.186 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b59e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:15:05.186 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b59e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:15:05.187 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:15:05.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:15:05.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b42a3f90) skgpid 27414 ospid 27414 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:05.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:05.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:05.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:07.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:07.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:07.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:09.074 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:09.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:09.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:09.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:09.715 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:09.715 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:09.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0112002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:11.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:11.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:11.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:13.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:13.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:13.689 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:14.471 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:15:14.471 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:15:14.472 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:15:14.472 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5c0) proc(0x7f82b42dcd80) pid(27472) version 11:1:1:4 [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd4f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:15:14.478 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:14.485 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:15:14.485 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:15:14.485 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd7f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:14.485 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd7f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:15:14.688 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:15:14.688 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5c0) skgpid ospid 27472 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:14.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:14.718 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:15.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:15.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:15.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:17.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:17.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:17.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:19.095 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:19.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:19.691 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:19.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:19.721 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:19.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:19.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0113002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:19.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:15:19.751 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:15:19.751 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:15:19.751 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:19.758 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0114002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:19.758 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:15:19.758 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:15:19.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0115002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:15:20.015 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4257820) skgpid 20147 ospid 20147 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:21.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:21.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:21.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:23.748 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:23.748 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:23.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:24.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:24.725 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:25.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:25.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:25.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:27.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:27.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:27.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:29.121 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:29.641 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:15:29.642 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:15:29.642 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:15:29.642 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(27613) version 11:1:1:4 [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ba8a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3ae0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:15:29.648 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:29.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:15:29.656 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:15:29.656 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe430) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:29.656 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:15:29.722 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:15:29.723 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:15:29.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:15:29.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42dcd80) pid(27621) version 11:1:1:4 [ CSSD]2013-05-23 17:15:29.728 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:29.728 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b42dd100, requested num -1 [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd660/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:15:29.731 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:29.738 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:15:29.738 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:15:29.738 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd960) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:29.738 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd960) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:15:29.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:29.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:29.771 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:29.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0116002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:29.858 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:15:29.858 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid ospid 27613 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:29.940 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:15:29.940 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b4257820) skgpid ospid 27621 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:31.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:31.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:31.796 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:33.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0117002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:33.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:15:33.533 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:15:33.533 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:15:33.533 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:33.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0118002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:33.541 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:15:33.541 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:15:33.730 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:33.731 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:15:33.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:33.788 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:33.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:35.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0119002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:35.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:15:35.015 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:15:35.015 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:15:35.015 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:35.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011a002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:35.022 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:15:35.022 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:15:35.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:35.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:35.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:37.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:37.802 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:37.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:38.734 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:38.734 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:39.142 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:39.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:39.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:39.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:39.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011b002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:41.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:41.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:41.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:43.737 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:43.737 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:43.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:43.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:43.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:44.973 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:15:44.974 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:15:44.974 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:15:44.974 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42ba8a0) pid(27768) version 11:1:1:4 [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ba8a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c6010, requested num -1 [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:15:44.981 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:44.987 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:15:44.987 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:15:44.987 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3c60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:15:44.987 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3c60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:15:45.190 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:15:45.190 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4257820) skgpid ospid 27768 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:15:45.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:45.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:45.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:47.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:47.883 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:47.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:48.741 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:48.741 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:49.172 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:49.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:49.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:49.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011c002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:49.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:50.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(011d002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:50.269 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:15:50.269 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:15:50.269 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:15:50.269 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:15:50.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(011e002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:50.276 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:15:50.276 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:15:51.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:51.897 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:51.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:52.744 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:52.744 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:15:52.988 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 17:15:52.989 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:15:52.989 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 17:15:52.989 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42ba8a0) pid(26655/26655) version 11:1:1:4 [ CSSD]2013-05-23 17:15:52.995 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ba8a0), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:15:52.995 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:15:52.995 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:15:52.995 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:15:53.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:53.950 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:53.992 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:55.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:55.957 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:55.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:57.747 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:15:57.747 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:15:57.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:57.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:15:57.990 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:15:59.202 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:15:59.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(011f002d) incarnation(174631051) [ CSSD]2013-05-23 17:15:59.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:15:59.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:00.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:00.233 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:16:00.234 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:16:00.234 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:16:00.234 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe520) proc(0x7f82b42dcd80) pid(27919) version 11:1:1:4 [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd4d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:16:00.241 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:00.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:16:00.248 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:16:00.248 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd7d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:00.248 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd7d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:16:00.450 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:16:00.450 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe520) skgpid ospid 27919 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:01.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:01.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:02.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:02.750 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:02.750 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:03.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:03.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:04.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:05.525 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0120002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:05.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:05.525 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:05.525 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:16:05.525 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:05.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0121002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:05.532 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:05.532 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:05.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:05.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:06.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:07.753 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:07.754 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:08.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:08.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:08.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:09.342 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:16:09.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0122002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:10.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:10.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:10.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:12.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:12.060 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:12.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:12.757 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:12.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:14.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:14.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:14.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:15.483 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcd80) allocated [ CSSD]2013-05-23 17:16:15.484 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:16:15.484 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcd80 - 1,2,3 [ CSSD]2013-05-23 17:16:15.484 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5e0) proc(0x7f82b42dcd80) pid(28095) version 11:1:1:4 [ CSSD]2013-05-23 17:16:15.490 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dcd80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:15.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:15.490 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42dccb0, requested num -1 [ CSSD]2013-05-23 17:16:15.490 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:15.490 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd580/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:16:15.491 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:16:15.491 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:15.498 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:15.498 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:16:15.498 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd880) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:15.498 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd880) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:16:15.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcd80 [ CSSD]2013-05-23 17:16:15.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcd80) con(0x7f82b41fe5e0) skgpid ospid 28095 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:15.875 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd5d0) allocated [ CSSD]2013-05-23 17:16:15.876 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:16:15.877 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd5d0 - 1,2,3 [ CSSD]2013-05-23 17:16:15.877 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe5c0) proc(0x7f82b42dd5d0) pid(28138/28138) version 11:1:1:4 [ CSSD]2013-05-23 17:16:15.882 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd5d0), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:16:15.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:16:15.882 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:16:15.882 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:16:15.902 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:16:15.902 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:16:15.902 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:16:15.902 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:16:15.903 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd5d0 [ CSSD]2013-05-23 17:16:15.903 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd5d0) con(0x7f82b41fe5c0) skgpid 28138 ospid 28138 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:16.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:16.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:16.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:17.760 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:17.760 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:18.088 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:18.088 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:18.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:19.372 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:16:20.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0123002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:20.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:20.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0124002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.608 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:20.608 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:20.608 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:16:20.608 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:20.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0125002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.615 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:20.615 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:20.746 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:16:20.746 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:16:20.748 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:16:20.748 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:16:20.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0126002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.781 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:20.781 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:20.781 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:16:20.781 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:20.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0127002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:20.789 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:20.789 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:22.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:22.102 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:22.249 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:22.763 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:22.763 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:24.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:24.100 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:24.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:24.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4207960) [ CSSD]2013-05-23 17:16:24.655 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4207960), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:16:24.655 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4207960), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:16:24.655 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c92b0 [ CSSD]2013-05-23 17:16:24.660 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c92b0) con(0x7f82b42dc2a0) skgpid 22849 ospid 22849 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:26.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:26.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:26.366 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:27.766 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:27.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:28.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:28.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:28.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:29.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:16:29.903 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:16:29.904 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:16:29.905 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:16:29.905 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(28263) version 11:1:1:4 [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:16:29.911 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:29.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:16:29.918 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:16:29.918 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:29.918 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:16:30.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0128002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:30.121 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:16:30.121 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 28263 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:30.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:30.164 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:30.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:30.733 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:16:30.734 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:16:30.735 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:16:30.735 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b41fea30) pid(28278) version 11:1:1:4 [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b41fcfe0, requested num -1 [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:16:30.751 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:30.758 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:16:30.758 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:16:30.758 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:30.758 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:16:30.961 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:16:30.961 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b4257820) skgpid ospid 28278 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:32.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:32.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:32.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:32.770 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:32.770 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:33.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0129002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:33.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:33.795 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:33.795 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:16:33.795 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:33.802 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012a002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:33.802 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:33.802 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:34.180 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:34.180 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:34.461 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:36.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012b002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:36.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:36.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:36.050 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:16:36.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:36.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(012c002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:36.058 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:36.058 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:36.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:36.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:36.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:37.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:37.773 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:38.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:38.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:38.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:39.424 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:16:40.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012d002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:40.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:40.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:40.544 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:42.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:42.209 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:42.570 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:42.776 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:42.776 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:44.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:44.262 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:44.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:45.994 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:16:45.995 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:16:45.996 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:16:45.996 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc2a0) proc(0x7f82b41fea30) pid(28427) version 11:1:1:4 [ CSSD]2013-05-23 17:16:46.001 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:16:46.001 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:16:46.001 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b41fcf10, requested num -1 [ CSSD]2013-05-23 17:16:46.001 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:46.001 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:16:46.002 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:16:46.002 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:46.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:16:46.008 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:16:46.008 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fcd90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:16:46.008 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fcd90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:16:46.211 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:16:46.211 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b42dc2a0) skgpid ospid 28427 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:16:46.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:46.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:46.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:47.779 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:47.779 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:48.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:48.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:48.591 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:49.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:16:50.055 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:16:50.056 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:16:50.057 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:16:50.057 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(28497/28497) version 11:1:1:4 [ CSSD]2013-05-23 17:16:50.063 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:16:50.063 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:16:50.063 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:16:50.063 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:16:50.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(012e002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:50.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:50.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:50.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:51.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(012f002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:51.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:16:51.344 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:16:51.344 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:16:51.344 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:16:51.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0130002d) incarnation(174631051) [ CSSD]2013-05-23 17:16:51.353 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:16:51.353 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:16:52.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:52.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:52.620 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:52.782 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:52.782 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:16:54.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:54.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:54.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:56.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:56.309 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:56.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:56.785 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:16:56.785 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:16:58.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:16:58.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:16:58.654 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:16:59.483 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:00.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0131002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:00.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:00.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:00.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:01.244 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de520) allocated [ CSSD]2013-05-23 17:17:01.245 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:17:01.246 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de520 - 1,2,3 [ CSSD]2013-05-23 17:17:01.246 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4bb0) proc(0x7f82b42de520) pid(28576) version 11:1:1:4 [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42de520), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42c9430, requested num -1 [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9a50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:01.252 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:01.258 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:17:01.259 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:01.259 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9d50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:01.259 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:01.461 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de520 [ CSSD]2013-05-23 17:17:01.461 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de520) con(0x7f82b42d4bb0) skgpid ospid 28576 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:01.788 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:01.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:02.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:02.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:02.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:04.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:04.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:04.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:06.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:06.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:06.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0132002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:06.600 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:06.600 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:06.600 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:17:06.601 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:06.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0133002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:06.610 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:06.610 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:06.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:06.792 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:06.792 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:08.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:08.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:08.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:09.504 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:10.142 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0134002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:10.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:10.407 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:10.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:11.692 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de520) allocated [ CSSD]2013-05-23 17:17:11.693 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:17:11.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de520 - 1,2,3 [ CSSD]2013-05-23 17:17:11.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4bb0) proc(0x7f82b42de520) pid(28730) version 11:1:1:4 [ CSSD]2013-05-23 17:17:11.795 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:11.796 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:12.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:12.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:12.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:13.936 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df400) allocated [ CSSD]2013-05-23 17:17:13.937 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:17:13.938 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df400 - 1,2,3 [ CSSD]2013-05-23 17:17:13.938 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9a30) proc(0x7f82b42df400) pid(29009) version 11:1:1:4 [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42df400), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42df320, requested num -1 [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dfbe0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:13.945 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:13.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:17:13.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:13.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dfee0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:13.953 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dfee0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:14.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df400 [ CSSD]2013-05-23 17:17:14.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df400) con(0x7f82b42c9a30) skgpid ospid 29009 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:14.287 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de520 [ CSSD]2013-05-23 17:17:14.287 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de520) con(0x7f82b42d4bb0) skgpid ospid 28730 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:14.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:14.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:14.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:15.798 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:15.799 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:17:16.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:16.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:16.498 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d50b0) allocated [ CSSD]2013-05-23 17:17:16.499 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:17:16.500 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d50b0 - 1,2,3 [ CSSD]2013-05-23 17:17:16.500 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42d50b0) pid(29085) version 11:1:1:4 [ CSSD]2013-05-23 17:17:16.505 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d50b0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:17:16.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:17:16.505 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42de5d0, requested num -1 [ CSSD]2013-05-23 17:17:16.505 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:16.505 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c98a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:16.506 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:16.506 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:16.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:17:16.513 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:16.513 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:16.513 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:16.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d50b0 [ CSSD]2013-05-23 17:17:16.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d50b0) con(0x7f82b4257820) skgpid ospid 29085 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:16.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:18.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:18.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:18.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:19.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:17:19.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:17:19.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:17:19.400 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:17:19.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0135002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:19.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:19.478 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:19.478 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:17:19.478 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:17:19.486 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0136002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:19.486 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:19.487 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:19.534 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:20.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0137002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:20.567 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:20.567 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:20.802 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:20.802 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:20.886 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:21.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0138002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:21.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:21.878 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:21.878 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:17:21.878 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:21.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0139002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:21.885 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:21.885 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:22.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:22.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:22.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:24.584 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:24.584 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:24.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:25.806 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:25.806 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:26.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:26.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:26.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:28.601 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:28.601 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:28.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:29.554 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:29.808 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:29.809 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:17:30.159 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de520) allocated [ CSSD]2013-05-23 17:17:30.160 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:17:30.160 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de520 - 1,2,3 [ CSSD]2013-05-23 17:17:30.160 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4bb0) proc(0x7f82b42de520) pid(29240) version 11:1:1:4 [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42de520), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42aee50 with con 0x7f82b42c9430, requested num -1 [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9a50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:30.166 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:30.173 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:17:30.173 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42aee50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:30.173 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9d50) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:30.173 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9d50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:30.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013a002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:30.376 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de520 [ CSSD]2013-05-23 17:17:30.376 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de520) con(0x7f82b42d4bb0) skgpid ospid 29240 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:30.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:30.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:31.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:31.749 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d50b0) allocated [ CSSD]2013-05-23 17:17:31.750 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:17:31.750 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d50b0 - 1,2,3 [ CSSD]2013-05-23 17:17:31.750 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42d50b0) pid(29255) version 11:1:1:4 [ CSSD]2013-05-23 17:17:31.756 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d50b0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:17:31.756 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:17:31.756 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42de5d0, requested num -1 [ CSSD]2013-05-23 17:17:31.756 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:31.756 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c98a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:31.757 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:31.757 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:31.763 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:17:31.763 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:31.763 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9ba0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:31.763 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9ba0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:31.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d50b0 [ CSSD]2013-05-23 17:17:31.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d50b0) con(0x7f82b427c5d0) skgpid ospid 29255 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:32.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:32.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:33.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:34.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013b002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:34.052 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:34.052 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:34.052 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:17:34.052 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:17:34.058 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid 28497 ospid 28497 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:34.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013c002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:34.060 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:34.060 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:34.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:34.665 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:34.812 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:34.812 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:35.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:36.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:36.671 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:37.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:37.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(013d002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:37.138 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:37.138 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:37.138 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:17:37.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:37.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(013e002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:37.145 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:37.145 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:38.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:38.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:39.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:39.576 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:39.815 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:39.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:40.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(013f002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:40.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:40.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:41.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:42.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:42.685 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:43.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:43.468 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:17:43.469 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:17:43.470 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:17:43.470 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(29384) version 11:1:1:4 [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:43.476 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:43.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:17:43.483 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:43.483 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:43.483 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:43.685 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:17:43.685 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 29384 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:44.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:44.696 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:44.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:44.819 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:45.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:46.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:46.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:47.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:17:47.009 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:17:47.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:17:47.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b41fea30) pid(29417) version 11:1:1:4 [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b41fcfe0, requested num -1 [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:17:47.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:47.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:17:47.021 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:17:47.021 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:17:47.021 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:17:47.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:47.224 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:17:47.224 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b4257820) skgpid ospid 29417 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:17:48.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:48.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:48.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:48.822 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:17:49.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:49.595 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:17:50.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0140002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:50.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:50.720 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:51.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:52.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0141002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:52.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:17:52.405 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:17:52.405 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:17:52.405 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:17:52.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0142002d) incarnation(174631051) [ CSSD]2013-05-23 17:17:52.413 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:17:52.413 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:17:52.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:52.726 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:53.273 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:53.825 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:53.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:54.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:54.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:55.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:56.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:56.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:57.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:58.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:17:58.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:17:58.829 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:17:58.829 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:17:59.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:17:59.615 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:00.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0143002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:00.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:00.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:01.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:02.256 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:18:02.257 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:18:02.258 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:18:02.258 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(29564) version 11:1:1:4 [ CSSD]2013-05-23 17:18:02.264 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:02.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:02.264 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:18:02.264 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:02.264 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:18:02.265 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:02.265 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:02.271 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:02.271 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:18:02.271 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:02.271 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:02.473 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:18:02.473 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 29564 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:02.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:02.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:03.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:03.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:03.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:04.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:04.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:05.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:06.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:06.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:07.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:07.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0144002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:07.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:18:07.660 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:18:07.660 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:18:07.660 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:07.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0145002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:07.667 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:18:07.668 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:18:07.836 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:07.836 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:18:08.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:08.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:09.433 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:09.635 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:10.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0146002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:10.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:10.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:11.439 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:12.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:12.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:12.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:12.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:13.445 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:14.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:14.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:15.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:16.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:16.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:17.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:17.508 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:18:17.509 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:18:17.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:18:17.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(29706) version 11:1:1:4 [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:18:17.515 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:17.516 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:17.523 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:18:17.523 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:18:17.523 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:17.523 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:17.725 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:18:17.725 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 29706 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:17.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:17.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:18.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:18.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:19.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:19.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:20.329 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0147002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:20.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:20.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:21.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:21.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:21.846 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:18:22.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0148002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:22.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:18:22.927 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:18:22.927 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:18:22.927 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:22.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0149002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:22.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:18:22.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:18:22.971 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:22.971 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:23.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:24.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:24.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:25.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:26.850 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:26.850 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:26.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:26.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:27.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:28.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:28.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:29.065 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:18:29.066 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:29.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:18:29.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fea30) pid(29823/29823) version 11:1:1:4 [ CSSD]2013-05-23 17:18:29.072 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:18:29.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:18:29.072 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:18:29.072 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42b3600), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:18:29.106 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b427c5d0) skgpid 29823 ospid 29823 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:29.285 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:18:29.286 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:29.287 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:18:29.287 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fea30) pid(29826/29826) version 11:1:1:4 [ CSSD]2013-05-23 17:18:29.293 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:18:29.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:18:29.293 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:18:29.293 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:18:29.340 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b427c5d0) skgpid 29826 ospid 29826 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:29.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:29.696 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:30.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014a002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:30.418 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:18:30.419 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:30.420 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:18:30.420 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fea30) pid(29844) version 11:1:1:4 [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fea30), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b41fcfe0, requested num -1 [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:30.426 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:30.433 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:30.433 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:18:30.433 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:30.434 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:30.636 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:18:30.636 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b427c5d0) skgpid ospid 29844 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:31.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:31.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:31.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:31.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:31.853 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:32.759 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:18:32.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:18:32.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:18:32.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(29866) version 11:1:1:4 [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:32.766 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:32.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:18:32.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:18:32.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:32.773 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:32.975 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:18:32.975 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 29866 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:33.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:33.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:33.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:34.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014b002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:34.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:18:34.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:18:34.312 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:18:34.312 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:34.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014c002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:34.319 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:18:34.319 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:18:35.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:35.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:35.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:36.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:36.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:37.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:37.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:37.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:38.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(014d002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:38.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:18:38.182 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:18:38.182 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:18:38.182 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:38.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(014e002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:38.189 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:18:38.189 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:18:39.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:39.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:39.675 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:39.717 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:40.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(014f002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:40.859 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:40.860 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:18:41.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:41.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:41.457 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fea30) allocated [ CSSD]2013-05-23 17:18:41.457 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:41.458 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fea30 - 1,2,3 [ CSSD]2013-05-23 17:18:41.458 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b41fea30) pid(29982) version 11:1:1:4 [ CSSD]2013-05-23 17:18:41.719 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:41.949 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42de420) allocated [ CSSD]2013-05-23 17:18:41.950 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:41.950 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42de420 - 1,2,3 [ CSSD]2013-05-23 17:18:41.950 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc360) proc(0x7f82b42de420) pid(30071) version 11:1:1:4 [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42de420), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b4207960 with con 0x7f82b42de350, requested num -1 [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9750/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:41.958 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:41.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:18:41.965 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:18:41.965 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9a50) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:18:41.965 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42c9a50) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:42.075 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df510) allocated [ CSSD]2013-05-23 17:18:42.076 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:42.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df510 - 1,2,3 [ CSSD]2013-05-23 17:18:42.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9770) proc(0x7f82b42df510) pid(30087) version 11:1:1:4 [ CSSD]2013-05-23 17:18:42.092 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:18:42.094 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:18:42.096 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:18:42.097 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df510 [ CSSD]2013-05-23 17:18:42.097 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df510) con(0x7f82b42c9770) skgpid ospid 30087 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:42.111 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fea30 [ CSSD]2013-05-23 17:18:42.111 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fea30) con(0x7f82b427c5d0) skgpid ospid 29982 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:42.168 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42de420 [ CSSD]2013-05-23 17:18:42.168 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42de420) con(0x7f82b42dc360) skgpid ospid 30071 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:43.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:43.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:43.725 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:45.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:45.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:45.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:45.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:45.863 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:47.122 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:47.122 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:47.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:48.010 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fcd90) allocated [ CSSD]2013-05-23 17:18:48.011 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:18:48.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fcd90 - 1,2,3 [ CSSD]2013-05-23 17:18:48.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fd370) proc(0x7f82b41fcd90) pid(30191) version 11:1:1:4 [ CSSD]2013-05-23 17:18:48.028 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b41fcd90), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:48.028 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:48.028 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b41fd420, requested num -1 [ CSSD]2013-05-23 17:18:48.028 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:48.028 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:18:48.029 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:18:48.029 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:48.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:18:48.035 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:18:48.035 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8710) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:18:48.035 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8710) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:18:48.238 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fcd90 [ CSSD]2013-05-23 17:18:48.238 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fcd90) con(0x7f82b41fd370) skgpid ospid 30191 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:49.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:49.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:49.737 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:49.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:50.405 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0150002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:50.866 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:50.866 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:51.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:51.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:51.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:53.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:53.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:53.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0151002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:53.442 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:18:53.442 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:18:53.442 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:18:53.442 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:18:53.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0152002d) incarnation(174631051) [ CSSD]2013-05-23 17:18:53.450 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:18:53.450 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:18:53.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:18:54.707 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid 24569 ospid 24569 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:54.708 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:18:54.708 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:18:54.708 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:18:54.708 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:18:54.716 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b427d8a0) skgpid 24571 ospid 24571 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:18:55.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:55.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:55.493 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:18:55.494 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:18:55.494 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:18:55.494 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(30300/30300) version 11:1:1:4 [ CSSD]2013-05-23 17:18:55.500 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:18:55.500 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:18:55.500 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:18:55.500 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:18:55.816 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:55.870 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:55.870 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:18:57.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:57.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:57.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:18:59.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:18:59.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:18:59.758 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:18:59.872 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:18:59.873 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:18:59.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:00.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0153002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:01.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:01.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:01.881 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:03.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:03.253 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:03.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:19:03.282 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:19:03.283 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:19:03.283 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42aed80) pid(30370) version 11:1:1:4 [ CSSD]2013-05-23 17:19:03.288 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42aed80), client(1/0x7f82b42b3600) [ CSSD]2013-05-23 17:19:03.288 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:19:03.288 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3600 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 17:19:03.288 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:03.288 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:19:03.289 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:03.289 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:03.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3600) [ CSSD]2013-05-23 17:19:03.295 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3600), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:19:03.295 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:03.295 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:03.498 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:19:03.498 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b41fa050) skgpid ospid 30370 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:03.908 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:04.875 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:04.876 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:05.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:05.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:05.998 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:07.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:07.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:08.005 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:08.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0154002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:08.693 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:19:08.693 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:19:08.693 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:19:08.693 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:08.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0155002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:08.700 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:19:08.700 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:19:09.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:09.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:09.778 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:19:09.879 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:09.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:10.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:10.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0156002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:11.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:11.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:12.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:13.332 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:13.332 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:14.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:14.882 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:14.882 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:15.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:15.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:16.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:17.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:17.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:18.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:18.532 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:19:18.533 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:19:18.533 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:19:18.533 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a93b0) proc(0x7f82b427c510) pid(30530) version 11:1:1:4 [ CSSD]2013-05-23 17:19:18.539 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b427c510), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:19:18.539 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:19:18.539 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 17:19:18.539 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:18.539 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:19:18.540 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:18.540 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:18.546 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:19:18.546 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:19:18.546 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:18.546 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:18.749 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:19:18.749 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42a93b0) skgpid ospid 30530 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:18.884 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:18.885 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:19:19.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:19.396 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:19.797 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:19:20.117 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:20.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0157002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:21.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:21.401 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:22.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:23.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:23.414 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:23.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:23.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:23.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0158002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:23.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:19:23.943 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:19:23.943 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:19:23.943 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:23.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0159002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:23.951 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:19:23.951 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:19:24.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:25.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:25.420 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:26.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:27.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:27.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:28.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:28.891 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:28.891 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:29.075 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4257760) allocated [ CSSD]2013-05-23 17:19:29.076 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:19:29.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4257760 - 1,2,3 [ CSSD]2013-05-23 17:19:29.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5c80) proc(0x7f82b4257760) pid(30668) version 11:1:1:4 [ CSSD]2013-05-23 17:19:29.210 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fd290) allocated [ CSSD]2013-05-23 17:19:29.211 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:19:29.211 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fd290 - 1,2,3 [ CSSD]2013-05-23 17:19:29.211 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b41fd290) pid(30678) version 11:1:1:4 [ CSSD]2013-05-23 17:19:29.230 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:19:29.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:19:29.236 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd290 [ CSSD]2013-05-23 17:19:29.236 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd290) con(0x7f82b42aee40) skgpid ospid 30678 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5356/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5356 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b41fcd90/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:29.310 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:19:29.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5356 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:19:29.317 [1199044928] >TRACE: clssgmExitGrock: client 5356 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:19:29.317 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:19:29.317 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:29.318 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4257760 [ CSSD]2013-05-23 17:19:29.318 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4257760) con(0x7f82b42d5c80) skgpid ospid 30668 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:29.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:29.437 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:29.818 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:19:30.197 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:30.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015a002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:30.684 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:19:30.685 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:19:30.685 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:19:30.685 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b427c510) pid(30697) version 11:1:1:4 [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b427c510), client(1/0x7f82b42d8690) [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d8690) [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d8690 with con 0x7f82b429e7c0, requested num -1 [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:30.692 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:30.699 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d8690) [ CSSD]2013-05-23 17:19:30.699 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d8690), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:19:30.699 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:30.699 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:30.902 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:19:30.902 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b427d8a0) skgpid ospid 30697 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:31.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:31.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:32.203 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:33.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:33.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:33.788 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4257760) allocated [ CSSD]2013-05-23 17:19:33.789 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:19:33.790 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4257760 - 1,2,3 [ CSSD]2013-05-23 17:19:33.790 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4257760) pid(30731) version 11:1:1:4 [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4257760), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a41c0, requested num -1 [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:33.796 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:33.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:19:33.803 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:19:33.803 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:33.804 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:33.894 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:33.894 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:34.006 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4257760 [ CSSD]2013-05-23 17:19:34.006 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4257760) con(0x7f82b41fa050) skgpid ospid 30731 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:34.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:34.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015b002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:34.574 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:19:34.574 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:19:34.574 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:19:34.574 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:34.581 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015c002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:34.581 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:19:34.581 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:19:35.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:35.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:36.241 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:37.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:37.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:38.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:38.897 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:38.897 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:39.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(015d002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:39.203 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:19:39.203 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:19:39.203 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:19:39.203 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:39.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(015e002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:39.210 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:19:39.210 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:19:39.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:39.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:39.848 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:19:40.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:40.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(015f002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3350 [ CSSD]2013-05-23 17:19:40.966 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3350) con(0x7f82b429e330) skgpid 25744 ospid 25744 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:41.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:41.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:42.325 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:42.900 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:42.900 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:19:43.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:43.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:44.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:45.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:45.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:46.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:47.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:47.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:47.903 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:47.904 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:48.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:49.043 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:19:49.044 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:19:49.044 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:19:49.044 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b427c510) pid(30879) version 11:1:1:4 [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b429e7c0, requested num -1 [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:19:49.051 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:49.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:19:49.058 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:19:49.058 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:19:49.058 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:19:49.260 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:19:49.260 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b5b40) skgpid ospid 30879 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:19:49.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:49.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:49.878 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:19:50.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:50.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0160002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:51.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:51.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:52.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:52.907 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:52.907 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:53.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:53.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:54.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:54.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0161002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:54.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:19:54.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:19:54.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:19:54.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:19:54.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0162002d) incarnation(174631051) [ CSSD]2013-05-23 17:19:54.463 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:19:54.463 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:19:55.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:55.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:56.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:57.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:57.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:57.910 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:19:57.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:19:58.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:19:59.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:19:59.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:19:59.898 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:00.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:00.577 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0163002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:01.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:01.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:01.912 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:01.913 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:20:02.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:03.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:03.796 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:04.294 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4257760) allocated [ CSSD]2013-05-23 17:20:04.294 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:20:04.295 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4257760 - 1,2,3 [ CSSD]2013-05-23 17:20:04.295 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4257760) pid(31216) version 11:1:1:4 [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4257760), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4207270, requested num -1 [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:20:04.301 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:04.308 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:04.308 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:20:04.308 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:04.308 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:20:04.364 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d36f0) allocated [ CSSD]2013-05-23 17:20:04.364 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:20:04.365 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d36f0 - 1,2,3 [ CSSD]2013-05-23 17:20:04.365 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42046a0) proc(0x7f82b42d36f0) pid(31225/31225) version 11:1:1:4 [ CSSD]2013-05-23 17:20:04.371 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d36f0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:04.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:04.371 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:20:04.371 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:20:04.511 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4257760 [ CSSD]2013-05-23 17:20:04.511 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4257760) con(0x7f82b41fa050) skgpid ospid 31216 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:04.517 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:04.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:04.649 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:20:04.649 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:20:04.650 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:20:04.650 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d36f0 [ CSSD]2013-05-23 17:20:04.650 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d36f0) con(0x7f82b42046a0) skgpid 31225 ospid 31225 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:05.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:05.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:06.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:06.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:06.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:07.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:07.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:08.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:09.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0164002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:09.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:09.706 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:09.706 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:09.706 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:09.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0165002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:09.714 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:09.714 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:09.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:09.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:10.059 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:10.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:10.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0166002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:11.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:11.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:11.918 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:11.919 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:12.607 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:13.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:13.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:14.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:15.920 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:15.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:16.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:16.922 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:16.922 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:17.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:17.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:18.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:19.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4257760) allocated [ CSSD]2013-05-23 17:20:19.545 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:20:19.546 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4257760 - 1,2,3 [ CSSD]2013-05-23 17:20:19.546 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5b40) proc(0x7f82b4257760) pid(31370) version 11:1:1:4 [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4257760), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:20:19.552 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:19.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:20:19.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:20:19.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:19.560 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:20:19.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4257760 [ CSSD]2013-05-23 17:20:19.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4257760) con(0x7f82b42b5b40) skgpid ospid 31370 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:19.939 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:19.939 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:20.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:20.109 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:20:20.109 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cbf40), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:20:20.109 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cbf40), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:20:20.109 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 17:20:20.112 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:20:20.112 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:20:20.112 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:20:20.112 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:20:20.113 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fd160 [ CSSD]2013-05-23 17:20:20.113 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fd160) con(0x7f82b4207cd0) skgpid 25798 ospid 25798 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:20.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0167002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:20.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:20.925 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:20.925 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:20:21.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:21.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:22.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:23.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:23.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:24.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:24.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0168002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:24.958 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:24.958 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:24.958 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:24.958 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:24.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0169002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:24.964 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:24.964 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:25.928 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:25.929 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:25.973 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:25.973 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:26.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:28.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:28.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:28.830 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:30.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:30.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:30.099 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:30.543 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:20:30.544 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:20:30.544 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:20:30.544 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9340) proc(0x7f82b42aed80) pid(31423/31423) version 11:1:1:4 [ CSSD]2013-05-23 17:20:30.560 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42aed80), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:20:30.560 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:20:30.560 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:20:30.560 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:20:30.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016a002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:30.840 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:30.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:30.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:30.937 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4257760) allocated [ CSSD]2013-05-23 17:20:30.938 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:20:30.938 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4257760 - 1,2,3 [ CSSD]2013-05-23 17:20:30.938 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e7c0) proc(0x7f82b4257760) pid(31490) version 11:1:1:4 [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4257760), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9690, requested num -1 [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:20:30.945 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:30.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:20:30.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:20:30.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:30.952 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:20:31.155 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4257760 [ CSSD]2013-05-23 17:20:31.155 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4257760) con(0x7f82b429e7c0) skgpid ospid 31490 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:32.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:32.035 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:32.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:34.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:34.046 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:34.794 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 17:20:34.795 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:20:34.795 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 17:20:34.795 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207c10) pid(31528) version 11:1:1:4 [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207c10), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427c510, requested num -1 [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:20:34.801 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:34.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:20:34.806 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:20:34.806 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:34.806 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:20:34.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016b002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:34.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:34.837 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:34.837 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:34.837 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:34.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016c002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:34.845 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:34.845 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:34.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:35.009 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 17:20:35.009 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b427d8a0) skgpid ospid 31528 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:35.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:35.935 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:36.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:36.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:36.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:38.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:38.105 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:38.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:39.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:39.938 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:20:40.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:40.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:40.120 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:40.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(016d002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:40.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:40.218 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:40.218 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:40.218 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:40.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(016e002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:40.224 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:40.224 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:40.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(016f002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:40.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:42.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:42.117 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:42.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:44.147 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:44.147 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:44.941 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:44.941 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:44.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:46.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:46.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:47.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:48.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:48.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:49.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:49.944 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:49.944 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:50.047 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:20:50.047 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:20:50.048 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:20:50.048 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b427c510) pid(31677) version 11:1:1:4 [ CSSD]2013-05-23 17:20:50.054 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:50.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:50.054 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4207c10, requested num -1 [ CSSD]2013-05-23 17:20:50.054 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:50.054 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:20:50.055 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:20:50.055 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:50.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:20:50.062 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:20:50.062 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:20:50.062 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:20:50.139 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:20:50.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:50.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:50.265 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:20:50.265 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b41fa050) skgpid ospid 31677 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:20:50.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0170002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:51.043 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:52.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:52.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:53.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:54.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:54.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:54.947 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:54.947 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:20:55.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:55.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0171002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:55.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:55.467 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:55.467 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:55.467 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:55.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0172002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:55.476 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:55.476 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:56.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:56.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:57.077 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:20:58.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:20:58.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:20:58.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0173002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:58.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:20:58.718 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:20:58.718 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:20:58.718 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:20:58.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0174002d) incarnation(174631051) [ CSSD]2013-05-23 17:20:58.726 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:20:58.726 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:20:58.950 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:20:58.950 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:20:59.083 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:00.169 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:00.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:00.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:00.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0175002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:01.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:02.335 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:02.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:03.139 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:03.953 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:03.954 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:04.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:04.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:05.149 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:05.324 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:21:05.325 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:21:05.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:21:05.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b42cbe70) pid(31818) version 11:1:1:4 [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cbe70), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d9690, requested num -1 [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:21:05.331 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:05.338 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:21:05.338 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:21:05.338 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:05.338 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:21:05.541 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:21:05.541 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b41fa050) skgpid ospid 31818 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:06.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:06.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:07.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:08.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:08.406 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:08.957 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:08.957 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:09.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:10.193 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:10.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:10.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:10.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0176002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:10.727 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:10.727 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:10.727 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:21:10.727 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:10.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0177002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:10.735 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:10.735 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:10.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0178002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:11.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:12.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:12.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:13.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:13.960 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:13.960 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:14.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:14.427 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:15.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:15.353 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:21:15.353 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:21:15.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:21:15.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429e7c0) proc(0x7f82b42d9690) pid(31943/31943) version 11:1:1:4 [ CSSD]2013-05-23 17:21:15.360 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d9690), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:21:15.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:21:15.360 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:21:15.360 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:21:15.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b429e7c0) skgpid 31943 ospid 31943 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:16.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:16.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:17.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:17.963 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:17.963 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:21:18.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:18.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:19.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:20.217 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:20.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:20.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:20.579 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:21:20.580 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:21:20.580 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:21:20.580 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5ce0) proc(0x7f82b42cbe70) pid(31984) version 11:1:1:4 [ CSSD]2013-05-23 17:21:20.587 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42cbe70), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:21:20.587 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:21:20.587 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b427c510, requested num -1 [ CSSD]2013-05-23 17:21:20.587 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:20.587 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:21:20.588 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:21:20.588 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:20.595 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:21:20.595 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:21:20.595 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8170) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:20.595 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8170) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:21:20.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0179002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:20.798 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:21:20.798 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42b5ce0) skgpid ospid 31984 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:20.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017a002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:20.907 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:20.907 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:20.907 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:21:20.907 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:20.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017b002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:20.913 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:20.913 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:21.041 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:21:21.042 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:21:21.043 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:21:21.043 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:21:21.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:22.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:22.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:22.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:22.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:23.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:24.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:24.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8180 [ CSSD]2013-05-23 17:21:24.834 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8180) con(0x7f82b42a29f0) skgpid 26657 ospid 26657 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a90a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a90a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 17:21:24.837 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42be650) skgpid 26655 ospid 26655 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:25.193 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 17:21:25.194 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:21:25.194 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 17:21:25.194 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b4207c10) pid(32051/32051) version 11:1:1:4 [ CSSD]2013-05-23 17:21:25.211 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:21:25.211 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:21:25.211 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:21:25.211 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 17:21:25.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:25.982 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017c002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:25.982 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:25.982 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:25.982 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:21:25.982 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:25.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(017d002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:25.990 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:25.990 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:26.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:26.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:27.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:27.969 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:27.970 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:28.607 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:28.607 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:29.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:29.915 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42aed80), client(2/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:21:29.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:21:29.915 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:21:29.915 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 17:21:30.238 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:30.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:30.613 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:30.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(017e002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:31.204 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 17:21:31.205 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:21:31.205 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 17:21:31.205 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42833d0) pid(32093) version 11:1:1:4 [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42833d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a8240, requested num -1 [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:21:31.212 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:31.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:21:31.219 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:21:31.219 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aff70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:31.220 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aff70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:21:31.422 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 17:21:31.422 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42a29f0) skgpid ospid 32093 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:31.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:32.619 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:32.619 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:32.972 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:32.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:33.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:34.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:34.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:35.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(017f002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:35.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:35.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:35.093 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:21:35.093 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:35.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0180002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:35.101 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:35.101 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:35.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:35.830 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:21:35.831 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:21:35.831 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:21:35.831 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c5f40) proc(0x7f82b42a8170) pid(32133) version 11:1:1:4 [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a8170), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42ae300, requested num -1 [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:21:35.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:35.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:21:35.845 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:21:35.845 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:35.845 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:21:36.048 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:21:36.048 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42c5f40) skgpid ospid 32133 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:36.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:36.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:37.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:37.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:37.975 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:38.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:38.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:39.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:40.269 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:40.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:40.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:40.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0181002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:41.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0182002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:41.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:41.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:41.234 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:21:41.234 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:41.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0183002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:41.242 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:41.242 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:41.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:41.978 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:41.978 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:21:42.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:42.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:43.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:44.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:44.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:45.550 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:46.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:46.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:46.981 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:46.981 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:47.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:48.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:48.757 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:49.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:50.292 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:21:50.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:50.763 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:50.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0184002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:51.091 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:21:51.092 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:21:51.092 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:21:51.092 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(32285) version 11:1:1:4 [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a3ea0), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a90a0 with con 0x7f82b42a8240, requested num -1 [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:21:51.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:51.108 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:21:51.108 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a90a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:21:51.108 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:21:51.108 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:21:51.311 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:21:51.311 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid ospid 32285 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:21:51.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:51.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:51.985 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:52.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:52.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:53.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:54.671 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 17:21:54.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:21:54.671 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:21:54.671 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 17:21:54.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:54.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:55.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:56.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0185002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:56.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:21:56.495 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:21:56.495 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:21:56.495 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:21:56.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0186002d) incarnation(174631051) [ CSSD]2013-05-23 17:21:56.502 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:21:56.502 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:21:56.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:56.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:56.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:21:56.988 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:21:57.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:21:58.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:21:58.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:21:59.710 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:00.319 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:00.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:00.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:00.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0187002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:00.991 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:00.991 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:22:01.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:02.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:02.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:03.723 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:04.118 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:22:04.119 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:22:04.119 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:22:04.119 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42833d0) proc(0x7f82b42b3cd0) pid(29611/29611) version 11:1:1:4 [ CSSD]2013-05-23 17:22:04.135 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42b3cd0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:22:04.135 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:22:04.135 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:22:04.135 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:22:04.921 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:04.921 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:05.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:05.994 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:05.994 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:06.348 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 17:22:06.349 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:22:06.350 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 17:22:06.350 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5840) proc(0x7f82b429e330) pid(32453) version 11:1:1:4 [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e330), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b429e550, requested num -1 [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a4f00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:22:06.356 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:06.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:22:06.363 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:22:06.363 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba2a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:06.363 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba2a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:22:06.566 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 17:22:06.566 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42b5840) skgpid ospid 32453 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:06.947 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:06.947 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:07.741 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:08.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0188002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:08.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:08.785 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:08.785 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:08.785 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:08.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0189002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:08.791 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:08.791 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:08.957 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:08.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:09.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:10.083 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e330) allocated [ CSSD]2013-05-23 17:22:10.083 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:22:10.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e330 - 1,2,3 [ CSSD]2013-05-23 17:22:10.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b5840) proc(0x7f82b429e330) pid(32049/32049) version 11:1:1:4 [ CSSD]2013-05-23 17:22:10.090 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e330), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:22:10.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:22:10.090 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:22:10.090 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:22:10.302 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b429e330), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 17:22:10.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 17:22:10.302 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:22:10.302 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 17:22:10.341 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:10.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018a002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:10.964 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:10.964 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:10.997 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:10.997 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:11.260 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5040) allocated [ CSSD]2013-05-23 17:22:11.260 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:22:11.261 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5040 - 1,2,3 [ CSSD]2013-05-23 17:22:11.261 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42d5040) pid(32582) version 11:1:1:4 [ CSSD]2013-05-23 17:22:11.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018b002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:11.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:11.755 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:11.755 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:11.755 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:11.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018c002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:11.763 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:11.763 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:11.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:13.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:13.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:13.803 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5040 [ CSSD]2013-05-23 17:22:13.803 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5040) con(0x7f82b42d9750) skgpid ospid 32582 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:13.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:15.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:15.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:15.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:16.000 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:16.000 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:17.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:17.028 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:17.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:19.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:19.039 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:19.718 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:22:19.719 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:22:19.720 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:22:19.721 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:22:19.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(018d002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:19.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:19.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:19.800 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:22:19.800 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:22:19.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(018e002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:19.807 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:19.807 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:19.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:20.003 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:20.003 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:22:20.377 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:21.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:21.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:21.603 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5040) allocated [ CSSD]2013-05-23 17:22:21.604 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:22:21.604 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5040 - 1,2,3 [ CSSD]2013-05-23 17:22:21.604 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42d5040) pid(498) version 11:1:1:4 [ CSSD]2013-05-23 17:22:21.610 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5040), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:22:21.610 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:22:21.610 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:22:21.610 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:21.611 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe8d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:22:21.611 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:22:21.611 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:21.618 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:22:21.618 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:22:21.618 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4e00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:21.618 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4e00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:22:21.820 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5040 [ CSSD]2013-05-23 17:22:21.821 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5040) con(0x7f82b42b34e0) skgpid ospid 498 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:21.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:22.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(018f002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:23.117 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:23.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:23.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:25.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:25.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:25.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:25.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:25.965 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:27.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0190002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:27.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:27.008 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:27.008 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:27.008 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:27.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0191002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:27.015 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:27.015 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:27.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:27.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:27.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:29.220 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:29.220 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:30.009 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:30.009 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:30.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:30.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:31.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:31.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:31.467 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5040) allocated [ CSSD]2013-05-23 17:22:31.468 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:22:31.469 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5040 - 1,2,3 [ CSSD]2013-05-23 17:22:31.469 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42d5040) pid(631) version 11:1:1:4 [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5040), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe8d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:22:31.476 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:31.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:22:31.484 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:22:31.484 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4e00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:31.484 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4e00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:22:31.686 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5040 [ CSSD]2013-05-23 17:22:31.686 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5040) con(0x7f82b42b34e0) skgpid ospid 631 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:32.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:32.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0192002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:33.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:33.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:34.036 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:35.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:35.013 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:35.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:35.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:35.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0193002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:35.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:35.357 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:35.357 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:35.357 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:35.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0194002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:35.364 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:35.364 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:36.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:36.862 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5040) allocated [ CSSD]2013-05-23 17:22:36.863 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:22:36.864 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5040 - 1,2,3 [ CSSD]2013-05-23 17:22:36.864 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42d5040) pid(670) version 11:1:1:4 [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5040), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe8d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:22:36.871 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:36.879 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:22:36.879 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:22:36.879 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4e00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:36.879 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4e00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:22:37.082 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5040 [ CSSD]2013-05-23 17:22:37.082 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5040) con(0x7f82b42b34e0) skgpid ospid 670 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:37.265 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:37.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:38.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:39.015 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:39.016 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:22:39.321 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:39.321 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:40.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:40.421 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:41.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:41.327 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:42.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:42.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0195002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:42.257 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:42.257 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:42.257 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:42.257 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:42.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0196002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:42.263 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:42.263 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:42.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0197002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:43.339 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:43.339 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:44.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:44.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:44.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:45.344 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:45.344 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:46.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:47.369 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:47.369 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:48.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:49.023 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:49.023 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:49.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:49.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:50.223 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:50.442 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:22:51.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:51.468 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:52.125 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5040) allocated [ CSSD]2013-05-23 17:22:52.126 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:22:52.127 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5040 - 1,2,3 [ CSSD]2013-05-23 17:22:52.127 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42d5040) pid(836) version 11:1:1:4 [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5040), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a90a0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe8d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:22:52.133 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:52.140 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:22:52.140 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a90a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:22:52.140 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4e00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:22:52.140 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4e00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:22:52.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:52.342 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5040 [ CSSD]2013-05-23 17:22:52.342 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5040) con(0x7f82b42d9750) skgpid ospid 836 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:22:52.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0198002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:53.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:53.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:54.026 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:54.027 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:22:54.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:55.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:55.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:56.247 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:57.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:57.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:22:57.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0199002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:57.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:22:57.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:22:57.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:22:57.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:22:57.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019a002d) incarnation(174631051) [ CSSD]2013-05-23 17:22:57.511 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:22:57.511 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:22:58.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:22:58.029 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:22:58.272 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:22:59.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:22:59.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:00.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:00.473 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:01.536 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:01.536 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:02.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:02.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019b002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:03.032 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:03.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:03.548 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:03.548 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:23:04.171 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42833d0) skgpid 29611 ospid 29611 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:04.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:05.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:05.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:06.427 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:07.379 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:07.379 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:23:07.380 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:07.380 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a8170) pid(982) version 11:1:1:4 [ CSSD]2013-05-23 17:23:07.385 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:23:07.385 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:23:07.385 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 17:23:07.385 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:07.385 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba4e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:23:07.386 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:07.386 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:07.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:23:07.392 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:23:07.392 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba7e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:07.392 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba7e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:07.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:07.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:07.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:07.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42a29f0) skgpid ospid 982 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:08.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:08.036 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:08.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:09.632 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:09.632 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:10.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:10.495 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:11.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:11.637 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:12.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:12.753 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(019c002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:12.753 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:23:12.753 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:23:12.753 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:23:12.753 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:12.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(019d002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:12.760 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:23:12.760 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:23:13.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019e002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:13.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:13.039 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:13.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:13.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:14.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:15.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:15.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:16.529 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:17.041 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:17.042 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:23:17.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:17.679 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:18.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:19.751 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:19.751 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:20.517 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:20.545 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:21.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:21.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:22.045 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:22.045 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:22.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:22.634 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:22.635 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:23:22.636 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:22.636 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42a8170) pid(1139) version 11:1:1:4 [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42ae3d0, requested num -1 [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba4e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:22.642 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:22.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:23:22.650 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:23:22.650 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba7e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:22.650 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba7e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:22.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:22.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42b34e0) skgpid ospid 1139 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:23.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(019f002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:23.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:23.769 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:24.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:25.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:25.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:26.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:27.048 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:27.049 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:27.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:27.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:28.003 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a0002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:28.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:23:28.003 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:23:28.003 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:23:28.003 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:28.009 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a1002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:28.009 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:23:28.009 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:23:28.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:29.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:29.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:30.538 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:30.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:31.725 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:31.726 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:23:31.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:31.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a8170) pid(1243) version 11:1:1:4 [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42b3da0, requested num -1 [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba4e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:31.734 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:31.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:23:31.740 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:23:31.740 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba7e0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:31.740 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba7e0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:31.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:31.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:31.943 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:31.943 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42a29f0) skgpid ospid 1243 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:32.052 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:32.052 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:32.642 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:33.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a2002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:33.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:33.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:34.683 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:35.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a3002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:35.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:23:35.611 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:23:35.611 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:23:35.611 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:35.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a4002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:35.618 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:23:35.618 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:23:35.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:35.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:36.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:36.054 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:23:36.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:37.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:37.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:37.887 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:37.888 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:23:37.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:37.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a8170) pid(1311) version 11:1:1:4 [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba370/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:37.894 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:37.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:23:37.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:23:37.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:37.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:38.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:38.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42d9750) skgpid ospid 1311 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:38.716 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:39.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:39.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:40.566 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:40.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:40.899 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:40.900 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:23:40.901 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:40.901 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42a8170) pid(1391) version 11:1:1:4 [ CSSD]2013-05-23 17:23:41.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:41.057 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:41.474 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:41.474 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42b34e0) skgpid ospid 1391 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:41.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:41.940 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:42.246 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:42.247 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:23:42.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:42.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42a8170) pid(1494) version 11:1:1:4 [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42adc50 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba370/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:42.255 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:42.263 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:23:42.263 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:23:42.263 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3da0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:23:42.263 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b3da0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:42.376 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d4f70) allocated [ CSSD]2013-05-23 17:23:42.377 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:23:42.377 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d4f70 - 1,2,3 [ CSSD]2013-05-23 17:23:42.377 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42d4f70) pid(1499) version 11:1:1:4 [ CSSD]2013-05-23 17:23:42.394 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:23:42.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:23:42.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:23:42.400 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d4f70 [ CSSD]2013-05-23 17:23:42.400 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d4f70) con(0x7f82b42d9750) skgpid ospid 1499 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:42.466 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:42.466 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42a29f0) skgpid ospid 1494 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:42.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:43.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a5002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:43.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a6002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:43.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:23:43.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:23:43.270 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:23:43.270 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:43.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01a7002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:43.278 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:23:43.278 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:23:43.951 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:43.951 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:44.784 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:45.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:45.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:46.060 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:46.060 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:46.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:48.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:48.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:48.795 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:50.034 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:50.034 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:50.587 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:23:50.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:51.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:51.064 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:52.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:52.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:52.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:53.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01a8002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:53.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:23:53.143 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:23:53.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:23:53.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b34e0) proc(0x7f82b42a8170) pid(1635) version 11:1:1:4 [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ba370/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:23:53.150 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:53.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:23:53.156 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:23:53.156 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae3d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:23:53.156 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae3d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:23:53.359 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:23:53.359 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42b34e0) skgpid ospid 1635 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:23:54.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:54.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:54.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:56.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:23:56.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:23:56.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:56.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:56.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:23:58.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:23:58.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:23:58.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01a9002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:58.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:23:58.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:23:58.521 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:23:58.521 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:23:58.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01aa002d) incarnation(174631051) [ CSSD]2013-05-23 17:23:58.527 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:23:58.527 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:23:58.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:00.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:00.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:00.607 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:00.887 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:01.070 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:01.070 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:02.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:02.141 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:02.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:03.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ab002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:04.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:04.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:04.228 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a8170) allocated [ CSSD]2013-05-23 17:24:04.228 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:04.228 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a8170 - 1,2,3 [ CSSD]2013-05-23 17:24:04.228 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a8170) pid(1684/1684) version 11:1:1:4 [ CSSD]2013-05-23 17:24:04.244 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a8170), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:24:04.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:24:04.244 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:24:04.244 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:24:04.944 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:06.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:06.074 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:06.149 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5110) allocated [ CSSD]2013-05-23 17:24:06.150 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:06.151 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5110 - 1,2,3 [ CSSD]2013-05-23 17:24:06.151 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba830) proc(0x7f82b42d5110) pid(1698/1698) version 11:1:1:4 [ CSSD]2013-05-23 17:24:06.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:06.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:06.167 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5110), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:24:06.167 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:24:06.167 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:24:06.167 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:24:06.620 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cee80) allocated [ CSSD]2013-05-23 17:24:06.620 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:06.621 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cee80 - 1,2,3 [ CSSD]2013-05-23 17:24:06.621 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5060) proc(0x7f82b42cee80) pid(821/821) version 11:1:1:4 [ CSSD]2013-05-23 17:24:06.637 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cee80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:24:06.637 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:24:06.637 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:24:06.637 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:24:06.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:08.179 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:08.179 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:08.394 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dce70) allocated [ CSSD]2013-05-23 17:24:08.395 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:24:08.396 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dce70 - 1,2,3 [ CSSD]2013-05-23 17:24:08.396 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9a70) proc(0x7f82b42dce70) pid(1795) version 11:1:1:4 [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dce70), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42c9510, requested num -1 [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:08.402 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:08.409 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:24:08.409 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:24:08.409 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:08.410 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:08.612 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dce70 [ CSSD]2013-05-23 17:24:08.612 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dce70) con(0x7f82b42c9a70) skgpid ospid 1795 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:08.977 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:10.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:10.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:10.628 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:10.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:11.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:11.077 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:12.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:12.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:12.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:13.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ac002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:13.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ad002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:13.780 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:24:13.780 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:24:13.780 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:24:13.780 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:13.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ae002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:13.787 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:24:13.787 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:24:14.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:14.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:15.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:15.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:15.080 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:24:16.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:16.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:17.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:18.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:18.251 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:19.078 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:20.083 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:20.083 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:20.256 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:20.256 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:20.649 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:21.087 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:22.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:22.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:23.093 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:23.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01af002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:23.651 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dce70) allocated [ CSSD]2013-05-23 17:24:23.652 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:24:23.653 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dce70 - 1,2,3 [ CSSD]2013-05-23 17:24:23.653 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9a90) proc(0x7f82b42dce70) pid(1939) version 11:1:1:4 [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dce70), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c9510, requested num -1 [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd440/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:23.659 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:23.666 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:23.666 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:24:23.666 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:23.666 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:23.869 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dce70 [ CSSD]2013-05-23 17:24:23.869 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dce70) con(0x7f82b42c9a90) skgpid ospid 1939 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:24.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:24.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:25.087 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:25.087 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:25.145 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:26.298 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:26.298 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:27.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:28.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:28.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:29.039 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b0002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:29.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:24:29.039 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:24:29.039 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:24:29.039 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:29.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b1002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:29.046 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:24:29.046 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:24:29.176 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:29.387 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dce70) allocated [ CSSD]2013-05-23 17:24:29.388 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:29.388 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dce70 - 1,2,3 [ CSSD]2013-05-23 17:24:29.388 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9aa0) proc(0x7f82b42dce70) pid(2020) version 11:1:1:4 [ CSSD]2013-05-23 17:24:29.491 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42df7e0) allocated [ CSSD]2013-05-23 17:24:29.492 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:29.492 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42df7e0 - 1,2,3 [ CSSD]2013-05-23 17:24:29.492 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dd510) proc(0x7f82b42df7e0) pid(2030) version 11:1:1:4 [ CSSD]2013-05-23 17:24:29.511 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:24:29.513 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:24:29.515 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42df7e0 [ CSSD]2013-05-23 17:24:29.515 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42df7e0) con(0x7f82b42dd510) skgpid ospid 2030 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5357/0x7f82b41bf650) [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5357 (0x7f82b41bf650) [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b42cafe0, requested num -1 [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42dd510/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:29.605 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:24:29.609 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5357 (0x7f82b41bf650) [ CSSD]2013-05-23 17:24:29.609 [1199044928] >TRACE: clssgmExitGrock: client 5357 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:24:29.609 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd810) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:24:29.609 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42dd810) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:29.610 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dce70 [ CSSD]2013-05-23 17:24:29.610 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dce70) con(0x7f82b42c9aa0) skgpid ospid 2020 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:30.090 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:30.090 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:30.356 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:30.356 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:30.673 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:31.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:31.987 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dce70) allocated [ CSSD]2013-05-23 17:24:31.988 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:24:31.988 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dce70 - 1,2,3 [ CSSD]2013-05-23 17:24:31.988 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9aa0) proc(0x7f82b42dce70) pid(2061) version 11:1:1:4 [ CSSD]2013-05-23 17:24:31.995 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dce70), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd450/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:31.996 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:32.003 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:24:32.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:24:32.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42dd750) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:32.004 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42dd750) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:32.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dce70 [ CSSD]2013-05-23 17:24:32.206 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dce70) con(0x7f82b42c9aa0) skgpid ospid 2061 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:32.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:32.362 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:33.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b2002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:33.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:34.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:34.093 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:24:34.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:34.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:34.457 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:24:34.457 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:24:34.457 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:24:34.457 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:24:34.458 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a8170 [ CSSD]2013-05-23 17:24:34.458 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a8170) con(0x7f82b42d9750) skgpid 1684 ospid 1684 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:35.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:35.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b3002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:35.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:24:35.869 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:24:35.869 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:24:35.869 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:35.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b4002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:35.875 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:24:35.875 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:24:36.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:36.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:37.353 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:38.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:38.392 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:38.911 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 17:24:38.912 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:24:38.912 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 17:24:38.912 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(2117) version 11:1:1:4 [ CSSD]2013-05-23 17:24:38.919 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:24:38.919 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:24:38.919 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42b34e0, requested num -1 [ CSSD]2013-05-23 17:24:38.920 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:38.920 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:24:38.920 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:38.920 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:38.926 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:24:38.926 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:24:38.926 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:38.926 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:39.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:39.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:39.129 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 17:24:39.129 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid ospid 2117 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:39.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:40.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:40.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:40.693 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:41.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:42.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:42.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:43.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b5002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:43.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:44.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:44.099 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:44.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b6002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:44.297 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:24:44.297 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:24:44.297 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:24:44.297 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:44.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01b7002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:44.304 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:24:44.304 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:24:44.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:44.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:45.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:46.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:46.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:47.502 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:48.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:48.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:49.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:49.102 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:49.554 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:50.496 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:50.496 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:50.713 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:24:51.560 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:52.502 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:52.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:53.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01b8002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:53.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:54.105 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:54.106 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:24:54.168 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:24:54.169 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:24:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:24:54.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(2275) version 11:1:1:4 [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42a3ea0), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a90a0 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:24:54.177 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:54.184 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:24:54.184 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a90a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:24:54.184 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:24:54.184 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:24:54.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:24:54.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid ospid 2275 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:24:54.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:54.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:55.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:56.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:56.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:57.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:24:58.108 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:24:58.108 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:24:58.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:24:58.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:24:59.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01b9002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:59.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:24:59.557 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:24:59.557 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:24:59.557 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:24:59.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ba002d) incarnation(174631051) [ CSSD]2013-05-23 17:24:59.565 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:24:59.565 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:24:59.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:00.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:00.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:00.734 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:01.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:02.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:02.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:03.111 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:03.112 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:03.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bb002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:03.696 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:04.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:04.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:04.849 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 17:25:04.850 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:25:04.850 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 17:25:04.850 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(2424/2424) version 11:1:1:4 [ CSSD]2013-05-23 17:25:04.867 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42833d0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:25:04.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:04.867 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:25:04.867 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 17:25:05.143 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid 2424 ospid 2424 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:05.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:06.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:06.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:07.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:08.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:08.115 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:08.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:08.673 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:09.430 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:25:09.431 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:25:09.432 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:25:09.432 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42ae300) pid(2473) version 11:1:1:4 [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42ae300), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42b34e0, requested num -1 [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42c9690/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:25:09.439 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:09.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:09.447 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:25:09.447 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c9990) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:09.447 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c9990) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:25:09.649 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:25:09.649 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42a29f0) skgpid ospid 2473 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:09.765 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:10.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:10.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:10.762 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:11.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:12.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:12.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:13.118 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:13.118 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:13.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bc002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:13.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:14.774 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:14.774 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:14.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01bd002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:14.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:25:14.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:25:14.817 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:25:14.817 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:14.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01be002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:14.824 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:25:14.824 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:25:15.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:16.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:16.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:17.121 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:17.121 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:25:17.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:18.793 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:18.793 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:19.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:20.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:20.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:20.816 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:20.878 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 17:25:20.879 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:25:20.879 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 17:25:20.880 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(2587/2587) version 11:1:1:4 [ CSSD]2013-05-23 17:25:20.896 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(1/0x7f82b42a90a0) [ CSSD]2013-05-23 17:25:20.896 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:25:20.896 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:25:20.896 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:25:21.700 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dce70) allocated [ CSSD]2013-05-23 17:25:21.701 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:25:21.701 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dce70 - 1,2,3 [ CSSD]2013-05-23 17:25:21.701 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42dce70) pid(2599/2599) version 11:1:1:4 [ CSSD]2013-05-23 17:25:21.717 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dce70), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:25:21.717 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:21.717 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:25:21.717 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:25:21.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:22.124 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:22.124 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:22.822 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:22.822 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:23.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01bf002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:23.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:23.880 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:23.880 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:25:23.880 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:25:23.880 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:25:23.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dce70 [ CSSD]2013-05-23 17:25:23.881 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dce70) con(0x7f82b42a29f0) skgpid 2599 ospid 2599 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:24.045 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d5110), client(2/0x7f82b42adc50) [ CSSD]2013-05-23 17:25:24.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 17:25:24.046 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:25:24.046 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 17:25:24.683 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caeb0) allocated [ CSSD]2013-05-23 17:25:24.684 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:25:24.684 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caeb0 - 1,2,3 [ CSSD]2013-05-23 17:25:24.684 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dc8e0) proc(0x7f82b42caeb0) pid(2628) version 11:1:1:4 [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42caeb0), client(1/0x7f82b42b3db0) [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b3db0) [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b3db0 with con 0x7f82b42cafe0, requested num -1 [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dd9b0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:25:24.690 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:24.696 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b3db0) [ CSSD]2013-05-23 17:25:24.696 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b3db0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:25:24.696 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcb0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:24.696 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcb0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:25:24.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:24.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:24.899 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caeb0 [ CSSD]2013-05-23 17:25:24.899 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caeb0) con(0x7f82b42dc8e0) skgpid ospid 2628 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:25.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:26.691 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd260) allocated [ CSSD]2013-05-23 17:25:26.692 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:25:26.692 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd260 - 1,2,3 [ CSSD]2013-05-23 17:25:26.692 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c9c20) proc(0x7f82b42dd260) pid(2585/2585) version 11:1:1:4 [ CSSD]2013-05-23 17:25:26.708 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd260), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:25:26.708 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:25:26.708 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:25:26.708 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:25:26.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:26.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:27.127 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:27.127 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:27.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:28.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:28.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:29.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:30.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c0002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:30.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:25:30.079 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:25:30.079 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:25:30.079 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:30.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c1002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:30.087 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:25:30.087 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:25:30.813 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:30.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:30.890 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:31.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:32.130 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:32.130 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:32.243 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0080) allocated [ CSSD]2013-05-23 17:25:32.244 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:25:32.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0080 - 1,2,3 [ CSSD]2013-05-23 17:25:32.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dddb0) proc(0x7f82b42e0080) pid(2746) version 11:1:1:4 [ CSSD]2013-05-23 17:25:32.250 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0080), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:32.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:32.250 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42dffa0, requested num -1 [ CSSD]2013-05-23 17:25:32.250 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:32.250 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:25:32.251 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:25:32.251 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:32.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:25:32.257 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:25:32.257 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0b00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:32.257 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0b00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:25:32.460 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0080 [ CSSD]2013-05-23 17:25:32.460 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0080) con(0x7f82b42dddb0) skgpid ospid 2746 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:32.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:32.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:33.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c2002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:33.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:34.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:34.906 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:35.970 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:36.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c3002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:36.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:25:36.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:25:36.120 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:25:36.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:36.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c4002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:36.127 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:25:36.127 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:25:36.133 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:36.133 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:25:36.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:36.911 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:37.976 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:38.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:38.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:39.606 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c5f40), client(2/0x7f82b42b3db0) [ CSSD]2013-05-23 17:25:39.606 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42b3db0) [ CSSD]2013-05-23 17:25:39.606 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:25:39.606 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 17:25:39.936 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e02e0) allocated [ CSSD]2013-05-23 17:25:39.937 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:25:39.938 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e02e0 - 1,2,3 [ CSSD]2013-05-23 17:25:39.938 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de010) proc(0x7f82b42e02e0) pid(2802) version 11:1:1:4 [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e02e0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42e0200, requested num -1 [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0a60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:25:39.944 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:25:39.945 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:39.952 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:25:39.952 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:25:39.952 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0d60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:39.952 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0d60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:25:39.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:40.154 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e02e0 [ CSSD]2013-05-23 17:25:40.154 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e02e0) con(0x7f82b42de010) skgpid ospid 2802 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:40.836 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:40.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:40.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:41.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:41.136 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:42.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:42.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:42.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:43.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c5002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:44.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:44.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:44.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:45.338 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c6002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:45.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:25:45.338 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:25:45.338 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:25:45.338 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:45.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01c7002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:45.346 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:25:45.346 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:25:46.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:46.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:46.140 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:47.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:47.001 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:48.076 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:49.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:49.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:50.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:50.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:25:51.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:51.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:51.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:51.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:25:52.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:53.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:53.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:53.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01c8002d) incarnation(174631051) [ CSSD]2013-05-23 17:25:54.100 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:55.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:55.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:55.145 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:25:55.146 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:25:55.189 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e03a0) allocated [ CSSD]2013-05-23 17:25:55.190 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:25:55.190 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e03a0 - 1,2,3 [ CSSD]2013-05-23 17:25:55.190 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de0d0) proc(0x7f82b42e03a0) pid(2953) version 11:1:1:4 [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e03a0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e02c0, requested num -1 [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0b20/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:25:55.197 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:25:55.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:25:55.203 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:25:55.203 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e0e20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:25:55.203 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e0e20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:25:55.406 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e03a0 [ CSSD]2013-05-23 17:25:55.406 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e03a0) con(0x7f82b42de0d0) skgpid ospid 2953 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:25:56.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:57.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:57.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:25:58.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:25:59.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:25:59.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:00.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:00.149 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:00.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:00.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01c9002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:00.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:00.589 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:00.589 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:26:00.589 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:00.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ca002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:00.597 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:00.597 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:00.880 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:01.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:01.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:02.173 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:03.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:03.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:03.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cb002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:04.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:05.152 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:05.152 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:05.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:05.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:06.191 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:06.773 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd260), client(2/0x7f82b4257830) [ CSSD]2013-05-23 17:26:06.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4257830) [ CSSD]2013-05-23 17:26:06.773 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:26:06.773 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 17:26:07.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:07.184 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:08.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:09.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:09.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:10.155 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:10.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:10.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:10.441 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0770) allocated [ CSSD]2013-05-23 17:26:10.442 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:26:10.443 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0770 - 1,2,3 [ CSSD]2013-05-23 17:26:10.443 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de4a0) proc(0x7f82b42e0770) pid(3101) version 11:1:1:4 [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0770), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e0690, requested num -1 [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0ef0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:26:10.449 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:10.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:10.456 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:26:10.456 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e11f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:10.456 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e11f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:26:10.658 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0770 [ CSSD]2013-05-23 17:26:10.658 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0770) con(0x7f82b42de4a0) skgpid ospid 3101 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:10.902 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:11.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:11.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:12.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:13.273 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:13.273 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:13.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01cc002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:14.158 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:14.158 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:26:14.263 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:15.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:15.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:15.788 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e06c0) allocated [ CSSD]2013-05-23 17:26:15.789 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:26:15.789 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e06c0 - 1,2,3 [ CSSD]2013-05-23 17:26:15.789 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb60) proc(0x7f82b42e06c0) pid(3195/3195) version 11:1:1:4 [ CSSD]2013-05-23 17:26:15.806 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e06c0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:26:15.806 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:15.806 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:26:15.806 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 41 [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 40 [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e06c0 [ CSSD]2013-05-23 17:26:15.832 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e06c0) con(0x7f82b42ddb60) skgpid 3195 ospid 3195 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:15.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cd002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:15.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:15.840 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:15.840 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:26:15.840 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:15.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ce002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:15.847 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:15.847 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:16.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:17.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:17.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:18.320 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:19.162 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:19.162 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:19.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:19.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:20.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:20.927 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:21.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01cf002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:21.203 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:21.203 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:21.203 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:26:21.203 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:21.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d0002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:21.211 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:21.211 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:21.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:21.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:21.327 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:26:21.327 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:26:21.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:26:21.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:26:22.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:23.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:23.373 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:23.473 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d1002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:24.165 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:24.165 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:24.382 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:25.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:25.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:25.695 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e06c0) allocated [ CSSD]2013-05-23 17:26:25.696 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:26:25.697 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e06c0 - 1,2,3 [ CSSD]2013-05-23 17:26:25.697 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42e06c0) pid(3262) version 11:1:1:4 [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e06c0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42e05e0, requested num -1 [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0e40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:26:25.703 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:25.710 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:25.711 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:26:25.711 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1140) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:25.711 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1140) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:26:25.913 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e06c0 [ CSSD]2013-05-23 17:26:25.913 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e06c0) con(0x7f82b4283170) skgpid ospid 3262 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cfb30), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cfb30), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a1690 [ CSSD]2013-05-23 17:26:26.019 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a1690) con(0x7f82b42c6340) skgpid 26581 ospid 26581 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:26.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:27.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:27.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:28.399 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:29.169 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:29.169 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:29.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:29.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:30.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:30.959 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:31.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d2002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:31.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:31.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:31.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:26:31.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:31.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d3002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:31.114 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:31.114 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:31.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:31.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:32.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:32.510 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3540) allocated [ CSSD]2013-05-23 17:26:32.511 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:26:32.512 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3540 - 1,2,3 [ CSSD]2013-05-23 17:26:32.512 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb60) proc(0x7f82b42d3540) pid(3347) version 11:1:1:4 [ CSSD]2013-05-23 17:26:32.518 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d3540), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:26:32.518 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:32.518 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 17:26:32.518 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:32.518 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:26:32.519 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:26:32.519 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:32.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:26:32.526 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:26:32.527 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1780) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:32.527 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1780) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:26:32.729 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3540 [ CSSD]2013-05-23 17:26:32.729 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3540) con(0x7f82b42ddb60) skgpid ospid 3347 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:33.171 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:33.172 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:26:33.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d4002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:33.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:33.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:34.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:35.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:35.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:36.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d5002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:36.396 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:36.396 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:36.396 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:26:36.396 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:36.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d6002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:36.403 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:36.403 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:36.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:37.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:37.526 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:38.175 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:38.175 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:38.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:39.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:39.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:40.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:40.946 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:26:40.947 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:26:40.948 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:26:40.948 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ddb60) proc(0x7f82b42d87c0) pid(3424) version 11:1:1:4 [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d87c0), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:26:40.955 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:40.961 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:26:40.961 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:26:40.961 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1780) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:40.961 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1780) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:26:40.982 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:41.164 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:26:41.164 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42ddb60) skgpid ospid 3424 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:41.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:41.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:42.535 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:43.178 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:43.178 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:43.522 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01d7002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:43.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:43.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:44.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:45.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:45.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:46.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01d8002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:46.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:26:46.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:26:46.355 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:26:46.355 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:46.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01d9002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:46.362 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:26:46.362 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:26:46.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:47.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:47.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:48.182 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:48.182 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:48.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:49.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:49.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:50.629 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:51.006 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:26:51.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:51.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:52.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:52.185 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:26:52.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:53.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01da002d) incarnation(174631051) [ CSSD]2013-05-23 17:26:53.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:53.684 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:54.688 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:55.690 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:55.690 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:56.208 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3540) allocated [ CSSD]2013-05-23 17:26:56.209 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:26:56.209 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3540 - 1,2,3 [ CSSD]2013-05-23 17:26:56.209 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d3540) pid(3565) version 11:1:1:4 [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d3540), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:26:56.215 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:26:56.223 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:26:56.223 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:26:56.223 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1780) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:26:56.223 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1780) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:26:56.426 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3540 [ CSSD]2013-05-23 17:26:56.426 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3540) con(0x7f82b42c6340) skgpid ospid 3565 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:26:56.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:57.188 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:26:57.188 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:26:57.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:57.695 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:26:58.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:26:59.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:26:59.706 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:00.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:01.030 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:01.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01db002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:01.604 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:01.604 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:01.604 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:27:01.604 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:01.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01dc002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:01.612 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:01.612 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:01.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:01.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:02.191 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:02.192 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:02.738 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:03.583 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01dd002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:03.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:03.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:04.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:05.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:05.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:06.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:07.143 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:27:07.144 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:27:07.144 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:27:07.144 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d87c0) pid(3254/3254) version 11:1:1:4 [ CSSD]2013-05-23 17:27:07.161 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d87c0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:27:07.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:27:07.161 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:27:07.161 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:27:07.195 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:07.195 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:07.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:07.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:08.821 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:09.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:09.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:10.831 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:11.052 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:11.198 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:11.198 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:27:11.459 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0900) allocated [ CSSD]2013-05-23 17:27:11.459 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:27:11.460 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0900 - 1,2,3 [ CSSD]2013-05-23 17:27:11.460 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de630) proc(0x7f82b42e0900) pid(3800) version 11:1:1:4 [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0900), client(1/0x7f82b42cbda0) [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbda0 with con 0x7f82b42e0820, requested num -1 [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e1080/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:11.466 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:11.473 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbda0) [ CSSD]2013-05-23 17:27:11.473 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbda0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:11.473 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1380) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:11.473 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1380) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:11.676 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0900 [ CSSD]2013-05-23 17:27:11.676 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0900) con(0x7f82b42de630) skgpid ospid 3800 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:11.732 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0980) allocated [ CSSD]2013-05-23 17:27:11.733 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:27:11.733 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0980 - 1,2,3 [ CSSD]2013-05-23 17:27:11.733 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de650) proc(0x7f82b42e0980) pid(3756) version 11:1:1:4 [ CSSD]2013-05-23 17:27:11.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:11.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:12.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:13.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01de002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:13.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:13.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:14.284 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e32c0) allocated [ CSSD]2013-05-23 17:27:14.285 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:27:14.285 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e32c0 - 1,2,3 [ CSSD]2013-05-23 17:27:14.285 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42e32c0) pid(4148) version 11:1:1:4 [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmRegisterClient: proc(72/0x7f82b42e32c0), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42e31e0, requested num -1 [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e3a40/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:14.292 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:14.300 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:14.300 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:14.300 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e3d40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:14.300 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e3d40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:14.320 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0980 [ CSSD]2013-05-23 17:27:14.320 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0980) con(0x7f82b42de650) skgpid ospid 3756 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:14.503 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e32c0 [ CSSD]2013-05-23 17:27:14.503 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e32c0) con(0x7f82b4283170) skgpid ospid 4148 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:14.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:15.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:15.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:16.201 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:16.201 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:16.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01df002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:16.855 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:16.855 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:16.855 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:27:16.855 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:16.862 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e0002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:16.862 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:16.862 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:16.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:17.917 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:17.917 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:18.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:19.927 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:19.927 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:20.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:27:20.048 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:27:20.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:27:20.050 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:27:20.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e1002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:20.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:20.125 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:20.125 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:27:20.125 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:27:20.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e2002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:20.133 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:20.133 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:20.911 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:21.075 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:21.204 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:21.205 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:21.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:21.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:22.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:23.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e3002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:23.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:23.985 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:25.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:25.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:25.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:26.208 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:26.208 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:26.717 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0850) allocated [ CSSD]2013-05-23 17:27:26.717 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:27:26.718 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0850 - 1,2,3 [ CSSD]2013-05-23 17:27:26.718 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42e0850) pid(4248) version 11:1:1:4 [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0850), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42e0770, requested num -1 [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0fd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:26.724 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:26.731 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:26.731 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:26.731 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e12d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:26.731 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e12d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:26.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0850 [ CSSD]2013-05-23 17:27:26.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0850) con(0x7f82b4283170) skgpid ospid 4248 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:27.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:27.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:27.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:29.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:30.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:30.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:30.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:30.210 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:27:31.033 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:31.099 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:32.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:32.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:32.105 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e4002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:32.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:32.105 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:32.105 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:27:32.105 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:32.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e5002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:32.113 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:32.113 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:32.772 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0790) allocated [ CSSD]2013-05-23 17:27:32.773 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:27:32.774 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0790 - 1,2,3 [ CSSD]2013-05-23 17:27:32.774 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9290) proc(0x7f82b42e0790) pid(4331) version 11:1:1:4 [ CSSD]2013-05-23 17:27:32.778 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0790), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:32.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:32.778 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42e06b0, requested num -1 [ CSSD]2013-05-23 17:27:32.779 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:32.779 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0f10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:32.779 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:32.779 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:32.784 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:32.784 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:32.784 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1210) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:32.784 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1210) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:32.986 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0790 [ CSSD]2013-05-23 17:27:32.986 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0790) con(0x7f82b42d9290) skgpid ospid 4331 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:33.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:33.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e6002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:34.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:34.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:35.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:35.213 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:35.213 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:36.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:36.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:36.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01e7002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:36.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:36.655 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:36.655 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:27:36.655 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:36.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01e8002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:36.662 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:36.662 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:37.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:38.124 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:38.124 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:39.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:40.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:40.130 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:40.217 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:40.217 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:41.121 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:41.123 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:41.974 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0840) allocated [ CSSD]2013-05-23 17:27:41.975 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:27:41.976 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0840 - 1,2,3 [ CSSD]2013-05-23 17:27:41.976 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42de570) proc(0x7f82b42e0840) pid(4409) version 11:1:1:4 [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0840), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42e0760, requested num -1 [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0fc0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:41.982 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:41.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:41.989 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:41.989 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e12c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:41.989 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e12c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:42.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:42.135 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:42.191 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0840 [ CSSD]2013-05-23 17:27:42.191 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0840) con(0x7f82b42de570) skgpid ospid 4409 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:43.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:43.684 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01e9002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:43.809 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0790) allocated [ CSSD]2013-05-23 17:27:43.810 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:27:43.810 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0790 - 1,2,3 [ CSSD]2013-05-23 17:27:43.810 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42e0790) pid(4464) version 11:1:1:4 [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmRegisterClient: proc(71/0x7f82b42e0790), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42e06b0, requested num -1 [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42e0f10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:43.817 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:43.824 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:43.824 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:43.824 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42e1210) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:43.824 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42e1210) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:44.027 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0790 [ CSSD]2013-05-23 17:27:44.027 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0790) con(0x7f82b4283170) skgpid ospid 4464 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:44.186 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:44.186 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:45.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:45.220 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:45.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:46.190 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:46.190 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:47.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:47.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ea002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:47.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:27:47.355 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:27:47.355 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:27:47.355 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:47.362 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01eb002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:47.362 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:27:47.362 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:27:48.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:48.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:49.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:49.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:49.223 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:27:50.219 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:27:50.219 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:27:50.219 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:27:50.220 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 17:27:50.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:50.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:27:50.230 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42d9340) skgpid 31423 ospid 31423 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:51.144 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:27:51.204 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:52.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:52.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:53.210 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:53.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ec002d) incarnation(174631051) [ CSSD]2013-05-23 17:27:54.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:54.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:54.287 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:54.287 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:55.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:56.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:56.293 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:57.228 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:27:57.230 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:27:57.231 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:27:57.231 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:27:57.231 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b42aed80) pid(4579) version 11:1:1:4 [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b4207790, requested num -1 [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de0c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:27:57.237 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:27:57.244 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:27:57.244 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:27:57.244 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:27:57.244 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:27:57.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:27:57.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42dbbd0) skgpid ospid 4579 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:27:58.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:27:58.304 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:27:59.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:27:59.230 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:27:59.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:00.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:00.328 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:01.164 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:01.324 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:02.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:02.334 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:02.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01ed002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:02.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:28:02.615 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:28:02.615 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:28:02.615 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:02.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01ee002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:02.623 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:28:02.623 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:28:03.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:03.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ef002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:04.233 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:04.234 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:04.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:04.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:05.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:06.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:06.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:07.348 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:08.236 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:08.237 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:28:08.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:08.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:09.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:10.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:10.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:11.186 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:11.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:12.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:12.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:12.484 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:12.485 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:28:12.485 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:12.485 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42aed80) pid(4762) version 11:1:1:4 [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de0c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:12.492 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:12.499 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:12.499 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:28:12.499 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:12.499 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:12.701 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:12.701 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b427c5d0) skgpid ospid 4762 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:13.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:13.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:13.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:13.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f0002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:14.437 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:14.438 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:15.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:16.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:16.443 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:17.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:17.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f1002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:17.873 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:28:17.873 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:28:17.873 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:28:17.873 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:17.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f2002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:17.881 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:28:17.881 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:28:18.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:18.243 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:18.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:18.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:19.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:19.798 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d87c0), client(2/0x7f82b4257580) [ CSSD]2013-05-23 17:28:19.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4257580) [ CSSD]2013-05-23 17:28:19.798 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:28:19.798 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 17:28:20.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:20.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:21.208 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:21.546 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:22.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:22.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:23.246 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:23.246 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:23.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:23.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f3002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:24.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:24.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:25.603 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:26.542 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:26.542 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:27.249 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:27.249 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:28:27.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:27.739 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:27.740 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:28:27.740 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:27.740 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbe70) proc(0x7f82b42aed80) pid(4923) version 11:1:1:4 [ CSSD]2013-05-23 17:28:27.746 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:27.746 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:27.746 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b42dbf50, requested num -1 [ CSSD]2013-05-23 17:28:27.747 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:27.747 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:28:27.747 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:27.747 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:27.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:27.753 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:28:27.753 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:27.754 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:27.956 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:27.956 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b42cbe70) skgpid ospid 4923 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:28.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:28.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:29.621 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:30.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:30.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:31.231 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:31.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:32.252 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:32.252 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:32.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:32.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:33.035 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:33.036 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:28:33.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:33.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42aed80) pid(5011) version 11:1:1:4 [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42a93b0, requested num -1 [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:33.043 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:33.050 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:33.050 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:28:33.050 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de610) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:33.050 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:33.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f4002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:33.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:28:33.134 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:28:33.134 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:28:33.134 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:33.141 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f5002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:33.141 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:28:33.141 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:28:33.252 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:33.252 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b427c5d0) skgpid ospid 5011 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:33.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:33.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f6002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:34.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:34.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:35.705 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:36.623 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:36.623 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:36.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01f7002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:36.925 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:28:36.925 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:28:36.925 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:28:36.925 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:36.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01f8002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:36.933 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:28:36.933 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:28:37.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:37.255 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:37.711 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:38.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:38.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:39.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:40.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:40.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:41.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:41.248 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:28:41.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:41.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42aed80) pid(5373) version 11:1:1:4 [ CSSD]2013-05-23 17:28:41.251 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:41.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:41.767 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:41.767 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4283170) skgpid ospid 5373 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:42.257 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:42.257 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:42.544 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:42.545 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:28:42.545 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:42.545 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4283170) proc(0x7f82b42aed80) pid(5476) version 11:1:1:4 [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41c8ba0 with con 0x7f82b4207790, requested num -1 [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de310/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:42.553 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:42.559 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:28:42.559 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:28:42.559 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de610) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:28:42.559 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42de610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:42.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:42.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:42.665 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42e0470) allocated [ CSSD]2013-05-23 17:28:42.666 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:28:42.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42e0470 - 1,2,3 [ CSSD]2013-05-23 17:28:42.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42e0470) pid(5487) version 11:1:1:4 [ CSSD]2013-05-23 17:28:42.681 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:28:42.683 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:28:42.685 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:28:42.686 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42e0470 [ CSSD]2013-05-23 17:28:42.686 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42e0470) con(0x7f82b427c5d0) skgpid ospid 5487 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:42.762 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:42.762 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4283170) skgpid ospid 5476 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:42.999 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:28:43.000 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:28:43.001 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:28:43.001 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42aed80) pid(5537) version 11:1:1:4 [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42aed80), client(1/0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cfb30 with con 0x7f82b4283170, requested num -1 [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42de190/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:43.008 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:43.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cfb30) [ CSSD]2013-05-23 17:28:43.016 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cfb30), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:28:43.016 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de490) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:43.016 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de490) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:43.219 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:28:43.219 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b427c5d0) skgpid ospid 5537 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:43.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:43.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01f9002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:44.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:44.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:45.743 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:46.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:46.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:47.260 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:47.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:47.749 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:48.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fa002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:48.386 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:28:48.386 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:28:48.386 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:28:48.386 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:48.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fb002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:48.393 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:28:48.393 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:28:48.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:48.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:49.802 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:50.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:50.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:51.263 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:51.264 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:28:51.282 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:28:51.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:52.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:52.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:53.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:53.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01fc002d) incarnation(174631051) [ CSSD]2013-05-23 17:28:54.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:54.739 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:54.943 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 17:28:54.943 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:28:54.943 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:28:54.943 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 17:28:54.946 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:28:54.946 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:28:54.946 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:28:54.946 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 17:28:54.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:28:54.947 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:28:54.947 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:28:54.947 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:28:54.948 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e330 [ CSSD]2013-05-23 17:28:54.948 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e330) con(0x7f82b42b5840) skgpid 32049 ospid 32049 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 17:28:54.954 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42be650) skgpid 32051 ospid 32051 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:55.845 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:56.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:28:56.267 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:28:56.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:56.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:57.850 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:28:58.252 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4283170) allocated [ CSSD]2013-05-23 17:28:58.253 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:28:58.254 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4283170 - 1,2,3 [ CSSD]2013-05-23 17:28:58.254 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4283170) pid(5699) version 11:1:1:4 [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4283170), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b429e7c0, requested num -1 [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:28:58.260 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:28:58.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:28:58.266 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:28:58.266 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:28:58.266 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:28:58.469 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4283170 [ CSSD]2013-05-23 17:28:58.469 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4283170) con(0x7f82b427d8a0) skgpid ospid 5699 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:28:58.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:28:58.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:28:59.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:00.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:00.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:01.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:01.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:01.302 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:01.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:02.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:02.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:03.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(01fd002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:03.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:29:03.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:29:03.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:29:03.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:03.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(01fe002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:03.654 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:29:03.654 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:29:03.903 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:03.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(01ff002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:04.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:04.840 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:05.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:05.274 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:29:05.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:06.844 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:06.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:07.921 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:08.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:08.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:09.932 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:10.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:10.278 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:10.872 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:10.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:11.323 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:11.958 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:12.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:12.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:13.503 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4283170) allocated [ CSSD]2013-05-23 17:29:13.504 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:29:13.504 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4283170 - 1,2,3 [ CSSD]2013-05-23 17:29:13.504 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b4283170) pid(5865) version 11:1:1:4 [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4283170), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:13.510 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:13.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:29:13.517 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:29:13.517 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:13.517 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:13.720 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4283170 [ CSSD]2013-05-23 17:29:13.720 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4283170) con(0x7f82b42be650) skgpid ospid 5865 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:13.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0200002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:13.964 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:14.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:14.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:15.281 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:15.281 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:16.015 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:16.924 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:16.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:18.021 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:18.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0201002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:18.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:29:18.900 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:29:18.900 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:29:18.900 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:18.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0202002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:18.907 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:29:18.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:29:18.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:18.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:20.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:20.285 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:20.285 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:20.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:20.943 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:21.344 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:22.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:22.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:22.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:23.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0203002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:24.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:24.288 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:24.288 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:29:24.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:24.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:26.136 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:26.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:26.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:28.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:28.753 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4283170) allocated [ CSSD]2013-05-23 17:29:28.754 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:29:28.754 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4283170 - 1,2,3 [ CSSD]2013-05-23 17:29:28.754 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4283170) pid(6033) version 11:1:1:4 [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4283170), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b429e7c0, requested num -1 [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:28.761 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:28.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:28.767 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:29:28.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:28.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:28.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4283170 [ CSSD]2013-05-23 17:29:28.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4283170) con(0x7f82b427d8a0) skgpid ospid 6033 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:29.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:29.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:29.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:29.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:29.693 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4283170) allocated [ CSSD]2013-05-23 17:29:29.694 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:29:29.694 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4283170 - 1,2,3 [ CSSD]2013-05-23 17:29:29.694 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4283170) pid(6084) version 11:1:1:4 [ CSSD]2013-05-23 17:29:29.825 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:29:29.826 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:29:29.826 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:29:29.826 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d85e0) pid(6095) version 11:1:1:4 [ CSSD]2013-05-23 17:29:29.844 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:29:29.845 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:29:29.848 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:29:29.848 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b42be650) skgpid ospid 6095 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5358/0x7f82b42cd480) [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5358 (0x7f82b42cd480) [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cd480 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d8180/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:29.928 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:29:29.934 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5358 (0x7f82b42cd480) [ CSSD]2013-05-23 17:29:29.934 [1199044928] >TRACE: clssgmExitGrock: client 5358 (0x7f82b42cd480), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:29:29.934 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bea70) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:29:29.934 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42bea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:29.935 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4283170 [ CSSD]2013-05-23 17:29:29.935 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4283170) con(0x7f82b427d8a0) skgpid ospid 6084 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:30.214 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:31.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:31.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:31.371 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:32.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:33.029 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4283170) allocated [ CSSD]2013-05-23 17:29:33.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:33.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:33.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:29:33.030 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4283170 - 1,2,3 [ CSSD]2013-05-23 17:29:33.030 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b4283170) pid(4671/4671) version 11:1:1:4 [ CSSD]2013-05-23 17:29:33.046 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4283170), client(1/0x7f82b42a1820) [ CSSD]2013-05-23 17:29:33.046 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:29:33.046 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:29:33.046 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:29:33.287 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:29:33.288 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:29:33.289 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:29:33.289 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207790) proc(0x7f82b42d85e0) pid(6137) version 11:1:1:4 [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85e0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:33.295 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:33.302 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:29:33.302 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:29:33.302 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:33.303 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:33.505 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:29:33.505 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b4207790) skgpid ospid 6137 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:34.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0204002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:34.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0205002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:34.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:29:34.151 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:29:34.151 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:29:34.151 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:34.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0206002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:34.157 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:29:34.157 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:29:34.226 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:34.295 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:34.295 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:35.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:35.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:36.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:37.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:37.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:37.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0207002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:37.189 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:29:37.189 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:29:37.189 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:29:37.189 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:37.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0208002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:37.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:29:37.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:29:38.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:39.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:39.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:39.298 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:39.299 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:40.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:41.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:41.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:41.398 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:42.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:43.156 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:43.156 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:43.302 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:43.302 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:29:44.008 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:29:44.009 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:29:44.009 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:29:44.009 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257760) proc(0x7f82b42d85e0) pid(6243) version 11:1:1:4 [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85e0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:44.015 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:44.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:29:44.023 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:29:44.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:44.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:44.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0209002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:44.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:29:44.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b4257760) skgpid ospid 6243 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:29:44.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:45.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:45.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:46.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:47.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:47.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:48.305 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:48.306 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:48.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:49.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:49.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:49.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020a002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:49.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:29:49.400 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:29:49.400 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:29:49.400 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:49.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020b002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:49.407 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:29:49.407 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:29:50.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:51.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:51.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:51.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:29:52.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:53.236 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:53.236 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:53.309 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:53.309 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:29:54.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020c002d) incarnation(174631051) [ CSSD]2013-05-23 17:29:54.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:55.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:55.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:56.458 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:57.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:57.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:57.312 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:29:57.312 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:29:58.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:29:59.258 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:29:59.259 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:29:59.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:29:59.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:29:59.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:29:59.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42d85e0) pid(6380) version 11:1:1:4 [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85e0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4207790, requested num -1 [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:29:59.266 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:29:59.273 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:29:59.273 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:29:59.273 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:29:59.273 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:29:59.476 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:29:59.476 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b4285e90) skgpid ospid 6380 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:00.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:01.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:01.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:01.443 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:02.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:02.316 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:02.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:03.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:03.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:04.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(020d002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:04.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:04.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(020e002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:04.649 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:04.649 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:04.649 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:04.649 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:04.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(020f002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:04.656 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:04.656 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:05.312 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:30:05.313 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:30:05.313 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:30:05.313 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5c80) proc(0x7f82b42d85e0) pid(6665/6665) version 11:1:1:4 [ CSSD]2013-05-23 17:30:05.323 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:05.323 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:05.330 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85e0), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:30:05.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:30:05.330 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:30:05.330 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:30:05.616 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b42d5c80) skgpid 6665 ospid 6665 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:06.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:07.319 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:07.319 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:07.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:07.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:08.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:09.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:09.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:10.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:11.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:11.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:11.470 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:12.323 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:12.323 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:12.622 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:13.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:13.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:14.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0210002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:14.509 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:30:14.510 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:30:14.510 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:30:14.510 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207790) proc(0x7f82b42d85e0) pid(6727) version 11:1:1:4 [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d85e0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:30:14.517 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:14.524 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:30:14.524 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:30:14.524 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:14.524 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:30:14.633 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:14.726 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:30:14.726 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b4207790) skgpid ospid 6727 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:15.423 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:15.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:16.326 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:16.326 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:30:16.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:17.428 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:17.428 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:18.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:19.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:19.440 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:19.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0211002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:19.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:19.899 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:19.899 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:19.899 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:19.906 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0212002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:19.906 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:19.907 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cee80 [ CSSD]2013-05-23 17:30:20.249 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cee80) con(0x7f82b42d5060) skgpid 821 ospid 821 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:20.665 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:21.330 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:21.330 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:21.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:21.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:21.492 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:22.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:23.518 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:23.519 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:24.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0213002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:24.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:25.164 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d85e0) allocated [ CSSD]2013-05-23 17:30:25.165 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:30:25.165 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d85e0 - 1,2,3 [ CSSD]2013-05-23 17:30:25.165 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4285e90) proc(0x7f82b42d85e0) pid(6818/6818) version 11:1:1:4 [ CSSD]2013-05-23 17:30:25.171 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d85e0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:30:25.171 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:30:25.171 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:30:25.171 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:30:25.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:25.545 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:26.333 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:26.333 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:26.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:27.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:27.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:28.153 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42573d0) allocated [ CSSD]2013-05-23 17:30:28.154 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:30:28.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42573d0 - 1,2,3 [ CSSD]2013-05-23 17:30:28.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d5060) proc(0x7f82b42573d0) pid(6816/6816) version 11:1:1:4 [ CSSD]2013-05-23 17:30:28.161 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42573d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:30:28.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:30:28.161 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:30:28.161 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:30:28.776 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:29.571 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:29.571 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:29.759 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:30:29.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:30:29.761 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:30:29.761 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42d83d0) pid(6879) version 11:1:1:4 [ CSSD]2013-05-23 17:30:29.766 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:30:29.766 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:30:29.766 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 17:30:29.766 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:29.766 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:30:29.767 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:30:29.767 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:29.773 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:30:29.773 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:30:29.773 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cb9d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:29.773 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cb9d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:30:29.976 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:30:29.976 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b4258470) skgpid ospid 6879 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:30.827 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:31.337 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:31.337 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:31.515 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:31.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:31.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:32.833 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:33.549 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:30:33.550 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:30:33.551 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:30:33.551 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42d83d0) pid(6947) version 11:1:1:4 [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42d8300, requested num -1 [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:30:33.557 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:33.564 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:30:33.564 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:30:33.564 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbaa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:33.564 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbaa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:30:33.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:33.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:33.766 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:30:33.766 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b42aee40) skgpid ospid 6947 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:34.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0214002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:34.844 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:35.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0215002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:35.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:35.149 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:35.149 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:35.149 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:35.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0216002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:35.155 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:35.155 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:35.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:35.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:36.340 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:36.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:36.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:37.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0217002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:37.447 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:37.447 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:37.447 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:37.447 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:37.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0218002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:37.455 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:37.455 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:37.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:37.639 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:38.875 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:39.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:39.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:40.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:41.344 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:41.344 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:41.539 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:41.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:41.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:42.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:43.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:43.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:44.231 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0219002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:44.945 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:45.009 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:30:45.010 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:30:45.010 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:30:45.010 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42d83d0) pid(7036) version 11:1:1:4 [ CSSD]2013-05-23 17:30:45.016 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:30:45.016 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:30:45.016 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d8300, requested num -1 [ CSSD]2013-05-23 17:30:45.016 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:45.016 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb7a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:30:45.017 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:30:45.017 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:45.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:30:45.023 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:30:45.023 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbaa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:30:45.023 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbaa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:30:45.225 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:30:45.225 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b4258470) skgpid ospid 7036 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:30:45.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:45.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:46.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:46.348 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:46.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:47.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:47.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:48.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:49.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:49.732 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:50.351 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:50.351 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:30:50.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021a002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:50.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:50.397 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:50.397 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:50.397 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:50.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021b002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:50.403 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:50.403 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:50.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:51.604 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:30:51.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:51.738 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:52.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:53.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:53.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:54.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021c002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:55.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:55.354 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:30:55.354 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:30:55.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:55.776 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:57.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:57.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:57.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:30:59.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(021d002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:59.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:30:59.076 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:30:59.076 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:30:59.076 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:30:59.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:30:59.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(021e002d) incarnation(174631051) [ CSSD]2013-05-23 17:30:59.084 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:30:59.084 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:30:59.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:30:59.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:00.259 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:31:00.260 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:31:00.260 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:31:00.260 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42d83d0) pid(7183) version 11:1:1:4 [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b4258470, requested num -1 [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:31:00.266 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:00.272 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:00.272 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:31:00.272 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cb9d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:00.272 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cb9d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:31:00.358 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:00.358 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:00.475 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:31:00.475 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b42aee40) skgpid ospid 7183 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:01.128 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:01.626 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:01.839 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:01.839 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:03.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:03.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:03.850 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:04.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(021f002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:05.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:05.361 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:05.362 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:05.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0220002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:05.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:05.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:05.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:31:05.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:05.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0221002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:05.653 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:05.653 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:05.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:05.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:07.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:07.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:07.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:09.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:09.364 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:09.365 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:31:09.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:09.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:11.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:11.647 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:11.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:11.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:13.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:14.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:14.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:14.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0222002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:14.368 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:14.369 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:15.225 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:31:15.226 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:31:15.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:31:15.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42d83d0) pid(7388/7388) version 11:1:1:4 [ CSSD]2013-05-23 17:31:15.232 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:31:15.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:31:15.232 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:31:15.232 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:31:15.246 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:15.253 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:31:15.253 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:31:15.253 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:31:15.253 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:31:15.254 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:31:15.254 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b42aee40) skgpid 7388 ospid 7388 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:15.508 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d83d0) allocated [ CSSD]2013-05-23 17:31:15.509 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:31:15.509 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d83d0 - 1,2,3 [ CSSD]2013-05-23 17:31:15.509 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42d83d0) pid(7390) version 11:1:1:4 [ CSSD]2013-05-23 17:31:15.526 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42d83d0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:31:15.526 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:31:15.526 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 17:31:15.526 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:15.526 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cb6d0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:31:15.527 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:31:15.527 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:15.533 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:31:15.533 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:31:15.533 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cb9d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:15.533 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cb9d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:31:15.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d83d0 [ CSSD]2013-05-23 17:31:15.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d83d0) con(0x7f82b4258470) skgpid ospid 7390 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:16.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:16.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:17.252 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:18.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:18.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:19.257 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:19.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:19.372 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:20.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:20.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:20.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0223002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:20.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:20.893 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:20.893 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:31:20.893 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:20.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0224002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:20.899 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:20.899 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:21.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:21.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0225002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:21.501 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:21.501 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:21.501 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:31:21.501 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:21.508 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0226002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:21.508 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:21.508 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:21.631 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:31:21.631 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:31:21.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:31:21.633 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:31:21.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:22.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:22.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:23.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:23.375 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:23.375 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:31:24.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:24.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:24.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0227002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:24.984 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42adc50) [ CSSD]2013-05-23 17:31:24.984 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42adc50), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:31:24.984 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42adc50), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:31:24.984 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 17:31:24.991 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:31:24.991 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:31:24.991 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:31:24.992 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:31:24.992 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5110 [ CSSD]2013-05-23 17:31:24.992 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5110) con(0x7f82b42ba830) skgpid 1698 ospid 1698 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:25.327 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:26.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:26.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:27.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:28.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:28.129 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:28.379 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:28.379 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:29.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:30.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:30.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:30.770 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:31:30.771 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:31:30.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:31:30.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c7c00) pid(7562) version 11:1:1:4 [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b4258470, requested num -1 [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:31:30.789 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:30.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:31:30.798 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:31:30.798 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:30.798 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:31:31.001 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:31:31.001 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42aee40) skgpid ospid 7562 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:31.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:31.754 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:32.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:32.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:33.382 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:33.382 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:33.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:33.813 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:31:33.814 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:31:33.815 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:31:33.815 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c7c00) pid(7625) version 11:1:1:4 [ CSSD]2013-05-23 17:31:33.822 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:33.822 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:33.822 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:31:33.822 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:33.822 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:31:33.823 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:31:33.823 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:33.829 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:31:33.829 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:31:33.829 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:33.829 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:31:34.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:31:34.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42aee40) skgpid ospid 7625 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:34.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:34.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:34.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0228002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:35.447 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:36.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0229002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:36.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:36.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:36.139 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:31:36.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:36.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022a002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:36.146 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:36.146 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:36.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:36.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:37.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:37.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022b002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:37.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:37.719 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:37.719 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:31:37.719 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:37.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022c002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:37.726 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:37.726 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:38.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:38.229 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:38.385 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:38.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:39.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:40.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:40.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:41.541 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:41.777 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:42.239 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:42.239 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:42.388 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:42.389 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:31:43.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:44.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:44.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:44.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(022d002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:45.558 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:46.034 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:31:46.035 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:31:46.036 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:31:46.036 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c7c00) pid(7720) version 11:1:1:4 [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:31:46.042 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:46.049 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:31:46.049 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:31:46.049 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:31:46.049 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:31:46.251 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:31:46.251 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a29f0) skgpid ospid 7720 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:31:46.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:46.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:47.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:47.392 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:47.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:48.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:48.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:49.636 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:50.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:50.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:51.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(022e002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:51.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:31:51.390 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:31:51.390 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:31:51.390 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:31:51.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(022f002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:51.398 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:31:51.398 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:31:51.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:51.800 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:31:52.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:52.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:52.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:52.396 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:53.668 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:54.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:54.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:54.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0230002d) incarnation(174631051) [ CSSD]2013-05-23 17:31:55.679 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:56.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:56.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:57.399 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:31:57.399 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:31:57.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:31:58.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:31:58.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:31:59.737 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:00.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:00.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:01.284 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:01.285 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:32:01.285 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:01.285 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c7c00) pid(7866) version 11:1:1:4 [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4258470, requested num -1 [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:32:01.292 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:01.298 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:32:01.298 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:32:01.298 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:01.299 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:32:01.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:01.402 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:32:01.501 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:01.501 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a29f0) skgpid ospid 7866 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:01.763 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:01.834 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:02.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:02.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:03.769 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:04.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:04.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:04.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0231002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:05.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:06.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:06.406 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:06.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:06.408 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:06.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0232002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:06.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:06.640 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:06.640 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:06.640 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:06.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0233002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:06.646 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:06.646 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:07.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:08.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:08.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:09.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0234002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:09.119 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:09.119 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:09.119 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:09.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:09.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0235002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:09.126 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:09.126 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:09.837 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:10.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:10.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:11.148 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:11.149 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:32:11.149 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:11.149 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c7c00) pid(8015) version 11:1:1:4 [ CSSD]2013-05-23 17:32:11.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:11.409 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:11.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:11.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:12.452 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:12.452 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:13.818 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:13.818 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a29f0) skgpid ospid 8015 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:13.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:14.464 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:14.464 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:14.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0236002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:15.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:16.411 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:16.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:16.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:16.469 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:16.534 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:16.535 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:32:16.536 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:16.536 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c7c00) pid(8404) version 11:1:1:4 [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b4258470, requested num -1 [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:32:16.542 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:16.549 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:32:16.549 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:32:16.549 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:16.549 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:32:16.751 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:16.751 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a29f0) skgpid ospid 8404 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:17.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:18.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:18.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:19.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:20.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:32:20.374 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:32:20.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:32:20.376 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:32:20.414 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:20.415 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:32:20.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0237002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:20.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:20.454 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:20.454 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:32:20.454 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:32:20.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0238002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:20.461 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:20.461 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:20.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:20.487 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:21.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:21.886 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:21.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0239002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:21.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:21.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:21.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:21.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:21.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023a002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:21.898 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:21.898 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:22.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:22.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:23.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:24.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:24.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:24.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023b002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:25.418 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:25.418 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:25.940 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:26.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:26.589 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:27.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:28.642 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:28.642 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:30.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:30.422 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:30.422 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:30.648 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:30.648 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:31.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:31.796 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:32:31.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:31.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42c7c00) pid(8585) version 11:1:1:4 [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:32:31.803 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:31.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:32:31.810 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:32:31.810 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:31.810 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:32:31.911 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:32.012 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:32.012 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b4258470) skgpid ospid 8585 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:32.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:32.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:32.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:34.065 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:34.066 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:32:34.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:34.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b42c7c00) pid(8642) version 11:1:1:4 [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4258470, requested num -1 [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:32:34.073 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:34.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:32:34.080 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:32:34.080 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:34.080 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:32:34.089 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:34.282 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:34.283 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b42a29f0) skgpid ospid 8642 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:34.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(023c002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:34.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:34.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:35.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:35.426 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:36.141 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:36.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:36.670 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:37.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023d002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:37.140 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:37.140 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:37.140 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:37.140 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:37.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(023e002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:37.146 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:37.147 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:37.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(023f002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:37.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:37.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:37.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:37.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:38.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0240002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:38.000 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:38.000 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:38.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:38.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:38.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:40.159 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:40.429 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:40.429 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:40.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:40.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:41.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:42.165 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:42.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:42.694 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:44.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:44.702 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0241002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:44.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:44.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:45.432 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:45.433 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:46.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:46.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:46.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:47.054 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7c00) allocated [ CSSD]2013-05-23 17:32:47.055 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:32:47.056 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7c00 - 1,2,3 [ CSSD]2013-05-23 17:32:47.056 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42c7c00) pid(8755) version 11:1:1:4 [ CSSD]2013-05-23 17:32:47.062 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42c7c00), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:32:47.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:32:47.062 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a29f0, requested num -1 [ CSSD]2013-05-23 17:32:47.062 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:47.062 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8180/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:32:47.063 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:32:47.063 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:47.069 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:32:47.069 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:32:47.069 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ddcd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:32:47.069 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ddcd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:32:47.272 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7c00 [ CSSD]2013-05-23 17:32:47.272 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7c00) con(0x7f82b4258470) skgpid ospid 8755 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:48.207 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:48.863 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:48.863 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:50.239 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:50.282 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42b3db0) [ CSSD]2013-05-23 17:32:50.282 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42b3db0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:32:50.282 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42b3db0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:32:50.282 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 17:32:50.285 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4257830) [ CSSD]2013-05-23 17:32:50.285 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4257830), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:32:50.285 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4257830), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:32:50.285 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a90a0) [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a90a0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a90a0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd260 [ CSSD]2013-05-23 17:32:50.291 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd260) con(0x7f82b42c9c20) skgpid 2585 ospid 2585 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:50.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 17:32:50.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid 2587 ospid 2587 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:32:50.436 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:50.436 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:32:50.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:50.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:51.964 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:32:52.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:52.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0242002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:52.402 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:32:52.402 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:32:52.402 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:32:52.402 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:32:52.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0243002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:52.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:32:52.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:32:52.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:52.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:54.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:54.439 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:54.440 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:32:54.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0244002d) incarnation(174631051) [ CSSD]2013-05-23 17:32:54.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:54.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:56.270 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:56.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:56.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:58.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:32:58.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:32:58.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:32:59.443 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:32:59.443 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:00.290 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:00.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:00.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:01.988 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:02.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:02.304 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:33:02.305 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:33:02.306 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:33:02.306 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a3ea0) pid(8978) version 11:1:1:4 [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a3ea0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42b34e0, requested num -1 [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddc10/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:02.312 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:02.318 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:33:02.318 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:33:02.318 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c5f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:02.318 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c5f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:02.521 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:33:02.521 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42aee40) skgpid ospid 8978 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:02.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:02.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:04.301 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:04.446 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:04.446 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a1820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a1820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4283170 [ CSSD]2013-05-23 17:33:04.495 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4283170) con(0x7f82b42be650) skgpid 4671 ospid 4671 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:04.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0245002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:05.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:05.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:06.352 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:07.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:07.041 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:07.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0246002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:07.662 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:33:07.662 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:33:07.662 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:33:07.662 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:07.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0247002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:07.669 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:33:07.669 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:33:08.378 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:09.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:09.054 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:09.449 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:09.450 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:10.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:11.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:11.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:12.012 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:12.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:13.085 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:13.085 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:13.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:13.452 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:33:14.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:14.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0248002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:15.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:15.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:16.359 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe6d0) allocated [ CSSD]2013-05-23 17:33:16.359 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:16.360 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe6d0 - 1,2,3 [ CSSD]2013-05-23 17:33:16.360 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a29f0) proc(0x7f82b41fe6d0) pid(8884/8884) version 11:1:1:4 [ CSSD]2013-05-23 17:33:16.376 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b41fe6d0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:33:16.376 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:33:16.376 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:33:16.376 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:33:16.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:17.103 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:17.103 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:17.554 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:33:17.555 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:33:17.556 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:33:17.556 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a3ea0) pid(9137) version 11:1:1:4 [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a3ea0), client(1/0x7f82b42b59e0) [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42b59e0 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:17.562 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:17.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42b59e0) [ CSSD]2013-05-23 17:33:17.568 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42b59e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:33:17.568 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:17.569 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:17.771 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:33:17.771 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b427d8a0) skgpid ospid 9137 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:18.455 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:18.456 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:18.499 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:19.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:19.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:20.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:21.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:21.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:22.034 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:22.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:22.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0249002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:22.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:33:22.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:33:22.911 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:33:22.911 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:22.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024a002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:22.918 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:33:22.918 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:33:23.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:23.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:23.459 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:23.459 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:24.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:24.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024b002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:25.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:25.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:26.169 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 17:33:26.170 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:26.170 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 17:33:26.170 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42a3ea0) pid(8880/8880) version 11:1:1:4 [ CSSD]2013-05-23 17:33:26.177 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a3ea0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:33:26.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:33:26.177 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:33:26.177 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:33:26.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:26.751 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa10) allocated [ CSSD]2013-05-23 17:33:26.752 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:26.753 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa10 - 1,2,3 [ CSSD]2013-05-23 17:33:26.753 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42cfa10) pid(8878/8878) version 11:1:1:4 [ CSSD]2013-05-23 17:33:26.769 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cfa10), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:33:26.769 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:33:26.769 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:33:26.769 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:33:27.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:27.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:28.409 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:28.410 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:28.411 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:28.411 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d3ca0) pid(9245/9245) version 11:1:1:4 [ CSSD]2013-05-23 17:33:28.416 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3ca0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:33:28.416 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:33:28.416 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:33:28.416 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:33:28.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:28.463 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:28.552 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42a5080) skgpid 9245 ospid 9245 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:28.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:28.876 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:28.877 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:28.878 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:28.878 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d3ca0) pid(9254/9254) version 11:1:1:4 [ CSSD]2013-05-23 17:33:28.894 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3ca0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:33:28.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:33:28.894 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:33:28.894 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:28.949 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42a5080) skgpid 9254 ospid 9254 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:29.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:29.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:30.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:31.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:31.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:32.060 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:32.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:32.465 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:33:32.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:32.804 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:32.804 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:33:32.805 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:32.805 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d3ca0) pid(9286) version 11:1:1:4 [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3ca0), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42ce390, requested num -1 [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ceac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:32.811 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:32.818 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:33:32.818 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:33:32.818 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cedc0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:32.818 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cedc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:33.020 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:33.020 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42a5080) skgpid ospid 9286 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:33.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:33.353 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:34.333 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3c40) allocated [ CSSD]2013-05-23 17:33:34.334 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:34.335 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3c40 - 1,2,3 [ CSSD]2013-05-23 17:33:34.335 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d3c40) pid(9335) version 11:1:1:4 [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3c40), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d4a00/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:34.341 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:34.347 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:33:34.347 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:33:34.347 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d39f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:34.347 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d39f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:34.550 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3c40 [ CSSD]2013-05-23 17:33:34.550 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3c40) con(0x7f82b42a5080) skgpid ospid 9335 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:34.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:34.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(024c002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:35.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:35.358 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:36.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:37.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:37.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:37.469 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:37.469 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:38.162 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024d002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:38.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:33:38.162 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:33:38.162 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:33:38.162 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:38.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(024e002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:38.169 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:33:38.169 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:33:38.251 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(024f002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:38.251 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:33:38.251 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:33:38.251 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:33:38.251 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:38.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0250002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:38.257 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:33:38.257 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:33:38.699 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:39.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:39.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:40.760 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:40.761 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:40.761 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:40.761 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d3ca0) pid(9397) version 11:1:1:4 [ CSSD]2013-05-23 17:33:40.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:41.372 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:41.372 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42a5080) skgpid ospid 9397 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:41.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:41.381 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:42.082 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:42.472 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:42.472 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:42.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:42.843 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:42.844 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:42.844 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:42.844 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d3ca0) pid(9581) version 11:1:1:4 [ CSSD]2013-05-23 17:33:42.861 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3ca0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:33:42.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:33:42.861 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42ccac0 with con 0x7f82b42ce390, requested num -1 [ CSSD]2013-05-23 17:33:42.861 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:33:42.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ceac0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:33:42.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:42.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:42.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:33:42.868 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:33:42.868 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cedc0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:33:42.868 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cedc0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:42.977 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd7b0) allocated [ CSSD]2013-05-23 17:33:42.978 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:33:42.978 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd7b0 - 1,2,3 [ CSSD]2013-05-23 17:33:42.978 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ceae0) proc(0x7f82b42dd7b0) pid(9589) version 11:1:1:4 [ CSSD]2013-05-23 17:33:42.994 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:33:42.996 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:33:42.998 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:33:42.999 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd7b0 [ CSSD]2013-05-23 17:33:42.999 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd7b0) con(0x7f82b42ceae0) skgpid ospid 9589 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:43.070 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:43.070 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42be650) skgpid ospid 9581 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:43.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:43.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:44.790 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:44.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0251002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:45.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:45.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:46.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:47.476 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:47.476 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:47.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:47.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:48.053 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3ca0) allocated [ CSSD]2013-05-23 17:33:48.054 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:33:48.055 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3ca0 - 1,2,3 [ CSSD]2013-05-23 17:33:48.055 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d3ca0) pid(9637) version 11:1:1:4 [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3ca0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce9f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:33:48.071 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:48.078 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:33:48.078 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:33:48.078 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cecf0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:33:48.078 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cecf0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:33:48.281 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3ca0 [ CSSD]2013-05-23 17:33:48.281 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3ca0) con(0x7f82b42be650) skgpid ospid 9637 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:48.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:49.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:49.495 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:50.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:51.479 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:51.479 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:33:51.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:51.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:52.109 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:33:52.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:53.408 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0252002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:53.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:33:53.408 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:33:53.408 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:33:53.408 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:33:53.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0253002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:53.414 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:33:53.414 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:33:53.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:53.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:54.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0254002d) incarnation(174631051) [ CSSD]2013-05-23 17:33:54.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:55.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4257580) [ CSSD]2013-05-23 17:33:55.024 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4257580), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:33:55.024 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4257580), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:33:55.024 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:33:55.031 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42c6340) skgpid 3254 ospid 3254 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:33:55.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid 30300 ospid 30300 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:33:55.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:55.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:56.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:33:56.483 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:33:56.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:57.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:57.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:33:58.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:33:59.594 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:33:59.594 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:00.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:01.486 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:01.486 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:01.599 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:01.599 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:02.129 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:02.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:03.315 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:34:03.316 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:34:03.316 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:34:03.316 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d87c0) pid(9814) version 11:1:1:4 [ CSSD]2013-05-23 17:34:03.322 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:03.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:03.322 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:34:03.322 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:03.322 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:34:03.323 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:03.323 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:03.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:03.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:34:03.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:03.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:03.532 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:34:03.532 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b4257120) skgpid ospid 9814 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:03.654 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:03.654 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:04.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0255002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:04.969 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:05.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:05.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:06.489 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:06.489 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:06.975 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:07.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:07.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:08.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0256002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:08.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:34:08.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:34:08.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:34:08.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:08.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0257002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:08.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:34:08.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:34:08.982 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:09.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:09.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:10.492 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:10.492 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:34:11.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:11.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:11.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:12.155 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:13.029 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:13.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:13.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:14.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0258002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:15.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:15.496 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:15.496 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:15.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:15.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:17.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:17.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:17.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:18.565 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:34:18.566 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:34:18.567 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:34:18.567 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b4207a80) pid(9994) version 11:1:1:4 [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:18.573 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:18.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:34:18.580 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:34:18.580 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:18.580 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:18.782 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:34:18.782 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a5080) skgpid ospid 9994 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:19.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:19.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:19.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:20.499 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:20.499 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:21.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:21.801 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:21.801 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:22.176 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:23.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:23.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:23.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:23.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0259002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:23.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:34:23.916 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:34:23.916 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:34:23.916 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:23.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025a002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:23.922 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:34:23.923 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:34:24.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025b002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:25.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:25.503 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:25.503 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:25.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:25.811 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:27.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:27.856 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:27.856 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:29.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:29.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:29.886 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:30.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:34:30.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:34:30.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:34:30.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b42d87c0) pid(10142) version 11:1:1:4 [ CSSD]2013-05-23 17:34:30.134 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:34:30.135 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:34:30.136 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:34:30.136 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(10154) version 11:1:1:4 [ CSSD]2013-05-23 17:34:30.152 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:34:30.154 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:34:30.157 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:34:30.157 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 10154 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5359/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5359 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42a1cd0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:30.239 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:34:30.245 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5359 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:34:30.245 [1199044928] >TRACE: clssgmExitGrock: client 5359 (0x7f82b41ff1f0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:34:30.245 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:34:30.245 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:30.246 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:34:30.246 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42dbbd0) skgpid ospid 10142 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:30.506 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:30.506 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:31.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:31.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:31.891 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:32.198 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:33.170 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:33.818 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:34:33.819 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:34:33.820 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:34:33.820 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(10188) version 11:1:1:4 [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:33.826 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:33.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:34:33.833 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:34:33.833 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:33.833 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:33.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:33.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:34.036 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:34:34.036 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 10188 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:34.589 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:34:34.590 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:34:34.590 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:34:34.590 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b42d87c0) pid(10235) version 11:1:1:4 [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:34.607 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:34.613 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:34:34.613 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:34:34.613 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:34.613 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:34.816 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:34:34.816 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42dbbd0) skgpid ospid 10235 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:34.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(025c002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:35.182 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:35.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:35.510 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:35.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:35.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:37.188 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:37.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:37.934 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:38.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025d002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:38.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:34:38.505 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:34:38.505 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:34:38.505 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:38.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(025e002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:38.512 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:34:38.512 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:34:39.164 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(025f002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:39.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:34:39.164 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:34:39.164 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:34:39.164 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:39.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0260002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:39.170 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:34:39.170 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:34:39.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:39.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:39.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:40.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:40.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:41.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:41.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:41.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:42.221 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:43.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:44.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:44.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:44.516 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:44.517 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:34:45.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0261002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:45.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:46.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:46.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:47.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:48.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:48.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:49.069 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:34:49.070 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:34:49.070 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:34:49.070 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(10350) version 11:1:1:4 [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:34:49.086 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:34:49.087 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:49.093 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:34:49.093 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:34:49.093 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:34:49.093 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:34:49.295 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:34:49.295 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 10350 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:34:49.314 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:49.520 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:49.520 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:50.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:50.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:51.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:52.136 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:52.136 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:52.246 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:34:53.411 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:54.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:54.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:54.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0262002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:54.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:34:54.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:34:54.414 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:34:54.414 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:34:54.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0263002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:54.421 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:34:54.421 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:34:54.523 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:54.523 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:34:55.041 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0264002d) incarnation(174631051) [ CSSD]2013-05-23 17:34:55.462 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:56.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:56.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:57.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:58.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:34:58.185 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:34:59.474 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:34:59.527 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:34:59.527 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:00.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:00.191 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:01.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:02.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:02.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:02.267 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:03.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:03.529 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:03.530 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:35:04.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:04.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:04.328 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:35:04.329 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:35:04.329 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:35:04.329 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d87c0) pid(10511) version 11:1:1:4 [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:35:04.335 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:04.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:35:04.341 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:35:04.341 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:04.341 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:35:04.544 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:35:04.544 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42a5080) skgpid ospid 10511 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:04.722 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:35:04.723 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:35:04.723 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:35:04.723 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b4207a80) pid(10559/10559) version 11:1:1:4 [ CSSD]2013-05-23 17:35:04.740 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:35:04.740 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:35:04.740 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:35:04.740 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:35:05.032 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42dbbd0) skgpid 10559 ospid 10559 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:05.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0265002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:05.582 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:06.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:06.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:07.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:08.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:08.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:08.533 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:08.533 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:09.594 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:09.663 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0266002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:09.663 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:35:09.663 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:35:09.663 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:35:09.663 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:09.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0267002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:09.669 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:35:09.669 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:35:10.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:10.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:11.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:12.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:12.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:12.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:13.536 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:13.536 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:13.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:14.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:14.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:15.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0268002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:15.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:16.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:16.333 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:17.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:18.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:18.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:18.540 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:18.540 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:19.577 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:35:19.578 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:35:19.578 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:35:19.578 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b42d87c0) pid(10660) version 11:1:1:4 [ CSSD]2013-05-23 17:35:19.584 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:35:19.585 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:19.592 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:35:19.592 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:35:19.592 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:19.592 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:35:19.682 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:19.795 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:35:19.795 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42a5080) skgpid ospid 10660 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:20.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:20.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:21.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:22.313 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:22.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:22.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:22.543 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:22.543 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:35:23.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:24.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:24.386 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:24.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0269002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:24.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:35:24.911 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:35:24.911 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:35:24.912 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:24.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026a002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:24.918 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:35:24.918 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:35:25.119 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026b002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:25.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:26.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:26.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:27.547 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:27.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:27.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:28.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:28.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:29.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:30.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:30.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:31.788 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:32.335 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:32.478 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:32.478 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:32.550 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:32.550 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:33.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:34.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:34.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:34.828 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:35:34.829 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:35:34.830 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:35:34.830 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(10838) version 11:1:1:4 [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b42a5080, requested num -1 [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:35:34.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:34.845 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:35:34.845 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:35:34.845 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:34.845 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:35:34.859 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:35:34.860 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:35:34.860 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:35:34.860 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b42d87c0) pid(10843) version 11:1:1:4 [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d87c0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:35:34.866 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:34.872 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:35:34.872 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:35:34.872 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4286740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:34.872 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4286740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:35:35.047 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:35:35.047 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 10838 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:35.074 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:35:35.074 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42dbbd0) skgpid ospid 10843 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:35.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(026c002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:35.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:36.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:36.513 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:37.553 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:37.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:37.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:38.585 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:38.585 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:38.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026d002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:38.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:35:38.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:35:38.769 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:35:38.769 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:38.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(026e002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:38.776 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:35:38.776 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:35:39.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:40.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(026f002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:40.167 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:35:40.167 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:35:40.167 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:35:40.167 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:40.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0270002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:40.174 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:35:40.174 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:35:40.591 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:40.591 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:41.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:41.556 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:35:41.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:42.362 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:42.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:42.597 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:43.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:44.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:44.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:45.170 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0271002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:45.914 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:46.559 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:46.559 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:46.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:46.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:47.920 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:48.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:48.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:49.973 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:50.077 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:35:50.078 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:35:50.078 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:35:50.078 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(10998) version 11:1:1:4 [ CSSD]2013-05-23 17:35:50.084 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:35:50.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:35:50.084 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42dbbd0, requested num -1 [ CSSD]2013-05-23 17:35:50.084 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:50.084 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:35:50.085 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:35:50.085 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:50.091 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:35:50.091 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:35:50.091 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:35:50.091 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:35:50.294 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:35:50.294 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 10998 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:35:50.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:50.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:51.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:51.562 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:51.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:52.392 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:35:52.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:52.668 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:53.985 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:54.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:54.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:55.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0272002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:55.417 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0273002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:55.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:35:55.417 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:35:55.417 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:35:55.417 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:35:55.425 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0274002d) incarnation(174631051) [ CSSD]2013-05-23 17:35:55.425 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:35:55.425 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:35:55.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:56.565 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:35:56.565 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:35:56.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:56.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:35:58.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:35:58.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:35:58.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:00.094 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:00.568 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:00.568 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:36:00.722 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:00.722 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:02.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:02.412 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:02.728 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:02.728 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:04.126 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:04.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:04.780 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:05.229 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0275002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:05.337 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:36:05.338 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:36:05.339 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:36:05.339 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b42d87c0) pid(11141) version 11:1:1:4 [ CSSD]2013-05-23 17:36:05.344 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:36:05.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:36:05.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:36:05.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:05.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:36:05.345 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:36:05.345 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:05.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:36:05.352 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:36:05.352 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:05.352 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:36:05.554 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:36:05.554 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42dbbd0) skgpid ospid 11141 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:05.571 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:05.571 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:06.177 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:06.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:06.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:08.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:08.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:08.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:10.194 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:10.574 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:10.575 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:10.668 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0276002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:10.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:10.668 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:10.668 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:36:10.668 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:10.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0277002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:10.674 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:10.674 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:10.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:10.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:12.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:12.436 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:12.827 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:12.827 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:14.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:14.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:14.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:15.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0278002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:15.578 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:15.578 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:15.681 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:36:15.682 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:36:15.682 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:36:15.682 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(11250/11250) version 11:1:1:4 [ CSSD]2013-05-23 17:36:15.688 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:36:15.688 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:36:15.688 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:36:15.688 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a51f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a51f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:36:15.706 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 11250 ospid 11250 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:16.276 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:16.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:16.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:18.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:18.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:18.918 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:19.581 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:19.581 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:36:20.293 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:20.598 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d87c0) allocated [ CSSD]2013-05-23 17:36:20.598 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:36:20.599 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d87c0 - 1,2,3 [ CSSD]2013-05-23 17:36:20.599 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d87c0) pid(11284) version 11:1:1:4 [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d87c0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:36:20.604 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:20.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:36:20.611 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:36:20.611 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4257500) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:20.611 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4257500) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:36:20.814 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d87c0 [ CSSD]2013-05-23 17:36:20.814 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d87c0) con(0x7f82b42c6340) skgpid ospid 11284 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:20.923 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:20.923 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:21.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0279002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:21.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:21.797 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:21.797 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:36:21.797 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:21.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027a002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:21.804 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:21.804 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:21.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:36:21.944 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:36:21.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:36:21.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:36:22.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:22.458 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:22.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:22.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:24.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:24.585 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:24.585 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:24.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:24.981 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:25.391 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027b002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:25.928 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027c002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:25.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:25.928 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:25.928 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:36:25.928 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:25.934 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(027d002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:25.934 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:25.934 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:26.317 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:27.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:27.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:28.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:29.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:29.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:29.588 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:29.589 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:30.154 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:36:30.154 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:36:30.155 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:36:30.155 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42dbbd0) proc(0x7f82b4207a80) pid(10715/10715) version 11:1:1:4 [ CSSD]2013-05-23 17:36:30.161 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:36:30.161 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:36:30.161 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:36:30.161 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:36:30.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:31.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:31.023 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:32.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:32.480 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:33.029 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:33.029 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:34.407 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:34.591 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:34.592 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:35.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:35.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:35.116 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:36:35.117 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:36:35.117 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:36:35.117 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d8490) pid(11448) version 11:1:1:4 [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:36:35.134 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:35.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:36:35.141 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:36:35.141 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:35.142 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:36:35.344 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:36:35.344 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b4257120) skgpid ospid 11448 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:35.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(027e002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:35.847 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:36:35.848 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:36:35.849 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:36:35.849 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d8490) pid(11457) version 11:1:1:4 [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:36:35.855 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:35.861 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:36:35.861 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:36:35.861 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:35.862 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:36:36.064 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:36:36.064 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42c6340) skgpid ospid 11457 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:36.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:37.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:37.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:38.444 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:39.028 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(027f002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:39.028 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:39.028 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:39.028 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:36:39.028 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:39.035 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0280002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:39.035 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:39.035 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:39.138 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:39.138 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:39.595 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:39.595 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:40.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:41.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:41.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:41.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0281002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:41.178 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:41.178 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:41.178 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:36:41.178 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:41.185 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0282002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:41.185 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:41.185 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:42.482 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:42.517 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:43.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:43.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:44.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:44.598 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:44.598 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:45.182 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:45.182 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:45.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0283002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:46.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:47.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:47.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:48.505 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:49.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:49.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:49.601 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:49.602 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:50.516 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:51.096 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:36:51.097 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:36:51.098 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:36:51.098 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d8490) pid(11629) version 11:1:1:4 [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:36:51.104 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:51.110 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:36:51.110 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:36:51.110 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:36:51.110 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:36:51.204 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:51.204 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:51.312 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:36:51.312 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42c6340) skgpid ospid 11629 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:36:52.522 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:52.540 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:36:53.216 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:53.216 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:54.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:54.605 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:54.605 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:36:55.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:55.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:55.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0284002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:56.427 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0285002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:56.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:36:56.427 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:36:56.427 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:36:56.427 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:36:56.434 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0286002d) incarnation(174631051) [ CSSD]2013-05-23 17:36:56.434 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:36:56.434 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:36:56.528 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:57.227 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:57.227 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:58.553 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:36:59.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:36:59.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:36:59.608 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:36:59.609 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:00.586 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:01.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:01.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:02.561 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:02.593 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:03.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:03.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:04.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:04.612 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:04.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:05.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:05.264 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:05.495 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0287002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:06.355 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:06.356 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:37:06.357 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:06.357 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d8490) pid(11789) version 11:1:1:4 [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:06.363 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:06.370 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:37:06.370 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:06.370 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:06.370 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:06.573 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:06.573 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42ccc30) skgpid ospid 11789 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:06.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:07.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:07.269 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:08.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:09.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:09.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:09.615 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:09.616 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:10.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:11.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:11.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:11.530 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:11.531 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:37:11.531 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:11.531 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d8490) pid(11899) version 11:1:1:4 [ CSSD]2013-05-23 17:37:11.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0288002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:11.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:11.686 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:11.686 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:37:11.686 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:11.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0289002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:11.694 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:11.694 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:12.582 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:12.632 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:13.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:13.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:13.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:13.618 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:37:13.956 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:13.956 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b4257120) skgpid ospid 11899 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:14.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:14.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:37:14.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:14.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d8490) pid(12235) version 11:1:1:4 [ CSSD]2013-05-23 17:37:14.632 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:14.633 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:14.639 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:37:14.639 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:14.639 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:14.639 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:14.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:14.841 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:14.841 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42ccc30) skgpid ospid 12235 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:15.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:15.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:15.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028a002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:16.730 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:17.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:17.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:18.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:18.622 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:18.736 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:19.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:19.501 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:20.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:37:20.700 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:37:20.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:37:20.702 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:37:20.771 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028b002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:20.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:20.771 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:20.771 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:37:20.771 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:37:20.780 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028c002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:20.780 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:20.780 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:20.787 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:21.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:21.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:21.604 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:21.605 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:37:21.606 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:21.606 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d8490) pid(12294) version 11:1:1:4 [ CSSD]2013-05-23 17:37:21.612 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:37:21.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:37:21.612 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:37:21.612 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:21.612 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:21.613 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:21.613 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:21.618 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:37:21.618 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:21.618 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:21.619 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:21.821 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:21.821 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42c6340) skgpid ospid 12294 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:22.602 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:22.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:23.539 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:23.539 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:23.625 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:23.625 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:24.804 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:25.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(028d002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:25.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:25.544 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:26.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:26.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(028e002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:26.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:26.940 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:26.940 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:37:26.940 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:26.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(028f002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:26.946 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:26.947 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:27.550 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:27.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:28.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:28.628 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:28.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:29.602 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:29.602 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:30.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:31.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:31.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:32.623 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:32.631 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:32.631 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:37:32.894 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:33.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:33.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:34.904 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:35.384 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:35.385 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:37:35.385 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:35.385 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d8490) pid(12424) version 11:1:1:4 [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:35.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:35.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:37:35.398 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:35.398 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:35.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:35.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0290002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:35.601 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:35.601 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42ccc30) skgpid ospid 12424 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:35.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:35.725 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:36.853 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:36.854 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:37:36.854 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:36.854 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d8490) pid(12439) version 11:1:1:4 [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:36.860 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:36.866 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:37:36.866 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:36.866 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:36.866 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:36.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:37.069 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:37.069 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42c6340) skgpid ospid 12439 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:37.635 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:37.635 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:37.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:37.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:38.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:39.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0291002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:39.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:39.294 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:39.294 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:37:39.294 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:39.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0292002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:39.301 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:39.301 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:39.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:39.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:40.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:41.747 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:41.747 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:42.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0293002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:42.194 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:42.194 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:42.194 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:37:42.194 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:42.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0294002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:42.201 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:42.201 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:42.638 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:42.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:42.645 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:42.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:43.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:43.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:44.141 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:37:44.142 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:37:44.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:37:44.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d8490) pid(12531) version 11:1:1:4 [ CSSD]2013-05-23 17:37:44.148 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:37:44.148 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:37:44.148 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:37:44.148 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:44.148 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:44.149 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:44.149 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:44.155 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:37:44.155 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:44.155 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cffa0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:44.155 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cffa0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:44.358 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:37:44.358 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b4257120) skgpid ospid 12531 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:45.006 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:45.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0295002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:45.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:45.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:47.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:47.642 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:47.642 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:47.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:47.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:49.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:49.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:49.844 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:50.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:37:50.414 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:37:50.414 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:37:50.414 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:37:50.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42573d0 [ CSSD]2013-05-23 17:37:50.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42573d0) con(0x7f82b42d5060) skgpid 6816 ospid 6816 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d85e0 [ CSSD]2013-05-23 17:37:50.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d85e0) con(0x7f82b4285e90) skgpid 6818 ospid 6818 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:51.129 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:51.645 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:51.645 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:37:51.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:51.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:52.110 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a89c0) allocated [ CSSD]2013-05-23 17:37:52.111 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:37:52.112 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a89c0 - 1,2,3 [ CSSD]2013-05-23 17:37:52.112 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a89c0) pid(12597) version 11:1:1:4 [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a89c0), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:37:52.118 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:52.125 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:37:52.125 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:37:52.125 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:37:52.125 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:37:52.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a89c0 [ CSSD]2013-05-23 17:37:52.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a89c0) con(0x7f82b42c6340) skgpid ospid 12597 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:37:52.666 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:37:53.135 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:53.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:53.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:55.186 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:55.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0296002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:55.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:55.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:56.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:37:56.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:37:57.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:37:57.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0297002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:57.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:37:57.444 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:37:57.444 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:37:57.444 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:37:57.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0298002d) incarnation(174631051) [ CSSD]2013-05-23 17:37:57.450 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:37:57.451 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:37:57.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:37:57.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:37:59.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:00.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:00.024 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:01.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:01.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:01.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:02.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:02.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:02.686 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:03.233 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:04.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:04.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:05.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:05.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0299002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:06.045 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:06.045 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:06.656 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:06.656 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:07.262 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:07.360 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:38:07.361 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:38:07.362 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:38:07.362 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d9290) pid(12750) version 11:1:1:4 [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9290), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:07.368 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:07.375 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:07.375 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:38:07.375 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:07.376 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:07.578 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:38:07.578 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b4257120) skgpid ospid 12750 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:08.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:08.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:09.267 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:10.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:10.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:11.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:11.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:11.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:12.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:12.131 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:12.706 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:12.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029a002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:12.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:38:12.714 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:38:12.714 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:38:12.714 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:12.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029b002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:12.721 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:38:12.721 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:38:13.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:14.222 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:14.222 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:15.307 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:15.679 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029c002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:16.268 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:16.268 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:16.663 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:16.663 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:17.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:18.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:18.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:19.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:20.305 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:20.305 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:21.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:21.667 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:21.667 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:22.311 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:22.311 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:22.612 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5130) allocated [ CSSD]2013-05-23 17:38:22.613 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:38:22.613 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5130 - 1,2,3 [ CSSD]2013-05-23 17:38:22.613 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42a5130) pid(12901) version 11:1:1:4 [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5130), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:22.620 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:22.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:38:22.626 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:38:22.626 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:22.626 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:22.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:22.829 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5130 [ CSSD]2013-05-23 17:38:22.829 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5130) con(0x7f82b42c6340) skgpid ospid 12901 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:23.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:24.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:24.312 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:25.428 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:25.669 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:25.669 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:38:25.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(029d002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:26.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:26.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:27.435 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:27.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(029e002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:27.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:38:27.963 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:38:27.963 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:38:27.963 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:27.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(029f002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:27.969 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:38:27.969 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:38:28.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:28.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:29.441 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:30.375 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:30.375 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:30.673 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:30.673 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:31.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:32.380 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:32.380 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:32.753 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:33.457 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:34.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:34.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:35.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:35.642 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a89c0) allocated [ CSSD]2013-05-23 17:38:35.643 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:35.644 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a89c0 - 1,2,3 [ CSSD]2013-05-23 17:38:35.644 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a89c0) pid(13034) version 11:1:1:4 [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a89c0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:35.650 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:35.656 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:38:35.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:38:35.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:35.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:35.676 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:35.677 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:35.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a0002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:35.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a89c0 [ CSSD]2013-05-23 17:38:35.859 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a89c0) con(0x7f82b42b0d30) skgpid ospid 13034 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:36.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:36.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:37.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:37.868 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:38:37.869 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:38:37.869 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:38:37.869 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d9290) pid(13064) version 11:1:1:4 [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9290), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9760 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe800/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:37.875 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:37.882 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:38:37.882 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9760), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:38:37.882 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:37.882 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:38.084 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:38:38.084 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42ccc30) skgpid ospid 13064 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:38.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:38.431 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:39.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:39.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a1002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:39.551 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:38:39.551 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:38:39.551 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:38:39.551 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:39.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a2002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:39.557 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:38:39.557 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:38:40.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:40.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:40.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:40.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:40.851 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5130) allocated [ CSSD]2013-05-23 17:38:40.851 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:40.852 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5130 - 1,2,3 [ CSSD]2013-05-23 17:38:40.852 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42a5130) pid(13128/13128) version 11:1:1:4 [ CSSD]2013-05-23 17:38:40.868 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5130), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:40.868 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:40.868 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:38:40.868 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:38:40.884 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:40.884 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:38:40.885 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:38:40.885 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:38:40.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5130 [ CSSD]2013-05-23 17:38:40.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5130) con(0x7f82b42b0d30) skgpid 13128 ospid 13128 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:41.028 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a89c0) allocated [ CSSD]2013-05-23 17:38:41.029 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:41.029 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a89c0 - 1,2,3 [ CSSD]2013-05-23 17:38:41.029 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a89c0) pid(13172/13172) version 11:1:1:4 [ CSSD]2013-05-23 17:38:41.035 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a89c0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:38:41.035 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:38:41.035 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:38:41.035 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:38:41.232 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 17:38:41.233 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:41.233 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 17:38:41.233 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b4286740) pid(13144) version 11:1:1:4 [ CSSD]2013-05-23 17:38:41.531 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:41.834 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 17:38:41.834 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42ba970) skgpid ospid 13144 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:42.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:42.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:42.778 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:43.147 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:38:43.147 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:43.148 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:38:43.148 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b427c510) pid(13328) version 11:1:1:4 [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42adc50 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:43.165 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:43.171 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:38:43.171 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:38:43.171 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:38:43.171 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:43.209 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a3002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:43.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:38:43.209 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:38:43.209 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:38:43.209 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:43.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a4002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:43.215 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:38:43.215 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:38:43.278 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8dc0) allocated [ CSSD]2013-05-23 17:38:43.279 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:38:43.280 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8dc0 - 1,2,3 [ CSSD]2013-05-23 17:38:43.280 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d8dc0) pid(13336) version 11:1:1:4 [ CSSD]2013-05-23 17:38:43.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:38:43.296 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:38:43.298 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:38:43.299 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8dc0 [ CSSD]2013-05-23 17:38:43.299 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8dc0) con(0x7f82b4257120) skgpid ospid 13336 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:43.374 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:38:43.374 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b0d30) skgpid ospid 13328 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:43.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:44.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:44.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:44.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:44.683 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:38:45.609 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:45.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a5002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:46.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:46.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:47.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:48.511 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:48.511 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:49.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:49.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:49.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:50.517 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:50.517 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:51.651 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:52.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:52.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:52.803 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:38:53.116 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 17:38:53.117 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:38:53.118 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 17:38:53.118 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b4286740) pid(13428) version 11:1:1:4 [ CSSD]2013-05-23 17:38:53.134 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4286740), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:53.134 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:53.134 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:38:53.134 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:53.134 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:38:53.135 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:38:53.135 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:53.141 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:38:53.141 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:38:53.141 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:38:53.141 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:38:53.343 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 17:38:53.343 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42b0d30) skgpid ospid 13428 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:38:53.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:54.532 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:54.532 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:54.690 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:54.690 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:55.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:55.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a6002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:56.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:56.537 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:57.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:38:58.460 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02a7002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:58.460 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:38:58.460 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:38:58.460 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:38:58.460 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:38:58.467 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02a8002d) incarnation(174631051) [ CSSD]2013-05-23 17:38:58.467 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:38:58.467 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:38:58.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:38:58.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:38:59.694 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:38:59.694 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:38:59.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:00.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:00.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:01.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:02.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:02.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:02.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:03.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:03.697 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:39:03.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:04.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:04.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:05.810 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:05.811 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02a9002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:06.640 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:06.640 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:07.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:08.384 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:39:08.385 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:39:08.385 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:39:08.385 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b427c510) pid(13578) version 11:1:1:4 [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:08.391 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:08.397 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:39:08.397 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:39:08.397 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:08.398 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:08.600 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:39:08.600 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42b0d30) skgpid ospid 13578 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:08.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:08.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:08.700 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:08.701 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:09.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:10.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:10.658 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:11.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:12.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:12.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:12.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:13.704 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:13.704 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:13.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02aa002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:13.712 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:39:13.712 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:39:13.712 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:39:13.712 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:13.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ab002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:13.719 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:39:13.719 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:39:13.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:14.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:14.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:15.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ac002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:15.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:16.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:16.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:17.707 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:17.707 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:39:17.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:18.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:18.813 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:19.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:20.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:20.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:21.954 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:22.711 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:22.711 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:22.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:22.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:22.892 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:23.633 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 17:39:23.634 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:39:23.634 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 17:39:23.634 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b4286740) pid(13723) version 11:1:1:4 [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4286740), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:23.641 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:23.647 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:39:23.647 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:39:23.647 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:23.647 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:23.850 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 17:39:23.850 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42b0d30) skgpid ospid 13723 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:23.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:24.834 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:24.834 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:25.883 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ad002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:25.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:26.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:26.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:27.714 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:27.715 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:27.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:28.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:28.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:28.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ae002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:28.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:39:28.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:39:28.960 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:39:28.960 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:28.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02af002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:28.967 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:39:28.967 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:39:29.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:30.322 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:39:30.323 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:39:30.324 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:39:30.324 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba970) proc(0x7f82b427c510) pid(13824) version 11:1:1:4 [ CSSD]2013-05-23 17:39:30.443 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:39:30.444 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:39:30.445 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:39:30.445 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42d8e90) pid(13834) version 11:1:1:4 [ CSSD]2013-05-23 17:39:30.461 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:39:30.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:39:30.465 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:39:30.465 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42b0d30) skgpid ospid 13834 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5360/0x7f82b4207960) [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5360 (0x7f82b4207960) [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4207960 with con 0x7f82b429e0c0, requested num -1 [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42cfca0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:30.545 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:39:30.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5360 (0x7f82b4207960) [ CSSD]2013-05-23 17:39:30.552 [1199044928] >TRACE: clssgmExitGrock: client 5360 (0x7f82b4207960), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:39:30.552 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3350) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:39:30.553 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b3350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:30.554 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:39:30.554 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b42ba970) skgpid ospid 13824 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:30.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:30.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:32.014 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:32.718 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:32.718 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:32.945 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:32.945 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:32.946 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:34.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:34.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:34.956 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:35.907 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 17:39:35.908 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:39:35.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b0002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:35.908 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 17:39:35.908 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4286740) pid(13877) version 11:1:1:4 [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4286740), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:35.915 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:35.922 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:39:35.922 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:39:35.922 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:35.922 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:36.031 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:36.124 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 17:39:36.124 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b4257120) skgpid ospid 13877 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:36.721 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:36.722 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:39:36.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:36.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:38.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:38.887 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b427c510) allocated [ CSSD]2013-05-23 17:39:38.888 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:39:38.888 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b427c510 - 1,2,3 [ CSSD]2013-05-23 17:39:38.888 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b427c510) pid(13904) version 11:1:1:4 [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b427c510), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:38.894 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:38.901 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:39:38.901 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:39:38.901 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:38.901 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:38.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:38.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:39.103 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b427c510 [ CSSD]2013-05-23 17:39:39.103 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b427c510) con(0x7f82b4257120) skgpid ospid 13904 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:39.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b1002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:39.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:39:39.809 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:39:39.810 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:39:39.810 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:39.816 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b2002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:39.816 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:39:39.816 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:39:40.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:40.989 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:40.989 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:41.725 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:41.726 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:42.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:42.984 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:42.994 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:42.994 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:44.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:44.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b3002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:44.219 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:39:44.219 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:39:44.219 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:39:44.219 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:44.226 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b4002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:44.226 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:39:44.226 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:39:45.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:45.026 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:45.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b5002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:46.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:46.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:46.729 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:47.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:47.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:48.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:49.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:49.044 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:49.838 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 17:39:49.839 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:39:49.839 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 17:39:49.839 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4286740) pid(13483/13483) version 11:1:1:4 [ CSSD]2013-05-23 17:39:49.855 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4286740), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:39:49.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:39:49.855 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:39:49.855 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:39:50.169 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:50.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:50.732 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:39:51.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:51.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:52.175 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:53.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:39:53.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:53.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:54.138 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42bab90) allocated [ CSSD]2013-05-23 17:39:54.138 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:39:54.139 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42bab90 - 1,2,3 [ CSSD]2013-05-23 17:39:54.139 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42bab90) pid(14053) version 11:1:1:4 [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42bab90), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42be650, requested num -1 [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:39:54.145 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:54.152 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:39:54.152 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:39:54.152 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7f60) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:39:54.152 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7f60) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:39:54.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:54.355 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42bab90 [ CSSD]2013-05-23 17:39:54.355 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42bab90) con(0x7f82b42b0d30) skgpid ospid 14053 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:39:55.067 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:55.067 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:55.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:39:55.736 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:39:55.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b6002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:56.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:57.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:57.074 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:58.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:39:59.125 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:39:59.125 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:39:59.468 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02b7002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:59.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:39:59.468 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:39:59.468 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:39:59.468 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:39:59.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02b8002d) incarnation(174631051) [ CSSD]2013-05-23 17:39:59.475 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:39:59.475 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:00.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:00.738 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:00.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:01.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:01.151 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:02.275 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:03.035 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:03.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:03.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:04.281 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:05.168 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:05.168 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:05.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42bab90) allocated [ CSSD]2013-05-23 17:40:05.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:40:05.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42bab90 - 1,2,3 [ CSSD]2013-05-23 17:40:05.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b0d30) proc(0x7f82b42bab90) pid(14379/14379) version 11:1:1:4 [ CSSD]2013-05-23 17:40:05.228 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42bab90), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:40:05.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:40:05.228 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:40:05.228 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42bab90 [ CSSD]2013-05-23 17:40:05.482 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42bab90) con(0x7f82b42b0d30) skgpid 14379 ospid 14379 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:05.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:05.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:05.985 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02b9002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:06.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:07.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:07.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:08.338 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:08.628 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:40:08.628 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:40:08.629 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:40:08.629 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d8490) pid(12589/12589) version 11:1:1:4 [ CSSD]2013-05-23 17:40:08.644 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d8490), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:40:08.644 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:40:08.644 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:40:08.644 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:40:09.225 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:09.225 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:09.388 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3d20) allocated [ CSSD]2013-05-23 17:40:09.389 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:40:09.390 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3d20 - 1,2,3 [ CSSD]2013-05-23 17:40:09.390 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d3d20) pid(14411) version 11:1:1:4 [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d3d20), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42b0d30, requested num -1 [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce3e0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:40:09.395 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:09.402 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:40:09.402 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:40:09.402 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d5010) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:09.402 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d5010) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:40:09.604 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3d20 [ CSSD]2013-05-23 17:40:09.604 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3d20) con(0x7f82b42bad20) skgpid ospid 14411 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:09.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:09.745 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:40:10.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:11.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:11.250 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:12.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:13.057 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:13.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:13.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:14.361 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:14.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ba002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:14.729 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:40:14.729 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:40:14.729 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:40:14.729 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:14.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bb002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:14.736 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:40:14.736 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:14.749 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:14.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:15.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:15.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:16.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bc002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:16.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:17.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:17.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:18.379 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:19.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:19.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:19.752 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:19.753 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:20.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4257830), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa10 [ CSSD]2013-05-23 17:40:20.443 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa10) con(0x7f82b427d8a0) skgpid 8878 ospid 8878 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 17:40:20.446 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42cbf30) skgpid 8880 ospid 8880 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:20.452 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:40:20.453 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:40:20.453 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207ce0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:40:20.453 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:40:20.453 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe6d0 [ CSSD]2013-05-23 17:40:20.453 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe6d0) con(0x7f82b42a29f0) skgpid 8884 ospid 8884 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:21.432 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:21.432 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:22.211 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41fe6d0) allocated [ CSSD]2013-05-23 17:40:22.212 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:40:22.212 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41fe6d0 - 1,2,3 [ CSSD]2013-05-23 17:40:22.212 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b41fe6d0) pid(14542/14542) version 11:1:1:4 [ CSSD]2013-05-23 17:40:22.228 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b41fe6d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:40:22.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:40:22.228 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:40:22.228 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:40:22.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:23.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:23.444 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:23.444 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a89c0 [ CSSD]2013-05-23 17:40:23.857 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a89c0) con(0x7f82b42ccc30) skgpid 13172 ospid 13172 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:24.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:24.637 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:40:24.638 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:40:24.638 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:40:24.638 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42d9690) pid(14570) version 11:1:1:4 [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:40:24.655 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:24.662 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:40:24.662 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:40:24.662 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:24.662 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:40:24.756 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:24.757 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:24.864 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:40:24.864 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42c6340) skgpid ospid 14570 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:25.449 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:25.449 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:26.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02bd002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:26.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:27.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:27.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:28.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:28.759 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:28.759 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:40:29.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:29.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:29.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02be002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:29.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:40:29.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:40:29.990 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:40:29.990 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:29.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02bf002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:29.997 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:40:29.997 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:30.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:31.181 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b41fe6d0), client(2/0x7f82b41bf650) [ CSSD]2013-05-23 17:40:31.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 17:40:31.181 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:40:31.181 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 17:40:31.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:31.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:32.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:33.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:33.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:33.564 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:33.763 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:33.763 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:34.563 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:35.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:35.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:36.054 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c0002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:36.167 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:40:36.168 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:40:36.169 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:40:36.169 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(14681) version 11:1:1:4 [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cbe70), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b42bad20, requested num -1 [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:40:36.175 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:36.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:40:36.181 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:40:36.181 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:36.181 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:40:36.384 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:40:36.384 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid ospid 14681 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:36.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:37.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:37.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:38.580 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:38.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:38.767 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:39.627 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:39.627 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:39.906 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:40:39.907 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:40:39.908 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:40:39.908 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d9690) pid(14714) version 11:1:1:4 [ CSSD]2013-05-23 17:40:39.913 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:40:39.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:40:39.913 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:40:39.913 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:39.913 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:40:39.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:40:39.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:39.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:40:39.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:40:39.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:39.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:40:40.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c1002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:40.070 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:40:40.070 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:40:40.070 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:40:40.070 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:40.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c2002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:40.077 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:40:40.077 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:40.123 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:40:40.123 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42bad20) skgpid ospid 14714 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:40.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:41.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:41.652 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:42.606 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:42.770 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:42.770 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:40:43.123 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:43.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:43.664 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:44.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:45.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c3002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:45.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:40:45.237 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:40:45.237 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:40:45.237 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:45.243 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c4002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:45.243 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:40:45.243 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:45.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:45.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:46.079 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c5002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:46.644 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:47.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:47.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:47.773 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:47.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:48.650 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:49.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:49.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:50.662 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:51.733 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:51.733 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:52.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:52.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:52.777 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:53.144 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:40:53.744 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:53.744 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:54.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:55.156 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:40:55.157 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:40:55.157 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:40:55.157 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(14868) version 11:1:1:4 [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cbe70), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:40:55.163 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:55.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:40:55.170 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:40:55.170 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:40:55.170 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:40:55.373 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:40:55.373 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid ospid 14868 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:40:55.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:55.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:56.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02c6002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:56.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:57.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:57.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:40:57.780 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:40:57.780 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:40:58.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:40:59.414 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c7002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:59.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:40:59.414 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:40:59.414 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:40:59.414 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:40:59.420 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02c8002d) incarnation(174631051) [ CSSD]2013-05-23 17:40:59.420 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:40:59.420 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:40:59.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:40:59.778 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:00.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02c9002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:00.482 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:00.482 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:00.482 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:41:00.482 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:00.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ca002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:00.489 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:00.489 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:00.843 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:01.783 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:01.783 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:41:01.784 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:01.784 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:02.868 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:03.167 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:03.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:03.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:04.878 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:05.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:05.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:06.129 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02cb002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:06.786 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:06.787 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:06.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:07.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:07.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:08.890 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:09.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:09.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:10.407 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:41:10.408 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:41:10.408 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:41:10.408 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d9690) pid(15017) version 11:1:1:4 [ CSSD]2013-05-23 17:41:10.414 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:10.414 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:10.414 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:41:10.414 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:10.414 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:41:10.415 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:41:10.415 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:10.422 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:10.422 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:41:10.422 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:10.422 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:41:10.624 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:41:10.624 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42bad20) skgpid ospid 15017 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:10.943 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:11.790 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:11.790 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:11.885 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:11.885 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:12.949 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:13.194 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:13.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:13.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:14.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:15.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cc002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:15.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:15.743 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:15.743 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:41:15.743 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:15.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02cd002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:15.749 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:15.749 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:15.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:15.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:16.130 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:41:16.131 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:41:16.132 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:41:16.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42cbe70) pid(15115/15115) version 11:1:1:4 [ CSSD]2013-05-23 17:41:16.147 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cbe70), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:41:16.147 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:41:16.147 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:41:16.147 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:41:16.153 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ce002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:16.181 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:41:16.181 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:41:16.181 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9350), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:41:16.182 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:41:16.182 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:41:16.182 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42bad20) skgpid 15115 ospid 15115 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:16.794 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:16.794 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:16.987 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:17.967 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:17.967 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:18.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:19.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:19.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:20.796 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:20.797 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:41:21.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:22.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:22.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:22.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02cf002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:22.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:22.090 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:22.090 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:41:22.090 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:22.097 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d0002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:22.097 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:22.097 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:22.223 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:41:22.223 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:41:22.225 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:41:22.225 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:41:23.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:23.216 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:24.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:24.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:25.061 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:25.657 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:41:25.658 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:41:25.658 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:41:25.658 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d9690) pid(15184) version 11:1:1:4 [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:41:25.675 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:41:25.676 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:25.682 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:41:25.682 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:41:25.682 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:25.682 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:41:25.800 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:25.800 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:25.885 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:41:25.885 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42bad20) skgpid ospid 15184 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:26.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:26.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:26.191 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d1002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:27.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:28.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:28.047 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:29.072 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:30.059 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:30.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:30.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:30.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:30.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d2002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:30.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:30.992 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:30.992 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:41:30.992 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:31.001 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d3002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:31.001 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:31.001 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:31.084 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:32.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:32.065 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:33.109 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:33.238 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:34.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:34.076 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:35.142 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:35.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:35.808 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:36.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:36.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:36.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d4002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:36.424 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:41:36.425 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:41:36.425 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:41:36.425 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(15296) version 11:1:1:4 [ CSSD]2013-05-23 17:41:36.431 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cbe70), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:41:36.431 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:41:36.431 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b429dca0 with con 0x7f82b42bad20, requested num -1 [ CSSD]2013-05-23 17:41:36.431 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:36.431 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:41:36.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:41:36.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:36.438 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:41:36.438 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b429dca0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:41:36.438 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42830a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:36.438 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42830a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:41:36.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:41:36.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid ospid 15296 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:37.167 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:38.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:38.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:39.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:39.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:39.810 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:41:40.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:40.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:40.333 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d5002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:40.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:40.333 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:40.333 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:41:40.333 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:40.340 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d6002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:40.340 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:40.340 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:40.923 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:41:40.924 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:41:40.925 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:41:40.925 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d9690) pid(15332) version 11:1:1:4 [ CSSD]2013-05-23 17:41:40.930 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:40.930 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:40.930 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:41:40.930 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:40.930 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:41:40.931 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:41:40.931 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:40.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:41:40.937 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:41:40.937 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a4ef0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:40.937 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a4ef0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:41:41.140 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:41:41.140 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42bad20) skgpid ospid 15332 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:41.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:42.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:42.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:43.250 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:43.261 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:44.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:44.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:44.813 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:44.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:45.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:46.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:46.163 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:46.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02d7002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:46.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:41:46.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:41:46.242 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:41:46.242 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:46.245 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02d8002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:46.250 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02d9002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:46.250 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:41:46.250 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:41:47.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:48.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:48.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:49.373 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:49.816 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:49.816 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:50.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:50.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:51.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:52.266 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:52.266 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:53.287 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:41:53.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:54.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:54.278 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:54.820 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:54.820 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:41:55.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:56.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbe70) allocated [ CSSD]2013-05-23 17:41:56.173 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:41:56.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbe70 - 1,2,3 [ CSSD]2013-05-23 17:41:56.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42cbe70) pid(15515) version 11:1:1:4 [ CSSD]2013-05-23 17:41:56.179 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cbe70), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:41:56.179 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:41:56.179 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:41:56.179 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:56.179 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:41:56.180 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:41:56.180 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:41:56.186 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:41:56.186 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:41:56.186 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:41:56.186 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:41:56.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02da002d) incarnation(174631051) [ CSSD]2013-05-23 17:41:56.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:56.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:56.389 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbe70 [ CSSD]2013-05-23 17:41:56.389 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbe70) con(0x7f82b42c6340) skgpid ospid 15515 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:41:57.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:41:58.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:41:58.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:41:58.822 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:41:58.823 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:41:59.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:00.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:00.342 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:01.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:01.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02db002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:01.501 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:01.501 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:01.501 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:01.501 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:01.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02dc002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:01.509 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:01.509 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:02.368 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:02.368 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:03.307 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:03.493 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:03.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:03.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:04.398 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:04.398 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:05.323 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:42:05.324 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:42:05.325 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:42:05.325 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bad20) proc(0x7f82b42d9690) pid(15182/15182) version 11:1:1:4 [ CSSD]2013-05-23 17:42:05.330 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:42:05.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:42:05.330 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:42:05.330 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:42:05.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:06.293 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02dd002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:06.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:06.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:07.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:08.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:08.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:08.830 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:08.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:09.462 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02de002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:09.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:09.462 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:09.462 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:09.462 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:09.469 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02df002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:09.470 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:09.470 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:09.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:10.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:10.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:10.949 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b34e0) allocated [ CSSD]2013-05-23 17:42:10.950 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:42:10.951 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b34e0 - 1,2,3 [ CSSD]2013-05-23 17:42:10.951 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257820) proc(0x7f82b42b34e0) pid(15691) version 11:1:1:4 [ CSSD]2013-05-23 17:42:11.431 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa10) allocated [ CSSD]2013-05-23 17:42:11.432 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:42:11.432 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa10 - 1,2,3 [ CSSD]2013-05-23 17:42:11.432 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42cfa10) pid(15785) version 11:1:1:4 [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cfa10), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a8240, requested num -1 [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3850/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:42:11.437 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:11.442 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:42:11.442 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:42:11.442 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427d420) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:11.442 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427d420) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:42:11.556 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:11.644 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa10 [ CSSD]2013-05-23 17:42:11.644 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa10) con(0x7f82b4207cd0) skgpid ospid 15785 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:12.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:12.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:13.329 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:13.562 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:13.576 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b34e0 [ CSSD]2013-05-23 17:42:13.576 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b34e0) con(0x7f82b4257820) skgpid ospid 15691 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:13.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:13.833 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:14.459 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:14.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:15.573 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:16.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e0002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:16.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:16.465 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:16.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e1002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:16.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:16.760 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:16.760 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:16.760 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:16.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e2002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:16.767 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:16.767 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:17.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:17.836 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:17.836 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:42:18.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:18.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:19.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:20.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:20.483 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:21.015 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:42:21.016 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:42:21.017 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:42:21.018 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:42:21.094 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e3002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:21.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:21.094 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:21.094 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:42:21.094 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:42:21.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e4002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:21.101 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:21.101 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:21.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:22.489 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:22.489 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:22.840 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:22.840 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:23.351 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:23.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:24.509 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:24.509 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:25.674 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:26.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e5002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:26.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:26.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:26.677 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b34e0) allocated [ CSSD]2013-05-23 17:42:26.678 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:42:26.678 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b34e0 - 1,2,3 [ CSSD]2013-05-23 17:42:26.678 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42b34e0) pid(16150) version 11:1:1:4 [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b34e0), client(1/0x7f82b42d8690) [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d8690) [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d8690 with con 0x7f82b4257820, requested num -1 [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:42:26.694 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:26.701 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d8690) [ CSSD]2013-05-23 17:42:26.701 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d8690), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:42:26.701 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:26.701 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:42:26.904 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b34e0 [ CSSD]2013-05-23 17:42:26.904 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b34e0) con(0x7f82b4207cd0) skgpid ospid 16150 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:27.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:27.843 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:27.843 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:28.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:28.547 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:29.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:30.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:30.553 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:31.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:32.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e6002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:32.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:32.014 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:32.014 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:32.014 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:32.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02e7002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:32.020 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:32.020 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:32.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:32.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:32.846 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:32.847 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:33.370 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:33.783 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:34.570 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:34.570 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:35.794 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:36.373 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02e8002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:36.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:36.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:36.677 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b34e0) allocated [ CSSD]2013-05-23 17:42:36.678 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:42:36.678 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b34e0 - 1,2,3 [ CSSD]2013-05-23 17:42:36.678 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42b34e0) pid(16254) version 11:1:1:4 [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b34e0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42a8240, requested num -1 [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427d1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:42:36.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:36.690 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:42:36.690 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:42:36.690 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c7b30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:36.690 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c7b30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:42:36.849 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:36.849 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:42:36.893 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b34e0 [ CSSD]2013-05-23 17:42:36.893 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b34e0) con(0x7f82b4207cd0) skgpid ospid 16254 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:37.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:38.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:38.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:39.853 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:40.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:40.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:40.595 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02e9002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:40.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:40.595 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:40.595 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:40.595 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:40.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ea002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:40.603 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:40.603 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:41.067 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b34e0) allocated [ CSSD]2013-05-23 17:42:41.068 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:42:41.068 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b34e0 - 1,2,3 [ CSSD]2013-05-23 17:42:41.068 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42b34e0) pid(15180/15180) version 11:1:1:4 [ CSSD]2013-05-23 17:42:41.084 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b34e0), client(1/0x7f82b42aee50) [ CSSD]2013-05-23 17:42:41.084 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:42:41.084 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:42:41.084 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:42:41.853 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:41.853 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:41.877 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:41.946 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e4b0) allocated [ CSSD]2013-05-23 17:42:41.947 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:42:41.947 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e4b0 - 1,2,3 [ CSSD]2013-05-23 17:42:41.947 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42834c0) proc(0x7f82b429e4b0) pid(16301) version 11:1:1:4 [ CSSD]2013-05-23 17:42:41.953 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b429e4b0), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:42:41.953 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:42:41.953 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b427d370, requested num -1 [ CSSD]2013-05-23 17:42:41.953 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:41.953 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3aa0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:42:41.954 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:42:41.954 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:41.960 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:42:41.960 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:42:41.960 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d40b0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:41.961 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d40b0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:42:42.163 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e4b0 [ CSSD]2013-05-23 17:42:42.163 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e4b0) con(0x7f82b42834c0) skgpid ospid 16301 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:42.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:42.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:43.393 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:43.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:44.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:44.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:45.896 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:46.397 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02eb002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:46.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:46.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:46.857 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:46.857 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:47.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ec002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:47.264 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:42:47.264 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:42:47.264 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:42:47.264 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:47.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02ed002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:47.271 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:42:47.271 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:42:47.902 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:48.320 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9690), client(2/0x7f82b427c5e0) [ CSSD]2013-05-23 17:42:48.320 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:42:48.320 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:42:48.320 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 17:42:48.688 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:48.688 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:49.953 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:42:50.508 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42dbbd0) skgpid 10715 ospid 10715 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:50.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:50.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:50.860 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:50.860 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:42:51.089 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:42:51.090 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:42:51.090 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:42:51.090 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a5080) proc(0x7f82b4207a80) pid(16430/16430) version 11:1:1:4 [ CSSD]2013-05-23 17:42:51.106 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:42:51.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:42:51.106 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:42:51.106 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:42:51.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:52.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:52.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:52.949 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b4207a80), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:42:52.949 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:42:52.949 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:42:52.949 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 17:42:53.415 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:42:53.984 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:54.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:54.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:55.863 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:42:55.864 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:42:55.994 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:56.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02ee002d) incarnation(174631051) [ CSSD]2013-05-23 17:42:56.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:56.797 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:42:57.198 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cb9e0) allocated [ CSSD]2013-05-23 17:42:57.199 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:42:57.200 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cb9e0 - 1,2,3 [ CSSD]2013-05-23 17:42:57.200 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba360) proc(0x7f82b42cb9e0) pid(16477) version 11:1:1:4 [ CSSD]2013-05-23 17:42:57.205 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cb9e0), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:42:57.205 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:42:57.205 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b42cb920, requested num -1 [ CSSD]2013-05-23 17:42:57.205 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:57.205 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d39a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:42:57.206 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:42:57.206 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:42:57.212 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:42:57.212 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:42:57.212 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:42:57.212 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:42:57.415 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cb9e0 [ CSSD]2013-05-23 17:42:57.415 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cb9e0) con(0x7f82b42ba360) skgpid ospid 16477 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:42:58.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:42:58.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:42:58.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:00.054 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:00.855 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:00.855 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:00.867 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:00.867 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:02.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:02.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ef002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:02.514 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:43:02.514 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:43:02.514 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:43:02.514 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:02.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f0002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:02.520 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:43:02.521 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:43:02.860 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:02.860 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:03.439 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:04.086 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:04.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:04.871 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:05.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:05.871 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:06.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:06.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f1002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:06.896 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:06.896 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:08.121 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:08.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:08.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:09.874 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:09.874 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:43:10.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:10.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:10.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:12.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:12.448 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbaf0) allocated [ CSSD]2013-05-23 17:43:12.448 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:43:12.449 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbaf0 - 1,2,3 [ CSSD]2013-05-23 17:43:12.449 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba430) proc(0x7f82b42cbaf0) pid(16621) version 11:1:1:4 [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cbaf0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cbd80, requested num -1 [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3b30/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:12.455 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:12.462 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:12.462 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:43:12.462 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d4a00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:12.462 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d4a00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:12.664 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbaf0 [ CSSD]2013-05-23 17:43:12.664 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbaf0) con(0x7f82b42ba430) skgpid ospid 16621 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:12.979 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:12.979 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:14.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:14.729 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:14.878 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:14.878 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:15.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:15.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:16.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:16.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f2002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:17.017 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:17.017 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:17.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f3002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:17.761 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:43:17.761 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:43:17.761 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:43:17.762 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:17.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f4002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:17.768 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:43:17.768 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:43:18.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:19.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:19.050 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:19.881 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:19.881 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:20.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:21.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:21.056 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:22.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:23.060 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:23.060 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:24.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:24.749 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:24.885 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:24.885 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:25.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:25.072 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:26.277 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:26.513 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f5002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:27.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:27.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:27.697 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cb9e0) allocated [ CSSD]2013-05-23 17:43:27.698 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:43:27.699 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cb9e0 - 1,2,3 [ CSSD]2013-05-23 17:43:27.699 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba360) proc(0x7f82b42cb9e0) pid(16784) version 11:1:1:4 [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cb9e0), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42cb920, requested num -1 [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d39a0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:27.715 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:27.722 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:27.722 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:43:27.722 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3ca0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:27.722 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3ca0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:27.925 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cb9e0 [ CSSD]2013-05-23 17:43:27.925 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cb9e0) con(0x7f82b42ba360) skgpid ospid 16784 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:28.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:29.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:29.150 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:29.888 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:29.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:30.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:31.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:31.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:32.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:32.401 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cbaf0) allocated [ CSSD]2013-05-23 17:43:32.402 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:43:32.403 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cbaf0 - 1,2,3 [ CSSD]2013-05-23 17:43:32.403 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ba430) proc(0x7f82b42cbaf0) pid(16428/16428) version 11:1:1:4 [ CSSD]2013-05-23 17:43:32.408 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cbaf0), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:43:32.408 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:43:32.408 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:43:32.408 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:43:33.019 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f6002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:33.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:43:33.019 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:43:33.019 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:43:33.020 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:33.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02f7002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:33.027 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:43:33.027 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:43:33.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:33.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:34.156 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42cbaf0), client(2/0x7f82b42d8690) [ CSSD]2013-05-23 17:43:34.156 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d8690) [ CSSD]2013-05-23 17:43:34.156 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:43:34.156 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 28 [ CSSD]2013-05-23 17:43:34.335 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:34.769 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:34.892 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:34.892 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:35.023 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42b34e0), client(2/0x7f82b42d9350) [ CSSD]2013-05-23 17:43:35.023 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42d9350) [ CSSD]2013-05-23 17:43:35.023 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:43:35.023 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 29 [ CSSD]2013-05-23 17:43:35.174 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:35.174 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:36.368 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:36.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02f8002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:36.928 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cef60) allocated [ CSSD]2013-05-23 17:43:36.929 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:43:36.929 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cef60 - 1,2,3 [ CSSD]2013-05-23 17:43:36.929 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cef60) pid(16889) version 11:1:1:4 [ CSSD]2013-05-23 17:43:36.935 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cef60), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:36.935 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:36.935 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cee90, requested num -1 [ CSSD]2013-05-23 17:43:36.935 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:36.935 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:43:36.936 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:36.936 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:36.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:43:36.942 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:43:36.942 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:36.942 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:37.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cef60 [ CSSD]2013-05-23 17:43:37.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cef60) con(0x7f82b42d3bf0) skgpid ospid 16889 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:37.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:37.198 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:38.374 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:39.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:39.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:39.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:39.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:40.385 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:40.656 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf030) allocated [ CSSD]2013-05-23 17:43:40.656 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:43:40.657 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf030 - 1,2,3 [ CSSD]2013-05-23 17:43:40.657 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4ba0) proc(0x7f82b42cf030) pid(16933) version 11:1:1:4 [ CSSD]2013-05-23 17:43:40.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02f9002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:40.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:43:40.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:43:40.850 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:43:40.850 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:40.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fa002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:40.857 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:43:40.857 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:43:41.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:41.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:41.286 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf030 [ CSSD]2013-05-23 17:43:41.286 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf030) con(0x7f82b42d4ba0) skgpid ospid 16933 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:42.391 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:42.958 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf030) allocated [ CSSD]2013-05-23 17:43:42.958 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:43:42.959 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf030 - 1,2,3 [ CSSD]2013-05-23 17:43:42.959 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4ba0) proc(0x7f82b42cf030) pid(17101) version 11:1:1:4 [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf030), client(1/0x7f82b42ba8d0) [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba8d0 with con 0x7f82b42d4c50, requested num -1 [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:42.965 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:42.972 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:43:42.972 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba8d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:43:42.972 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:42.972 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:43.175 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf030 [ CSSD]2013-05-23 17:43:43.175 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf030) con(0x7f82b42d4ba0) skgpid ospid 17101 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:43.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:43.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:43.446 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cabc0) allocated [ CSSD]2013-05-23 17:43:43.447 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:43:43.448 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cabc0 - 1,2,3 [ CSSD]2013-05-23 17:43:43.448 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cabc0) pid(17144) version 11:1:1:4 [ CSSD]2013-05-23 17:43:43.464 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cabc0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:43:43.464 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:43:43.464 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42a2a00 with con 0x7f82b42caaf0, requested num -1 [ CSSD]2013-05-23 17:43:43.464 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:43:43.464 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ce310/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:43:43.465 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:43.465 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:43.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:43:43.471 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:43:43.471 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ce610) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:43:43.471 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42ce610) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:43.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd4c0) allocated [ CSSD]2013-05-23 17:43:43.578 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:43:43.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd4c0 - 1,2,3 [ CSSD]2013-05-23 17:43:43.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42caa60) proc(0x7f82b42dd4c0) pid(17149) version 11:1:1:4 [ CSSD]2013-05-23 17:43:43.594 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:43:43.596 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:43:43.598 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:43:43.599 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd4c0 [ CSSD]2013-05-23 17:43:43.599 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd4c0) con(0x7f82b42caa60) skgpid ospid 17149 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:43.674 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cabc0 [ CSSD]2013-05-23 17:43:43.674 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cabc0) con(0x7f82b42d3bf0) skgpid ospid 17144 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:43.898 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:43.899 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:43:44.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:44.789 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:45.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:45.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:46.469 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:46.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fb002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:47.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:47.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:48.270 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02fc002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:48.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:43:48.270 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:43:48.270 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:43:48.270 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:48.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(02fd002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:48.276 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:43:48.276 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:43:48.475 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:48.902 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:48.902 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:49.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:49.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:50.486 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:51.367 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:51.367 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:52.492 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:53.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:53.378 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:53.905 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:53.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:54.498 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:54.809 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:43:55.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:55.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:56.508 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:56.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(02fe002d) incarnation(174631051) [ CSSD]2013-05-23 17:43:57.409 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:57.409 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:43:58.216 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cef60) allocated [ CSSD]2013-05-23 17:43:58.217 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:43:58.218 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cef60 - 1,2,3 [ CSSD]2013-05-23 17:43:58.218 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cef60) pid(17274) version 11:1:1:4 [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cef60), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42cee90, requested num -1 [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:43:58.234 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:43:58.241 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:43:58.241 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:43:58.241 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:43:58.241 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:43:58.444 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cef60 [ CSSD]2013-05-23 17:43:58.444 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cef60) con(0x7f82b42d3bf0) skgpid ospid 17274 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:43:58.514 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:43:58.909 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:43:58.909 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:43:59.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:43:59.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:00.567 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:01.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:01.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:02.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:02.911 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:02.911 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:44:03.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:03.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:03.519 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(02ff002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:03.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:44:03.519 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:44:03.519 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:44:03.519 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:03.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0300002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:03.526 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:44:03.526 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:44:04.598 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:04.840 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:05.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:05.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:06.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:06.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0301002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:07.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:07.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:07.915 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:07.915 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:08.615 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:09.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:09.562 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:10.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:11.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:11.568 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:12.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:12.919 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:12.919 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:13.476 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cf030) allocated [ CSSD]2013-05-23 17:44:13.477 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:44:13.477 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cf030 - 1,2,3 [ CSSD]2013-05-23 17:44:13.477 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d4ba0) proc(0x7f82b42cf030) pid(17421) version 11:1:1:4 [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cf030), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42d4c50, requested num -1 [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca1f0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:13.483 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:13.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:13.490 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:44:13.490 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca4f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:13.490 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca4f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:13.580 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:13.580 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:13.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cf030 [ CSSD]2013-05-23 17:44:13.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cf030) con(0x7f82b42d4ba0) skgpid ospid 17421 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:14.697 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:14.869 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:15.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:15.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:16.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0302002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:16.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:17.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:17.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:17.922 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:17.922 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:18.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:18.768 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0303002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:18.768 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:44:18.768 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:44:18.768 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:44:18.768 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:18.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0304002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:18.775 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:44:18.775 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:44:19.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:19.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:20.768 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:21.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:21.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:21.924 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:21.925 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:44:22.774 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:23.660 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:23.660 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:24.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:24.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:25.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:25.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:26.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0305002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:26.791 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:26.928 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:26.928 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:27.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:27.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:28.726 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cef60) allocated [ CSSD]2013-05-23 17:44:28.727 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:44:28.727 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cef60 - 1,2,3 [ CSSD]2013-05-23 17:44:28.727 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cef60) pid(17578) version 11:1:1:4 [ CSSD]2013-05-23 17:44:28.743 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cef60), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:44:28.743 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:44:28.743 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cee90, requested num -1 [ CSSD]2013-05-23 17:44:28.743 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:28.743 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca170/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:44:28.744 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:28.744 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:28.749 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:44:28.749 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:44:28.749 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca470) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:28.750 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:28.817 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:28.952 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cef60 [ CSSD]2013-05-23 17:44:28.952 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cef60) con(0x7f82b42d3bf0) skgpid ospid 17578 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:29.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:29.703 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:30.625 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cef60) allocated [ CSSD]2013-05-23 17:44:30.626 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:44:30.627 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cef60 - 1,2,3 [ CSSD]2013-05-23 17:44:30.627 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cef60) pid(17631) version 11:1:1:4 [ CSSD]2013-05-23 17:44:30.744 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dcfc0) allocated [ CSSD]2013-05-23 17:44:30.745 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:44:30.746 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dcfc0 - 1,2,3 [ CSSD]2013-05-23 17:44:30.746 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca0d0) proc(0x7f82b42dcfc0) pid(17641) version 11:1:1:4 [ CSSD]2013-05-23 17:44:30.763 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:44:30.765 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:44:30.769 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dcfc0 [ CSSD]2013-05-23 17:44:30.769 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dcfc0) con(0x7f82b42ca0d0) skgpid ospid 17641 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5361/0x7f82b42ba8d0) [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5361 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42ba8d0 with con 0x7f82b42cee90, requested num -1 [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42ca170/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:30.848 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:44:30.855 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5361 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:44:30.855 [1199044928] >TRACE: clssgmExitGrock: client 5361 (0x7f82b42ba8d0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:44:30.855 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca470) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:44:30.855 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42ca470) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:30.857 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cef60 [ CSSD]2013-05-23 17:44:30.857 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cef60) con(0x7f82b42d3bf0) skgpid ospid 17631 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:30.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:31.709 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:31.709 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:31.931 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:31.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:32.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:33.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:33.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:33.775 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cef60) allocated [ CSSD]2013-05-23 17:44:33.782 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:44:33.782 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cef60 - 1,2,3 [ CSSD]2013-05-23 17:44:33.782 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d3bf0) proc(0x7f82b42cef60) pid(16426/16426) version 11:1:1:4 [ CSSD]2013-05-23 17:44:33.798 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cef60), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:44:33.798 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:44:33.798 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:44:33.798 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:44:34.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0306002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:34.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:44:34.025 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:44:34.025 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:44:34.025 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:34.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0307002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:34.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:44:34.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:44:34.885 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:34.910 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:35.767 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:35.767 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:36.265 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cef60), client(2/0x7f82b42ccac0) [ CSSD]2013-05-23 17:44:36.265 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:44:36.265 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:44:36.265 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 30 [ CSSD]2013-05-23 17:44:36.691 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0308002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:36.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:36.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:36.935 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:37.189 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd810) allocated [ CSSD]2013-05-23 17:44:37.190 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:44:37.191 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd810 - 1,2,3 [ CSSD]2013-05-23 17:44:37.191 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42caa20) proc(0x7f82b42dd810) pid(17690) version 11:1:1:4 [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd810), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42dd740, requested num -1 [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddf80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:37.197 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:37.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:37.204 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:44:37.204 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:37.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:37.407 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd810 [ CSSD]2013-05-23 17:44:37.407 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd810) con(0x7f82b42caa20) skgpid ospid 17690 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:37.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:37.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:38.918 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:39.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:39.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:40.917 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:40.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:40.938 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:44:41.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0309002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:41.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:44:41.104 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:44:41.104 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:44:41.104 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:41.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030a002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:41.110 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:44:41.110 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:44:41.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:41.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:42.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:43.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:43.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:43.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf30) allocated [ CSSD]2013-05-23 17:44:43.991 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:44:43.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf30 - 1,2,3 [ CSSD]2013-05-23 17:44:43.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca3c0) proc(0x7f82b42caf30) pid(17766) version 11:1:1:4 [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42caf30), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42dd740, requested num -1 [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dde50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:43.998 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:44.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:44:44.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:44:44.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de150) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:44.004 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de150) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:44.206 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf30 [ CSSD]2013-05-23 17:44:44.206 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf30) con(0x7f82b42ca3c0) skgpid ospid 17766 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:44:44.926 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:44.931 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:45.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:45.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:45.941 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:45.941 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:46.714 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030b002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:46.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:47.892 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:47.892 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:48.959 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:49.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030c002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:49.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:44:49.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:44:49.282 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:44:49.282 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:49.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(030d002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:49.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:44:49.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:44:49.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:49.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:50.945 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:50.945 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:50.988 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:51.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:51.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:53.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:53.962 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:53.962 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:54.950 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:44:55.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:55.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:44:55.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:44:55.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:55.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:56.738 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(030e002d) incarnation(174631051) [ CSSD]2013-05-23 17:44:57.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:58.013 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:44:58.013 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:44:59.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:44:59.239 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42dd810) allocated [ CSSD]2013-05-23 17:44:59.240 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:44:59.240 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42dd810 - 1,2,3 [ CSSD]2013-05-23 17:44:59.240 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42caa20) proc(0x7f82b42dd810) pid(17925) version 11:1:1:4 [ CSSD]2013-05-23 17:44:59.246 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42dd810), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42dd740, requested num -1 [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ddf80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:44:59.247 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:44:59.254 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:44:59.254 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:44:59.254 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de280) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:44:59.254 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de280) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:44:59.457 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42dd810 [ CSSD]2013-05-23 17:44:59.457 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42dd810) con(0x7f82b42caa20) skgpid ospid 17925 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:00.015 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:00.015 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:00.952 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:00.952 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:01.190 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:02.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:02.021 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:03.196 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:04.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:04.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:04.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(030f002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:04.529 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:45:04.529 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:45:04.529 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:45:04.529 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:04.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0310002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:04.535 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:45:04.535 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:45:04.601 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf30) allocated [ CSSD]2013-05-23 17:45:04.602 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:45:04.603 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf30 - 1,2,3 [ CSSD]2013-05-23 17:45:04.603 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca3c0) proc(0x7f82b42caf30) pid(18010/18010) version 11:1:1:4 [ CSSD]2013-05-23 17:45:04.619 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42caf30), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:04.619 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:04.619 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:45:04.619 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 40 [ CSSD]2013-05-23 17:45:04.951 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:04.951 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:45:04.951 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:45:04.952 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 39 [ CSSD]2013-05-23 17:45:04.952 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf30 [ CSSD]2013-05-23 17:45:04.952 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf30) con(0x7f82b42ca3c0) skgpid 18010 ospid 18010 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:04.970 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:05.206 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:05.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:05.956 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:06.098 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:06.098 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:06.763 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0311002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:07.212 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:08.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:08.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:09.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:10.116 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:10.116 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:10.959 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:10.959 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:11.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:12.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:12.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:13.236 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:14.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:14.173 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:14.500 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42caf30) allocated [ CSSD]2013-05-23 17:45:14.501 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:45:14.502 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42caf30 - 1,2,3 [ CSSD]2013-05-23 17:45:14.502 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ca3c0) proc(0x7f82b42caf30) pid(18075) version 11:1:1:4 [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42caf30), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42dd740, requested num -1 [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42dde50/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:45:14.508 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:14.515 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:14.515 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:45:14.515 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42de150) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:14.515 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42de150) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:45:14.718 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42caf30 [ CSSD]2013-05-23 17:45:14.718 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42caf30) con(0x7f82b42ca3c0) skgpid ospid 18075 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:14.962 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:14.962 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:45:14.991 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:15.288 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:16.178 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:16.178 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:16.790 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0312002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:17.294 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:18.203 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:18.203 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:19.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:19.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0313002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:19.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:45:19.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:45:19.776 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:45:19.776 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:19.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0314002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:19.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:45:19.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:45:19.966 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:19.966 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:20.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:20.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:45:20.538 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42be650) skgpid 12589 ospid 12589 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:21.330 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:22.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:22.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:23.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:24.274 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:24.274 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:24.969 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:24.969 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:25.021 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:25.388 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:26.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:26.280 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:26.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0315002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:27.394 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:28.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:28.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:29.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:29.750 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 17:45:29.751 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:45:29.752 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 17:45:29.752 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bab90) proc(0x7f82b42d8560) pid(18245) version 11:1:1:4 [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4257550, requested num -1 [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:45:29.759 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:29.765 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:45:29.765 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:45:29.765 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:29.765 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:45:29.968 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 17:45:29.968 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42bab90) skgpid ospid 18245 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:29.973 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:29.973 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:30.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:30.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:31.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:32.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:32.303 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:33.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:33.975 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:33.976 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:45:34.314 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:34.314 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:35.024 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0316002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:35.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:45:35.024 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:45:35.024 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:45:35.024 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:35.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0317002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:35.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:45:35.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:45:35.051 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:35.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:36.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:36.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:36.840 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0318002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:37.451 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:45:37.452 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:45:37.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:45:37.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d8490) pid(18332) version 11:1:1:4 [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8490), client(1/0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a51f0 with con 0x7f82b42a9140, requested num -1 [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:45:37.458 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:37.465 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a51f0) [ CSSD]2013-05-23 17:45:37.465 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a51f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:45:37.465 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:37.465 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:45:37.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:37.667 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:45:37.667 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42be650) skgpid ospid 18332 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:38.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:38.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:38.979 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:38.979 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:39.519 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:40.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:40.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:41.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0319002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:41.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:45:41.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:45:41.353 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:45:41.353 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:41.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031a002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:41.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:45:41.360 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:45:41.532 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:42.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:42.421 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:43.538 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:43.982 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:43.982 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:44.475 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:44.475 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:45.000 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:45:45.001 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:45:45.002 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:45:45.002 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d8490) pid(18393) version 11:1:1:4 [ CSSD]2013-05-23 17:45:45.007 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8490), client(1/0x7f82b42ba8d0) [ CSSD]2013-05-23 17:45:45.007 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:45:45.007 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ba8d0 with con 0x7f82b42a9140, requested num -1 [ CSSD]2013-05-23 17:45:45.007 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:45.007 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:45:45.008 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:45:45.008 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:45.013 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ba8d0) [ CSSD]2013-05-23 17:45:45.013 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ba8d0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:45:45.013 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:45:45.013 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:45:45.073 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:45.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:45:45.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42be650) skgpid ospid 18393 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:45:45.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:46.481 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:46.481 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:46.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031b002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:47.595 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:48.492 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:48.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:48.985 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:48.986 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:49.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:50.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031c002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:50.283 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:45:50.283 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:45:50.283 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:45:50.283 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:45:50.290 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(031d002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:50.290 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:45:50.290 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:45:50.499 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:50.499 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:51.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:52.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:52.505 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:52.988 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:52.988 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:45:53.638 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:54.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:54.515 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:55.093 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:45:55.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:56.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:56.521 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:56.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(031e002d) incarnation(174631051) [ CSSD]2013-05-23 17:45:57.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:45:57.992 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:45:57.992 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:45:58.573 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:45:58.573 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:45:59.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:00.254 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 17:46:00.255 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:46:00.256 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 17:46:00.256 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b429dfe0) proc(0x7f82b42d8560) pid(18567) version 11:1:1:4 [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42ca220, requested num -1 [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:46:00.262 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:00.269 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:46:00.269 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:46:00.269 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:00.269 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:46:00.472 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 17:46:00.472 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b429dfe0) skgpid ospid 18567 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:00.618 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:00.618 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:01.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:02.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:02.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:02.996 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:02.996 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:03.727 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:04.676 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:04.676 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:05.112 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:05.530 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(031f002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:05.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:05.531 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:05.531 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:46:05.531 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:05.537 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0320002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:05.537 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:05.537 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:05.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:06.682 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:06.682 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:06.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0321002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:06.999 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:06.999 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:46:07.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:08.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:08.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:09.798 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:10.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:10.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:11.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:12.002 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:12.003 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:12.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:12.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:13.809 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:14.716 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:14.716 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:15.134 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:15.509 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:46:15.510 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:46:15.511 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:46:15.511 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42be650) proc(0x7f82b42d8490) pid(18727) version 11:1:1:4 [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8490), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a9140, requested num -1 [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:46:15.517 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:15.525 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:15.525 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:46:15.525 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:15.526 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:46:15.572 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ca170) allocated [ CSSD]2013-05-23 17:46:15.572 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:46:15.573 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ca170 - 1,2,3 [ CSSD]2013-05-23 17:46:15.573 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42ca170) pid(18733/18733) version 11:1:1:4 [ CSSD]2013-05-23 17:46:15.578 [1199044928] >TRACE: clssgmRegisterClient: proc(70/0x7f82b42ca170), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:46:15.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:46:15.578 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:46:15.578 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 39 [ CSSD]2013-05-23 17:46:15.597 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:46:15.597 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:46:15.597 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:46:15.597 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 38 [ CSSD]2013-05-23 17:46:15.597 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ca170 [ CSSD]2013-05-23 17:46:15.598 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ca170) con(0x7f82b42a9150) skgpid 18733 ospid 18733 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:15.728 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:46:15.728 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42be650) skgpid ospid 18727 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:15.820 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:16.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:16.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:16.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0322002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:17.006 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:17.006 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:17.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:18.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:18.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:19.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:20.750 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:20.750 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:20.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0323002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:20.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:20.779 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:20.779 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:46:20.779 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:20.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0324002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:20.785 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:20.785 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:21.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:22.010 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:22.010 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:22.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0325002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:22.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:22.389 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:22.389 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:46:22.389 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:22.396 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0326002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:22.396 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:22.396 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:22.527 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:46:22.527 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:46:22.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:46:22.529 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:46:22.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:22.756 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:23.928 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:24.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:24.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:25.153 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:25.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:46:25.170 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:46:25.170 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:46:25.170 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:46:25.171 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 17:46:25.171 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b4257120) skgpid 13483 ospid 13483 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:25.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:26.013 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:26.013 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:46:26.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:26.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:26.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0327002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:27.948 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:28.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:28.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:29.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:30.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:46:30.772 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:46:30.772 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:46:30.772 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bea70) proc(0x7f82b42ba8d0) pid(18871) version 11:1:1:4 [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4286740, requested num -1 [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:46:30.788 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:30.795 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:30.795 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:46:30.795 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:30.795 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:46:30.819 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:30.819 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:30.998 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:46:30.998 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b42bea70) skgpid ospid 18871 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:31.016 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:31.016 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:32.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:32.824 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:32.824 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:34.010 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:34.838 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:34.838 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:35.173 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:36.019 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:36.019 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:36.022 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:36.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0328002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:36.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:36.027 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:36.027 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:46:36.027 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:36.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0329002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:36.033 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:36.033 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:36.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:36.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:36.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032a002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:37.710 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:46:37.711 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:46:37.712 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:46:37.712 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(18957) version 11:1:1:4 [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a5130, requested num -1 [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:46:37.718 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:37.724 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:46:37.724 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:46:37.724 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:37.724 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:46:37.926 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:46:37.926 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 18957 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:38.027 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:38.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:38.895 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:40.038 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:40.901 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:40.901 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:41.022 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:41.022 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:41.606 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032b002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:41.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:41.606 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:41.606 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:46:41.607 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:41.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032c002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:41.614 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:41.614 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:42.044 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:42.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:42.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:44.071 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:44.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:44.937 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:45.025 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:45.025 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:46:45.223 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:46.030 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:46:46.030 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:46:46.031 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:46:46.031 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(19025) version 11:1:1:4 [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a5130, requested num -1 [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:46:46.037 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:46.044 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:46:46.044 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:46:46.044 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dfe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:46:46.045 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dfe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:46:46.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:46.247 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:46:46.247 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 19025 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:46:46.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:46.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:47.021 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(032d002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:48.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:48.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:48.996 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:50.029 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:50.029 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:50.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:51.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:51.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:51.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(032e002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:51.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:46:51.282 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:46:51.282 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:46:51.282 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:46:51.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(032f002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:51.288 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:46:51.288 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:46:52.144 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:53.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:53.008 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:54.150 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:55.018 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:55.018 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:55.033 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:46:55.033 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:46:55.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:46:56.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:57.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:57.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:46:57.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0330002d) incarnation(174631051) [ CSSD]2013-05-23 17:46:58.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:46:59.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:46:59.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:00.036 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:00.037 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:00.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:01.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:01.120 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:01.279 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:47:01.280 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:47:01.281 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:47:01.281 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(19185) version 11:1:1:4 [ CSSD]2013-05-23 17:47:01.297 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:47:01.297 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:01.297 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a5130, requested num -1 [ CSSD]2013-05-23 17:47:01.297 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:01.297 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:01.298 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:01.298 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:01.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:01.305 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:01.305 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:01.305 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:01.508 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:47:01.508 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 19185 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:02.245 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:03.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:03.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:04.039 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:04.040 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:47:04.251 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:05.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:05.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:05.194 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:47:05.195 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:47:05.196 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:47:05.196 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(19254/19254) version 11:1:1:4 [ CSSD]2013-05-23 17:47:05.201 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:47:05.201 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:47:05.201 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:47:05.201 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:47:05.274 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:06.303 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:06.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0331002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:06.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:06.541 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:06.541 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:47:06.541 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:06.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0332002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:06.547 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:06.547 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:07.074 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0333002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:07.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:07.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:08.309 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:09.043 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:09.043 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:09.197 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:09.197 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:10.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:11.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:11.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:11.371 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:47:11.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:47:11.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:47:11.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a51e0) proc(0x7f82b42d8490) pid(19336) version 11:1:1:4 [ CSSD]2013-05-23 17:47:12.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:13.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:13.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:13.932 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:47:13.932 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42a51e0) skgpid ospid 19336 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:14.046 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:14.047 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:14.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:14.960 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 17:47:14.961 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:47:14.962 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 17:47:14.962 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bab90) proc(0x7f82b42d8560) pid(19656) version 11:1:1:4 [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42a4e30, requested num -1 [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:14.968 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:14.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:14.975 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:14.975 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:14.975 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:15.178 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 17:47:15.178 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42bab90) skgpid ospid 19656 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:15.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:15.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:15.294 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:16.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:16.546 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8560) allocated [ CSSD]2013-05-23 17:47:16.547 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:47:16.548 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8560 - 1,2,3 [ CSSD]2013-05-23 17:47:16.548 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bab90) proc(0x7f82b42d8560) pid(19701) version 11:1:1:4 [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8560), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a4e30, requested num -1 [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca610/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:16.554 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:16.561 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:47:16.561 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:16.561 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca910) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:16.561 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca910) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:16.763 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8560 [ CSSD]2013-05-23 17:47:16.763 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8560) con(0x7f82b42bab90) skgpid ospid 19701 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:17.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0334002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:17.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:17.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:18.426 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:19.050 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:19.050 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:19.237 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:19.237 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:20.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:21.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:21.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:21.311 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:47:21.312 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:47:21.313 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:47:21.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:47:21.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0335002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:21.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:21.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:21.394 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:47:21.395 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:47:21.401 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0336002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:21.401 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:21.401 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:21.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0337002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:21.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:21.791 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:21.791 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:47:21.791 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:21.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0338002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:21.798 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:21.798 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:22.448 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:23.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:23.295 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:24.054 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:24.054 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:24.453 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:25.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:25.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:25.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:26.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:27.184 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0339002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:27.306 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:27.306 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:28.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:29.057 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:29.058 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:29.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:29.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:30.512 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:31.343 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:31.343 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:31.796 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8490) allocated [ CSSD]2013-05-23 17:47:31.797 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:47:31.798 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8490 - 1,2,3 [ CSSD]2013-05-23 17:47:31.798 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a51e0) proc(0x7f82b42d8490) pid(19864) version 11:1:1:4 [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42d8490), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42a4e30, requested num -1 [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42ca490/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:31.804 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:31.810 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:47:31.810 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:31.810 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ca790) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:31.810 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ca790) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:32.013 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8490 [ CSSD]2013-05-23 17:47:32.013 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8490) con(0x7f82b42a51e0) skgpid ospid 19864 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:32.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:33.395 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:33.395 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:34.061 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:34.061 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:34.542 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:35.334 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:35.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:35.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:36.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:47:36.563 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid 19254 ospid 19254 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:37.050 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033a002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:37.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:37.050 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:37.050 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:47:37.050 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:37.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033b002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:37.057 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:37.057 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:37.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033c002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:37.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:37.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:37.967 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:47:37.968 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:47:37.968 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:47:37.968 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(19943) version 11:1:1:4 [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a5130, requested num -1 [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:37.975 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:37.981 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:37.981 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:37.981 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3350) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:37.982 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3350) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:38.063 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:38.064 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:47:38.184 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:47:38.184 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 19943 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:38.561 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:39.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:39.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:40.612 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:41.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:41.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:41.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(033d002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:41.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:41.870 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:41.870 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:47:41.870 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:41.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(033e002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:41.877 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:41.877 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:42.639 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:43.067 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:43.067 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:43.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:43.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:44.477 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:47:44.477 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:47:44.478 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:47:44.478 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(20010) version 11:1:1:4 [ CSSD]2013-05-23 17:47:44.494 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:47:44.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:47:44.494 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a5130, requested num -1 [ CSSD]2013-05-23 17:47:44.494 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:44.494 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:44.495 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:44.495 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:44.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:47:44.501 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:44.501 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bab90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:44.501 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bab90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:44.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:44.704 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:47:44.704 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 20010 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:45.355 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:45.551 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:45.551 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:46.655 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:47.047 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:47:47.048 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:47:47.049 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:47:47.049 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42bea70) proc(0x7f82b42ba8d0) pid(20056) version 11:1:1:4 [ CSSD]2013-05-23 17:47:47.054 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:47:47.054 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:47.054 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4286740, requested num -1 [ CSSD]2013-05-23 17:47:47.054 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:47.054 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:47:47.055 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:47:47.055 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:47.062 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:47:47.062 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:47:47.062 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429dfe0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:47:47.062 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429dfe0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:47:47.232 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(033f002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:47.264 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:47:47.264 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b42bea70) skgpid ospid 20056 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:47.558 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:47.558 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:48.071 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:48.071 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:48.660 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:49.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:49.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:50.579 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41bf650) [ CSSD]2013-05-23 17:47:50.579 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41bf650), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:47:50.579 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41bf650), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:47:50.579 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 29 [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41fe6d0 [ CSSD]2013-05-23 17:47:50.586 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41fe6d0) con(0x7f82b427d8a0) skgpid 14542 ospid 14542 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:47:50.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:51.615 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:51.615 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:52.309 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0340002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:52.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:47:52.309 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:47:52.309 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:47:52.309 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:47:52.315 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0341002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:52.315 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:47:52.315 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:47:52.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:53.074 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:53.075 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:47:53.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:53.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:54.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:55.385 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:47:55.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:55.633 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:56.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:57.077 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:47:57.077 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:47:57.255 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0342002d) incarnation(174631051) [ CSSD]2013-05-23 17:47:57.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:57.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:47:58.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:47:59.649 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:47:59.649 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:00.813 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:01.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:01.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:02.080 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:02.081 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:02.297 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:02.298 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:48:02.299 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:02.299 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42ba8d0) pid(20196) version 11:1:1:4 [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:02.305 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:02.312 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:48:02.312 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:48:02.312 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:02.312 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:02.514 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:02.514 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4258470) skgpid ospid 20196 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:02.839 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:03.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:03.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:04.851 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:05.415 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:05.712 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:05.712 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:06.857 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:07.084 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:07.084 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:07.280 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0343002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:07.568 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0344002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:07.568 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:48:07.568 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:48:07.568 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:48:07.568 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:07.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0345002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:07.575 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:48:07.575 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:48:07.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:07.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:08.863 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:09.729 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:09.729 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:10.933 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:11.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:11.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:12.088 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:12.088 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:12.939 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:13.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:13.807 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:14.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:15.445 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:15.833 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:15.833 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:16.957 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:17.092 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:17.092 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:17.304 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0346002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:17.558 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:17.558 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:48:17.559 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:17.559 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(20343) version 11:1:1:4 [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:17.565 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:17.572 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:48:17.572 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:48:17.572 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42bea70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:17.572 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42bea70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:17.775 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:17.775 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 20343 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:17.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:17.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:18.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:19.849 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:19.849 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:21.034 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:21.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:21.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:22.096 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:22.096 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:22.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0347002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:22.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:48:22.817 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:48:22.817 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:48:22.817 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:22.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0348002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:22.823 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:48:22.823 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:48:23.040 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:23.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:23.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:25.051 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:25.468 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:25.914 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:25.914 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:27.057 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:27.099 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:27.100 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:27.327 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0349002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:27.938 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:27.938 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:28.743 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:28.744 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:28.745 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:28.745 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42ba8d0) pid(20474/20474) version 11:1:1:4 [ CSSD]2013-05-23 17:48:28.761 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:48:28.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:48:28.761 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:48:28.761 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:28.799 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4258470) skgpid 20474 ospid 20474 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:28.975 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:28.976 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:28.976 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:28.976 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(20483/20483) version 11:1:1:4 [ CSSD]2013-05-23 17:48:28.992 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:28.992 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:28.992 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:48:28.992 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:48:29.037 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:29.037 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:48:29.037 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cbf40), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:48:29.037 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:48:29.038 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:29.038 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid 20483 ospid 20483 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:29.082 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:29.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:29.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:31.102 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:31.103 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:48:31.134 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:31.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:31.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:32.818 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:32.819 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:48:32.820 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:32.820 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(20506) version 11:1:1:4 [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:32.826 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:32.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:48:32.833 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:48:32.833 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:32.833 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:33.036 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:33.036 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid ospid 20506 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:33.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:34.008 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:34.009 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:35.152 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:35.489 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:36.014 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:36.014 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:36.106 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:36.106 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:37.157 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:37.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034a002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:38.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:38.020 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:38.065 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034b002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:38.065 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:48:38.065 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:48:38.065 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:48:38.065 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:38.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034c002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:38.071 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:48:38.071 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:48:38.234 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:38.235 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:38.236 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:38.236 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(20585) version 11:1:1:4 [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:38.242 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:38.248 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:48:38.248 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:48:38.248 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:38.248 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:38.451 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:38.451 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid ospid 20585 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:39.180 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:40.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:40.032 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:41.109 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:41.109 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:41.124 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:41.125 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:41.126 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:41.126 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(20623) version 11:1:1:4 [ CSSD]2013-05-23 17:48:41.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:41.760 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:41.760 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 20623 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:42.057 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:42.057 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:42.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(034d002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:42.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:48:42.123 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:48:42.123 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:48:42.123 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:42.130 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(034e002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:42.130 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:48:42.130 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:48:43.229 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:43.744 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:43.745 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:43.746 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:43.746 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42ba8d0) pid(20796) version 11:1:1:4 [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b42cbf40 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:43.753 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:43.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 17:48:43.760 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:48:43.760 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:48:43.760 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:43.870 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d0080) allocated [ CSSD]2013-05-23 17:48:43.871 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:48:43.871 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d0080 - 1,2,3 [ CSSD]2013-05-23 17:48:43.871 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d0080) pid(20801) version 11:1:1:4 [ CSSD]2013-05-23 17:48:43.886 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:48:43.888 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:48:43.890 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:48:43.891 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d0080 [ CSSD]2013-05-23 17:48:43.891 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d0080) con(0x7f82b42ccc30) skgpid ospid 20801 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:43.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:43.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4258470) skgpid ospid 20796 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:44.109 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:44.109 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:45.323 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:45.510 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:46.113 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:46.113 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:46.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:46.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:47.350 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:47.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(034f002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:48.065 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:48:48.066 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:48:48.067 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:48:48.067 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258470) proc(0x7f82b42ba8d0) pid(20848) version 11:1:1:4 [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42cfca0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:48:48.073 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:48.080 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:48:48.080 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:48:48.080 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:48:48.080 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:48:48.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:48.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:48.283 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:48:48.283 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4258470) skgpid ospid 20848 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:49.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:50.115 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:50.116 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:48:50.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:50.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:51.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:52.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:52.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:53.312 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0350002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:53.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:48:53.312 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:48:53.312 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:48:53.312 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:48:53.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0351002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:53.319 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:48:53.319 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:48:53.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:54.210 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:54.210 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:55.119 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:48:55.120 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:48:55.206 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d9350) [ CSSD]2013-05-23 17:48:55.206 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d9350), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:48:55.206 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d9350), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:48:55.206 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 28 [ CSSD]2013-05-23 17:48:55.209 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b427c5e0) [ CSSD]2013-05-23 17:48:55.209 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b427c5e0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:48:55.209 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b427c5e0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:48:55.209 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 27 [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42aee50) [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42aee50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b34e0 [ CSSD]2013-05-23 17:48:55.210 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b34e0) con(0x7f82b4207cd0) skgpid 15180 ospid 15180 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:48:55.214 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b42bad20) skgpid 15182 ospid 15182 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:48:55.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:55.534 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:48:56.215 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:56.215 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:57.406 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0352002d) incarnation(174631051) [ CSSD]2013-05-23 17:48:57.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:48:58.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:48:58.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:48:59.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:00.123 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:00.123 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:00.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:00.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:01.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:02.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:02.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:03.316 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:03.317 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:49:03.317 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:03.317 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8d0) pid(21012) version 11:1:1:4 [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:03.323 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:03.330 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:49:03.330 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:49:03.330 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:03.330 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:03.472 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:03.533 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:03.533 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b4257120) skgpid ospid 21012 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:04.126 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:04.126 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:49:04.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:04.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:05.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:05.556 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:06.267 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:06.267 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:07.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0353002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:07.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:08.288 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:08.288 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:08.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0354002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:08.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:49:08.559 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:49:08.560 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:49:08.560 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:08.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0355002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:08.566 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:49:08.566 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:49:09.129 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:09.129 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:09.555 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:10.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:10.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:11.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:12.300 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:12.300 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:13.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:14.132 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:14.133 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:14.331 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:14.331 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:15.583 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:15.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:16.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:16.337 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:17.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0356002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:17.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:18.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:18.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:18.576 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:18.576 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:49:18.577 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:18.577 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(21178) version 11:1:1:4 [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:18.583 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:18.589 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:49:18.589 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:49:18.589 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:18.590 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:18.792 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:18.792 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid ospid 21178 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:19.136 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:19.136 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:19.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:20.355 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:20.355 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:21.667 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:22.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:22.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:23.673 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:23.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0357002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:23.818 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:49:23.818 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:49:23.818 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:49:23.819 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:23.826 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0358002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:23.826 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:49:23.826 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:49:24.139 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:24.139 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:24.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:24.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:25.606 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:25.745 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:26.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:26.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:27.487 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0359002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:27.752 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:28.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:28.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:29.143 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:29.143 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:29.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:30.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:30.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:30.942 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:30.943 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:49:30.943 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:30.943 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ba8d0) pid(21301) version 11:1:1:4 [ CSSD]2013-05-23 17:49:31.060 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5130) allocated [ CSSD]2013-05-23 17:49:31.061 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:49:31.062 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5130 - 1,2,3 [ CSSD]2013-05-23 17:49:31.062 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5130) pid(21311) version 11:1:1:4 [ CSSD]2013-05-23 17:49:31.078 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:49:31.080 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:49:31.083 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5130 [ CSSD]2013-05-23 17:49:31.083 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5130) con(0x7f82b427d8a0) skgpid ospid 21311 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5362/0x7f82b41bf650) [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5362 (0x7f82b41bf650) [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42b3350/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:31.165 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:49:31.172 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5362 (0x7f82b41bf650) [ CSSD]2013-05-23 17:49:31.172 [1199044928] >TRACE: clssgmExitGrock: client 5362 (0x7f82b41bf650), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:49:31.172 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:49:31.173 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:31.174 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:31.174 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b42c6340) skgpid ospid 21301 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:31.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:32.461 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:32.461 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:33.826 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:33.827 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:49:33.828 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:33.828 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(21340) version 11:1:1:4 [ CSSD]2013-05-23 17:49:33.833 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:49:33.833 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:49:33.833 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:49:33.833 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:33.833 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:49:33.834 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:33.834 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:33.841 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:49:33.841 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:49:33.841 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42833d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:33.841 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42833d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:33.854 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:34.044 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:34.044 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid ospid 21340 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:34.146 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:34.146 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:34.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:34.470 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:35.642 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:35.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:36.476 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:36.476 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:37.516 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035a002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:37.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:38.496 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:38.497 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:49:38.497 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:38.497 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(21413) version 11:1:1:4 [ CSSD]2013-05-23 17:49:38.503 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:49:38.503 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:49:38.503 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:49:38.503 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:38.503 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:49:38.504 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:38.504 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:38.510 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:49:38.510 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:49:38.510 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:38.510 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:38.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:38.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:38.713 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:38.713 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid ospid 21413 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:39.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035b002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:39.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:49:39.093 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:49:39.093 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:49:39.093 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:39.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035c002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:39.101 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:49:39.102 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:49:39.149 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:39.150 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:39.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:40.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:40.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:41.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:42.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(035d002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:42.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:49:42.394 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:49:42.394 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:49:42.394 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:42.402 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(035e002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:42.402 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:49:42.402 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:49:42.560 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:42.560 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:43.152 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:43.153 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:49:43.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:44.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:44.590 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:45.665 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:45.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:46.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:46.596 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:47.540 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(035f002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:47.972 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:48.156 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:48.156 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:48.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:48.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:49.075 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:49.076 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:49:49.077 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:49.077 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ba8d0) pid(21494) version 11:1:1:4 [ CSSD]2013-05-23 17:49:49.082 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:49:49.083 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:49.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:49:49.089 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:49:49.089 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e7c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:49:49.089 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e7c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:49:49.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:49:49.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b42c6340) skgpid ospid 21494 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:49:50.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:50.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:50.636 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:52.030 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:52.641 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:52.641 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:53.159 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:53.160 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:54.035 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:54.342 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0360002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:54.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:49:54.342 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:49:54.342 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:49:54.342 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:49:54.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0361002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:54.348 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:49:54.348 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:49:54.653 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:54.653 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:55.687 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:49:56.065 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:56.659 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:56.659 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:49:56.829 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8d0) allocated [ CSSD]2013-05-23 17:49:56.829 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:49:56.830 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8d0 - 1,2,3 [ CSSD]2013-05-23 17:49:56.830 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8d0) pid(20951/20951) version 11:1:1:4 [ CSSD]2013-05-23 17:49:56.846 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8d0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:49:56.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:49:56.846 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:49:56.846 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 17:49:57.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0362002d) incarnation(174631051) [ CSSD]2013-05-23 17:49:58.070 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:49:58.163 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:49:58.163 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:49:58.730 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:49:58.730 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:00.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:00.754 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:00.754 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:02.099 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:02.166 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:02.166 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:50:02.759 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:02.759 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:04.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:04.334 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d4c70) allocated [ CSSD]2013-05-23 17:50:04.336 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:50:04.336 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d4c70 - 1,2,3 [ CSSD]2013-05-23 17:50:04.336 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d4c70) pid(21825) version 11:1:1:4 [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d4c70), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d9290, requested num -1 [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:50:04.353 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:04.359 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:50:04.359 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:50:04.359 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:04.359 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:50:04.561 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d4c70 [ CSSD]2013-05-23 17:50:04.561 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d4c70) con(0x7f82b42ccc30) skgpid ospid 21825 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:04.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:04.773 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:05.082 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5130) allocated [ CSSD]2013-05-23 17:50:05.083 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:50:05.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5130 - 1,2,3 [ CSSD]2013-05-23 17:50:05.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5130) pid(21874/21874) version 11:1:1:4 [ CSSD]2013-05-23 17:50:05.099 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42a5130), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:50:05.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:50:05.099 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:50:05.099 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:50:05.395 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:50:05.395 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:50:05.396 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:50:05.396 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:50:05.396 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5130 [ CSSD]2013-05-23 17:50:05.396 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5130) con(0x7f82b42ccc30) skgpid 21874 ospid 21874 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:05.708 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:06.137 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:06.779 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:06.779 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:07.170 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:07.170 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:07.589 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0363002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:08.143 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:08.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:08.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:09.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0364002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:09.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:09.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:09.590 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:09.590 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:09.596 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0365002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:09.596 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:09.596 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:10.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:10.837 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:10.837 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:12.173 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:12.174 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:12.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:12.843 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:12.843 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:14.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:14.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:14.854 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:15.737 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:16.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:16.859 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:16.859 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:17.177 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:17.177 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:17.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0366002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:18.244 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:18.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:18.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:19.594 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9290) allocated [ CSSD]2013-05-23 17:50:19.595 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:50:19.595 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9290 - 1,2,3 [ CSSD]2013-05-23 17:50:19.595 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42d9290) pid(21978) version 11:1:1:4 [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d9290), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:50:19.602 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:19.608 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:50:19.608 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:50:19.608 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b427c510) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:19.609 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b427c510) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:50:19.811 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9290 [ CSSD]2013-05-23 17:50:19.811 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9290) con(0x7f82b42ccc30) skgpid ospid 21978 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:20.255 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:20.626 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:50:20.626 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:50:20.626 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.626 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 17:50:20.629 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:50:20.629 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:50:20.629 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42ccac0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.629 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a2a00), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cef60 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cef60) con(0x7f82b42d3bf0) skgpid 16426 ospid 16426 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.633 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42d8690) [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42d8690), grp DBHWPROD, member 0 [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42d8690), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:50:20.634 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42a5080) skgpid 16430 ospid 16430 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cbaf0 [ CSSD]2013-05-23 17:50:20.641 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cbaf0) con(0x7f82b42ba430) skgpid 16428 ospid 16428 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:20.878 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:20.878 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:22.180 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:22.180 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:22.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:22.884 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:22.884 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:24.266 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(436) tag(0367002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(436) [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(CLSSSCHECK_GROUP) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP) [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmAddMember: member (0/0x7f82ac007b40) added. pbsz(8) prsz(8) flags 0x0 to grock (0x7f82ac007840/CLSSSCHECK_GROUP) [ CSSD]2013-05-23 17:50:24.670 [1123510592] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 17:50:24.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0368002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.671 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:24.671 [1123510592] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 17:50:24.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0369002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.672 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:24.672 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(CLSSSCHECK_LOCK) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:24.672 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/CLSSSCHECK_LOCK) [ CSSD]2013-05-23 17:50:24.672 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:50:24.673 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036a002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.673 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:24.673 [1123510592] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:24.850 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036b002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:24.850 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:24.850 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:24.850 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:24.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(036c002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.857 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:24.857 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:24.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:24.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:25.764 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:26.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:26.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:26.929 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:27.184 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:27.184 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:27.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036d002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:28.283 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:28.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:28.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:30.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:30.948 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:30.948 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:32.187 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:32.187 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:32.341 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:32.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:32.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:34.347 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:34.844 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:50:34.844 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:50:34.845 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:50:34.845 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(22128) version 11:1:1:4 [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d5980, requested num -1 [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:50:34.851 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:34.857 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:50:34.857 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:50:34.857 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:34.857 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:50:34.965 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:34.965 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:35.060 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:50:35.060 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 22128 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:35.787 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:36.190 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:36.190 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:50:36.359 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:36.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:36.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:37.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(036e002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:38.384 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:38.753 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:50:38.753 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:50:38.754 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:50:38.754 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(22189) version 11:1:1:4 [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42a3ba0, requested num -1 [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:50:38.760 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:38.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:50:38.767 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:50:38.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285e90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:38.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285e90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:50:38.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:50:38.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 22189 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:39.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:39.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:40.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(036f002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:40.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:40.111 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:40.111 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:40.111 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:40.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0370002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:40.118 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:40.118 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:40.437 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:41.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:41.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:41.193 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:41.194 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:42.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:42.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0371002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:42.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:42.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:42.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:42.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:42.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0372002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:42.658 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:42.658 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:43.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:43.053 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:44.449 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:45.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:45.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:45.813 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:46.197 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:46.197 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:46.459 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:47.071 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:47.071 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:47.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0373002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:48.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:49.082 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:49.082 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:50.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:50:50.093 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:50:50.093 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:50:50.093 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(22324) version 11:1:1:4 [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:50:50.099 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:50.106 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:50:50.106 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:50:50.106 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:50:50.106 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:50:50.309 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:50:50.309 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 22324 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:50:50.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:51.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:51.127 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:51.201 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:51.201 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(436) tag(0374002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(436) [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(CLSSSCHECK_GROUP) memberNo(-1) node(2) type(2). [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP) [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmAddMember: member (0/0x7f82ac007b40) added. pbsz(8) prsz(8) flags 0x0 to grock (0x7f82ac007840/CLSSSCHECK_GROUP) [ CSSD]2013-05-23 17:50:52.030 [1123510592] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Remote) node(2) flags 0x0 0x0 [ CSSD]2013-05-23 17:50:52.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0375002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:52.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:52.032 [1123510592] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 2 [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0376002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(CLSSSCHECK_LOCK) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/CLSSSCHECK_LOCK) [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0377002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:52.033 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:52.034 [1123510592] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:52.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:53.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:53.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:54.488 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:55.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:55.165 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:55.203 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:50:55.203 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:50:55.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0378002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:55.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:55.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:55.371 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:55.371 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:55.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0379002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:55.379 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:55.379 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:50:55.838 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:50:56.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:57.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:57.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:57.720 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037a002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:58.564 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:50:59.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:50:59.183 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:50:59.778 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037b002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:59.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:50:59.778 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:50:59.778 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:50:59.778 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:50:59.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037c002d) incarnation(174631051) [ CSSD]2013-05-23 17:50:59.785 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:50:59.785 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:00.206 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:00.207 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:00.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:01.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:01.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:02.581 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:03.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:03.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:04.587 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:05.210 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:05.210 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:05.247 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:05.247 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:05.353 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:51:05.353 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:51:05.354 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:51:05.354 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(22460) version 11:1:1:4 [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:51:05.360 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:05.368 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:05.368 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:51:05.368 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207270) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:05.368 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207270) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:51:05.571 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:51:05.571 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 22460 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:05.863 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:06.640 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:07.271 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:07.271 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:07.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(037d002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:08.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:09.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:09.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:10.214 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:10.214 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:10.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(037e002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:10.622 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:10.622 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:10.622 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:51:10.622 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:10.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(037f002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:10.630 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:10.630 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:10.657 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:11.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:11.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:12.663 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:13.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:13.341 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:14.216 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:14.216 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:51:14.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:15.193 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:51:15.194 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:51:15.194 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:51:15.194 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(22038/22038) version 11:1:1:4 [ CSSD]2013-05-23 17:51:15.210 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b429dca0) [ CSSD]2013-05-23 17:51:15.210 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:51:15.210 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:51:15.210 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 17:51:15.346 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:15.346 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:15.899 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:16.023 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42be580) allocated [ CSSD]2013-05-23 17:51:16.024 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:51:16.024 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42be580 - 1,2,3 [ CSSD]2013-05-23 17:51:16.024 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42be580) pid(22570/22570) version 11:1:1:4 [ CSSD]2013-05-23 17:51:16.040 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42be580), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:51:16.040 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:51:16.040 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:51:16.040 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 17:51:16.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:51:16.065 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:51:16.065 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:51:16.065 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 17:51:16.066 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42be580 [ CSSD]2013-05-23 17:51:16.066 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42be580) con(0x7f82b42c6340) skgpid 22570 ospid 22570 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:16.681 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:17.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:17.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:17.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0380002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:18.686 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:19.219 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:19.220 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:19.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:19.364 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:20.604 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42be580) allocated [ CSSD]2013-05-23 17:51:20.605 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:51:20.605 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42be580 - 1,2,3 [ CSSD]2013-05-23 17:51:20.605 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42be580) pid(22607) version 11:1:1:4 [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42be580), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:51:20.611 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:20.618 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:51:20.618 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:51:20.618 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:20.619 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:51:20.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:20.821 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42be580 [ CSSD]2013-05-23 17:51:20.821 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42be580) con(0x7f82b42c6340) skgpid ospid 22607 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:21.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:21.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:22.685 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0381002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:22.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:22.685 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:22.685 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:51:22.685 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:22.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0382002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:22.692 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:22.693 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:22.714 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:22.840 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:51:22.841 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:51:22.842 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:51:22.843 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:51:23.442 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:23.442 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:24.223 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:24.223 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:24.720 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:25.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:25.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:25.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0383002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:25.881 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:25.881 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:25.881 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:51:25.881 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:25.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0384002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:25.887 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:25.888 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:25.928 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:26.751 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:27.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:27.472 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:27.820 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0385002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:28.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:29.227 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:29.227 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:29.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:29.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:30.849 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:31.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:31.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:32.855 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:33.230 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:33.230 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:51:33.543 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:33.543 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:34.866 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:35.185 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42be580) allocated [ CSSD]2013-05-23 17:51:35.186 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:51:35.186 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42be580 - 1,2,3 [ CSSD]2013-05-23 17:51:35.186 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42be580) pid(22684/22684) version 11:1:1:4 [ CSSD]2013-05-23 17:51:35.202 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42be580), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:51:35.202 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:51:35.202 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:51:35.202 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 17:51:35.569 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:35.569 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:35.854 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:51:35.855 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:51:35.856 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:51:35.856 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42b3cd0) pid(22769) version 11:1:1:4 [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:51:35.862 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:35.869 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:51:35.869 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:51:35.869 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:35.869 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:51:35.958 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:36.072 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:51:36.072 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42cbf30) skgpid ospid 22769 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:36.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:37.574 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:37.574 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:37.848 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0386002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:38.234 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:38.234 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:38.897 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:39.015 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:51:39.016 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:51:39.016 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:51:39.016 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(22830) version 11:1:1:4 [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d91c0, requested num -1 [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:51:39.022 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:39.028 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:51:39.028 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:51:39.028 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aff70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:39.028 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aff70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:51:39.231 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:51:39.231 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 22830 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:39.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:39.586 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:40.950 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:41.137 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0387002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:41.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:41.137 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:41.137 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:51:41.137 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:41.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0388002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:41.144 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:41.144 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:41.592 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:41.592 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:42.918 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0389002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:42.918 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:42.918 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:42.918 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:51:42.918 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:42.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038a002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:42.926 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:42.926 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:42.956 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:43.237 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:43.237 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:43.593 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:43.593 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:44.967 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:45.598 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:45.598 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:45.983 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:46.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:47.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:47.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:47.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038b002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:48.240 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:48.240 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:48.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:49.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:49.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:51.050 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:51.112 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:51:51.113 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:51:51.113 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:51:51.113 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(22925) version 11:1:1:4 [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42a1690, requested num -1 [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:51:51.119 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:51.126 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:51:51.127 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:51:51.127 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aff70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:51:51.127 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aff70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:51:51.329 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:51:51.329 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 22925 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:51:51.681 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:51.681 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:52.243 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:52.243 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:51:53.056 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:53.692 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:53.692 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:55.067 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:55.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:55.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:56.011 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:51:56.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(038c002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:56.387 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:51:56.387 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:51:56.387 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:51:56.387 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:51:56.394 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(038d002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:56.394 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:51:56.394 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:51:57.073 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:57.247 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:51:57.247 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:51:57.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:57.723 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:51:57.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038e002d) incarnation(174631051) [ CSSD]2013-05-23 17:51:59.079 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:51:59.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:51:59.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:01.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:01.782 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:01.782 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:02.250 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:02.251 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:03.097 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:03.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:03.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:05.148 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:05.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:05.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:06.032 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:06.373 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:52:06.374 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:52:06.375 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:52:06.375 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42b3cd0) pid(23084) version 11:1:1:4 [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:52:06.381 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:06.389 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:52:06.389 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:52:06.389 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:06.389 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:52:06.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:52:06.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42cbf30) skgpid ospid 23084 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:07.154 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:07.254 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:07.254 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:07.806 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:07.806 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:07.929 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(038f002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:09.160 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:09.807 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0390002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:09.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:09.807 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:09.807 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:09.807 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:09.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0391002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:09.814 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:09.814 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:09.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:09.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:11.171 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:11.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0392002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:11.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:11.637 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:11.637 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:11.637 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:11.644 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0393002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:11.644 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:11.644 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:11.780 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:52:11.781 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:52:11.781 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:52:11.781 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42b3cd0) pid(23200) version 11:1:1:4 [ CSSD]2013-05-23 17:52:11.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:11.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:12.258 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:12.258 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:13.217 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:13.954 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:13.954 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:14.442 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:52:14.442 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42cbf30) skgpid ospid 23200 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:15.248 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:15.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:15.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:16.054 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:17.254 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:17.261 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:17.261 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:17.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0394002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:18.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:18.004 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:19.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:20.078 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:20.078 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:21.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:21.621 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:52:21.622 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:52:21.623 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:52:21.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:52:21.636 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:52:21.637 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:52:21.637 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:52:21.637 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(23588) version 11:1:1:4 [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d91c0, requested num -1 [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:52:21.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:21.649 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:52:21.649 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:52:21.649 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aff70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:21.649 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aff70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:52:21.703 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0395002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:21.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:21.703 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:21.703 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:52:21.703 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:52:21.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0396002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:21.710 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:21.710 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:21.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:52:21.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 23588 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:22.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:22.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:22.264 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:22.265 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:23.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:24.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:24.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:25.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:26.076 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:26.101 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:26.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:26.267 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:26.267 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:52:26.891 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0397002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:26.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:26.891 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:26.891 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:26.891 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:26.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0398002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:26.898 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:26.898 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:27.355 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:27.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0399002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:28.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:28.107 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:29.381 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:30.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:30.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:31.271 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:31.271 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:31.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:32.205 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:32.205 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:33.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:34.257 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:34.257 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:35.400 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:36.098 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:36.261 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:36.261 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:36.274 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:36.274 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:36.886 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:52:36.887 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:52:36.887 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:52:36.887 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(23724) version 11:1:1:4 [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:52:36.893 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:36.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:52:36.900 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:52:36.900 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:36.900 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:52:37.102 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:52:37.102 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 23724 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:37.405 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:38.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039a002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:38.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:38.285 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:39.276 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b3cd0) allocated [ CSSD]2013-05-23 17:52:39.277 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:52:39.277 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b3cd0 - 1,2,3 [ CSSD]2013-05-23 17:52:39.277 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42b3cd0) pid(23777) version 11:1:1:4 [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42b3cd0), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42cbf30, requested num -1 [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:52:39.284 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:39.291 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:52:39.291 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:52:39.291 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:39.291 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:52:39.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:39.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b3cd0 [ CSSD]2013-05-23 17:52:39.493 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b3cd0) con(0x7f82b42c6340) skgpid ospid 23777 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:40.297 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:40.297 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:41.277 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:41.277 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:41.463 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:42.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039b002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:42.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:42.139 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:42.139 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:42.139 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:42.146 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039c002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:42.146 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:42.146 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:42.301 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:42.301 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:43.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(039d002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:43.177 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:43.177 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:43.177 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:43.177 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:43.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(039e002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:43.183 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:43.183 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:43.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:44.357 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:44.357 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:45.280 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:45.280 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:52:45.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:46.128 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:46.363 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:46.363 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:47.506 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:48.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(039f002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:48.374 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:48.374 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:49.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:50.284 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:50.284 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:50.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:50.379 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:51.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:52.131 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:52:52.131 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:52:52.132 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:52:52.132 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ae300) pid(23888) version 11:1:1:4 [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ae300), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42a1690, requested num -1 [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:52:52.138 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:52.145 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:52:52.145 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:52:52.145 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aff70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:52:52.145 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aff70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:52:52.347 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:52:52.348 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42c6340) skgpid ospid 23888 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:52:52.403 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:52.403 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:53.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:54.456 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:54.457 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:55.287 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:52:55.288 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:52:55.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:56.150 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:52:56.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:56.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:57.386 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a0002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:57.386 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:52:57.387 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:52:57.387 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:52:57.387 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:52:57.392 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a1002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:57.392 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:52:57.392 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:52:57.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:52:58.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a2002d) incarnation(174631051) [ CSSD]2013-05-23 17:52:58.494 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:52:58.494 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:52:59.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:00.291 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:00.291 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:00.500 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:00.500 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:01.664 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:02.506 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:02.506 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:03.670 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:04.293 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:04.294 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:53:04.527 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:04.527 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:05.680 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:06.171 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:06.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:06.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:07.391 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:53:07.391 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:53:07.392 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:53:07.392 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ae300) pid(24042) version 11:1:1:4 [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ae300), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:07.398 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:07.405 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:53:07.405 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:53:07.405 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b0060) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:07.405 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b0060) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:07.607 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:53:07.607 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42cbf30) skgpid ospid 24042 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:07.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:08.083 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a3002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:08.565 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:08.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:09.296 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:09.296 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:09.361 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ae300) allocated [ CSSD]2013-05-23 17:53:09.362 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:53:09.363 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ae300 - 1,2,3 [ CSSD]2013-05-23 17:53:09.363 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbf30) proc(0x7f82b42ae300) pid(22682/22682) version 11:1:1:4 [ CSSD]2013-05-23 17:53:09.379 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ae300), client(1/0x7f82b42d9760) [ CSSD]2013-05-23 17:53:09.379 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:53:09.379 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:53:09.379 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 17:53:09.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:10.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:10.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:11.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:12.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:12.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:12.633 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a4002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:12.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:53:12.633 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:53:12.633 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:53:12.633 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:12.639 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a5002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:12.639 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:53:12.639 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:53:13.771 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:14.300 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:14.301 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:14.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:14.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:15.782 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:16.191 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:16.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:16.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:17.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:18.107 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a6002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:18.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:18.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:19.304 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:19.305 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:19.859 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:20.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:20.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:21.865 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:22.641 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:22.642 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:53:22.642 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:22.642 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8e90) pid(24196) version 11:1:1:4 [ CSSD]2013-05-23 17:53:22.648 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:53:22.648 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:53:22.648 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 17:53:22.648 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:22.648 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:53:22.649 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:22.649 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:22.657 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:53:22.657 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:53:22.657 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:22.657 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:22.677 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:22.677 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:22.859 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:22.860 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a9150) skgpid ospid 24196 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:23.308 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:23.308 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:53:23.871 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:24.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:24.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:25.882 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:26.211 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:26.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:26.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:27.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03a7002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:27.880 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:53:27.880 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:53:27.880 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:53:27.880 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:27.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03a8002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:27.887 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:53:27.887 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:53:27.888 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:28.131 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03a9002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:28.311 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:28.312 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:28.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:28.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:29.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:30.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:30.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:31.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:32.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:32.798 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:33.315 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:33.315 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:33.951 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:34.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:34.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:35.963 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:36.232 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:36.814 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:36.814 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:37.318 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:37.318 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:53:37.893 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:37.894 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:53:37.894 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:37.894 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b42d8e90) pid(24338) version 11:1:1:4 [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:37.900 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:37.906 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:53:37.906 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:53:37.906 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:37.907 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:37.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:38.109 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:38.109 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a90a0) skgpid ospid 24338 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:38.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03aa002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:38.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:38.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:39.533 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:39.534 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:53:39.535 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:39.535 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b42d8e90) pid(24391) version 11:1:1:4 [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:39.551 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:39.557 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:53:39.557 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:53:39.557 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:39.558 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:39.760 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:39.760 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a90a0) skgpid ospid 24391 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:39.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:40.617 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:40.618 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:53:40.619 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:40.619 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8e90) pid(24426) version 11:1:1:4 [ CSSD]2013-05-23 17:53:40.873 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:40.873 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:41.204 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:41.204 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a9150) skgpid ospid 24426 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:41.986 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:42.321 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:42.322 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:42.879 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:42.879 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:43.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ab002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:43.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:53:43.128 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:53:43.128 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:53:43.129 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:43.135 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ac002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:43.135 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:53:43.135 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:53:43.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ad002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:43.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:53:43.429 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:53:43.429 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:53:43.429 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:43.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ae002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:43.436 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:53:43.436 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:53:44.012 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:44.043 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:44.051 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:53:44.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:44.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8e90) pid(24625) version 11:1:1:4 [ CSSD]2013-05-23 17:53:44.059 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:53:44.059 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:53:44.059 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41bf650 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 17:53:44.059 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:53:44.059 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:53:44.060 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:44.060 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:44.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:53:44.065 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:53:44.065 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:53:44.065 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:44.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b429e400) allocated [ CSSD]2013-05-23 17:53:44.173 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:53:44.174 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b429e400 - 1,2,3 [ CSSD]2013-05-23 17:53:44.174 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7ce0) proc(0x7f82b429e400) pid(24636) version 11:1:1:4 [ CSSD]2013-05-23 17:53:44.189 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:53:44.191 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:53:44.192 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:53:44.194 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b429e400 [ CSSD]2013-05-23 17:53:44.194 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b429e400) con(0x7f82b42c7ce0) skgpid ospid 24636 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:44.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:44.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a9150) skgpid ospid 24625 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:44.889 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:44.889 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:46.102 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:46.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:46.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:46.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:47.325 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:47.326 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:48.108 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:48.183 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03af002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:48.907 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:48.907 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:50.161 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:50.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:50.913 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:52.166 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:52.329 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:52.330 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:53:52.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:52.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:53.142 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:53:53.143 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:53:53.143 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:53:53.143 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42d8e90) pid(24701) version 11:1:1:4 [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:53:53.149 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:53.157 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:53:53.157 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:53:53.157 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:53:53.157 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:53:53.359 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:53:53.359 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a8fc0) skgpid ospid 24701 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:53:54.172 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:54.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:54.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:56.184 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:56.276 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:53:56.332 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:53:56.332 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:53:56.995 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:56.995 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:53:58.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b0002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:58.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:53:58.379 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b1002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:58.379 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:53:58.379 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:53:58.379 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:53:58.379 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:53:58.385 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b2002d) incarnation(174631051) [ CSSD]2013-05-23 17:53:58.386 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:53:58.386 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:53:59.006 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:53:59.006 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:00.211 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:01.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:01.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:01.336 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:01.336 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:02.216 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:03.037 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:03.037 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:04.240 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:05.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:05.070 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:05.490 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:54:05.491 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:54:05.491 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:54:05.491 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42d8e90) pid(24763/24763) version 11:1:1:4 [ CSSD]2013-05-23 17:54:05.507 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:54:05.507 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:54:05.508 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:54:05.508 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:54:06.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:06.297 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:06.339 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:06.340 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:07.095 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:07.095 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:08.253 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b3002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:08.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:08.393 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5190) allocated [ CSSD]2013-05-23 17:54:08.394 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:54:08.395 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5190 - 1,2,3 [ CSSD]2013-05-23 17:54:08.395 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbd00) proc(0x7f82b42d5190) pid(24858) version 11:1:1:4 [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5190), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42bac40, requested num -1 [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d83c0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:08.412 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:08.419 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:54:08.419 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:54:08.419 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fe430) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:08.419 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fe430) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:08.622 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5190 [ CSSD]2013-05-23 17:54:08.622 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5190) con(0x7f82b42cbd00) skgpid ospid 24858 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:09.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:09.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:10.292 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:11.112 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:11.112 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:11.343 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:11.343 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:12.337 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:13.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:13.118 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:13.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b4002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:13.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:54:13.628 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:54:13.628 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:54:13.628 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:13.635 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b5002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:13.635 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:54:13.635 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:54:14.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:15.171 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:15.171 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:16.331 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:16.347 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:16.347 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:16.375 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:17.177 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:17.177 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:18.278 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b6002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:18.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:19.189 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:19.189 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:20.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:21.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:21.213 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:21.350 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:21.350 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:22.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:23.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:23.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:23.656 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42baac0) allocated [ CSSD]2013-05-23 17:54:23.657 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:54:23.657 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42baac0 - 1,2,3 [ CSSD]2013-05-23 17:54:23.657 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbc30) proc(0x7f82b42baac0) pid(25000) version 11:1:1:4 [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42baac0), client(1/0x7f82b42a2a00) [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a2a00 with con 0x7f82b42d52a0, requested num -1 [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d8250/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:23.663 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:23.670 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a2a00) [ CSSD]2013-05-23 17:54:23.670 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a2a00), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:54:23.670 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8550) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:23.671 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:23.873 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42baac0 [ CSSD]2013-05-23 17:54:23.873 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42baac0) con(0x7f82b42cbc30) skgpid ospid 25000 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:24.423 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:25.221 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:25.221 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:26.353 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:26.353 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:26.353 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:26.494 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:27.246 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:27.246 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:28.328 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03b7002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:28.500 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:28.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03b8002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:28.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:54:28.887 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:54:28.887 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:54:28.887 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:28.895 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03b9002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:28.895 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:54:28.895 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:54:29.279 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:29.279 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:30.513 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:31.247 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5190) allocated [ CSSD]2013-05-23 17:54:31.248 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:54:31.248 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5190 - 1,2,3 [ CSSD]2013-05-23 17:54:31.248 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbd00) proc(0x7f82b42d5190) pid(25087) version 11:1:1:4 [ CSSD]2013-05-23 17:54:31.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:31.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:31.356 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:31.356 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:31.370 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282510) allocated [ CSSD]2013-05-23 17:54:31.371 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:54:31.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282510 - 1,2,3 [ CSSD]2013-05-23 17:54:31.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42baba0) proc(0x7f82b4282510) pid(25097) version 11:1:1:4 [ CSSD]2013-05-23 17:54:31.394 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:54:31.396 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:54:31.399 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282510 [ CSSD]2013-05-23 17:54:31.399 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282510) con(0x7f82b42baba0) skgpid ospid 25097 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5363/0x7f82b4204870) [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5363 (0x7f82b4204870) [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b4204870 with con 0x7f82b42828d0, requested num -1 [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42d8180/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:31.569 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:54:31.576 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5363 (0x7f82b4204870) [ CSSD]2013-05-23 17:54:31.576 [1199044928] >TRACE: clssgmExitGrock: client 5363 (0x7f82b4204870), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:54:31.576 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8550) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:54:31.576 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42d8550) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:31.578 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5190 [ CSSD]2013-05-23 17:54:31.578 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5190) con(0x7f82b42cbd00) skgpid ospid 25087 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:32.518 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:33.291 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:33.291 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:34.524 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:35.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:35.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:35.584 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:54:35.584 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:54:35.584 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4286810), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:54:35.584 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:54:35.585 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:54:35.585 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a8fc0) skgpid 24763 ospid 24763 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:36.359 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:36.360 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:36.379 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:36.576 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:37.326 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:37.326 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:38.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ba002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:38.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:38.911 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:54:38.912 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:54:38.913 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:54:38.913 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8e90) pid(25174) version 11:1:1:4 [ CSSD]2013-05-23 17:54:38.918 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:54:38.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:54:38.918 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 17:54:38.918 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:38.918 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:54:38.919 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:38.919 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:38.925 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:54:38.925 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:54:38.925 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:38.925 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:39.128 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:54:39.128 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a9150) skgpid ospid 25174 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:39.399 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:39.399 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:39.801 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:54:39.802 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:54:39.803 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:54:39.803 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8fc0) proc(0x7f82b42d8e90) pid(25221) version 11:1:1:4 [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4257830) [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:39.809 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:39.815 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 17:54:39.815 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:54:39.815 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:39.815 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:40.017 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:54:40.017 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a8fc0) skgpid ospid 25221 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:40.613 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:41.363 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:41.363 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:41.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:41.404 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:42.619 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:43.416 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:43.416 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:43.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03bb002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:43.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:54:43.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:54:43.687 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:54:43.687 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:43.694 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03bc002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:43.694 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:54:43.694 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:54:44.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03bd002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:44.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:54:44.145 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:54:44.145 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:54:44.145 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:44.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03be002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:44.151 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:54:44.151 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:54:44.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:45.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:45.423 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:46.366 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:46.366 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:46.411 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:46.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:47.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:47.429 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:48.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03bf002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:48.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:49.480 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:49.480 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:50.369 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:50.369 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:54:50.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:51.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:51.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:52.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:53.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:53.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:54.161 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:54:54.162 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:54:54.162 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:54:54.162 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b42d8e90) pid(25334) version 11:1:1:4 [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42a9150, requested num -1 [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:54:54.168 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:54.176 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:54:54.176 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:54:54.176 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e400) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:54:54.176 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e400) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:54:54.378 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:54:54.379 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a90a0) skgpid ospid 25334 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:54:54.805 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:55.372 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:54:55.373 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:54:55.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:55.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:56.462 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:54:56.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:57.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:57.610 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:54:58.415 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c0002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:58.822 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:54:59.404 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c1002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:59.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:54:59.404 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:54:59.404 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:54:59.404 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:54:59.410 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c2002d) incarnation(174631051) [ CSSD]2013-05-23 17:54:59.410 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:54:59.410 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:54:59.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:54:59.621 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:00.376 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:00.376 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:00.874 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:01.626 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:01.626 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:02.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:03.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:03.678 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:04.473 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:55:04.474 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:55:04.474 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:55:04.474 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b42d8e90) pid(25473/25473) version 11:1:1:4 [ CSSD]2013-05-23 17:55:04.490 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:04.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:04.490 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:55:04.490 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:55:04.778 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:04.778 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:55:04.778 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42ccac0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:55:04.779 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:55:04.779 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:55:04.779 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a90a0) skgpid 25473 ospid 25473 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:04.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:05.380 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:05.380 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:05.683 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:05.683 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:06.488 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:06.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:07.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:07.689 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:08.439 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c3002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:08.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:09.383 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:09.383 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:55:09.412 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:55:09.413 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:55:09.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:55:09.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a9150) proc(0x7f82b42d8e90) pid(25511) version 11:1:1:4 [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42c7b30, requested num -1 [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:55:09.420 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:09.428 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:55:09.428 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:55:09.428 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cfa20) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:09.428 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cfa20) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:55:09.631 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 17:55:09.631 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a9150) skgpid ospid 25511 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:09.701 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:09.701 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:10.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:11.707 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:11.707 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:13.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:13.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:13.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:14.386 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:14.386 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:14.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c4002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:14.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:55:14.650 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:55:14.650 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:55:14.650 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:14.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c5002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:14.656 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:55:14.656 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:55:15.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:15.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:15.745 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:16.512 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:17.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:17.770 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:17.770 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:18.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c6002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:19.045 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:19.389 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:19.389 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:19.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:19.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:20.945 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d8e90) allocated [ CSSD]2013-05-23 17:55:20.946 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:55:20.946 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d8e90 - 1,2,3 [ CSSD]2013-05-23 17:55:20.946 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a90a0) proc(0x7f82b42d8e90) pid(25644/25644) version 11:1:1:4 [ CSSD]2013-05-23 17:55:20.963 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42d8e90), client(1/0x7f82b4204870) [ CSSD]2013-05-23 17:55:20.963 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 17:55:20.963 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:55:20.963 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 17:55:21.085 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:21.399 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d5190) allocated [ CSSD]2013-05-23 17:55:21.400 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:55:21.401 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d5190 - 1,2,3 [ CSSD]2013-05-23 17:55:21.401 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42cbd00) proc(0x7f82b42d5190) pid(24759/24759) version 11:1:1:4 [ CSSD]2013-05-23 17:55:21.417 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5190), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 17:55:21.417 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 17:55:21.417 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:55:21.417 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 17:55:21.786 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:21.786 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:23.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:23.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:23.800 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:24.392 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:24.393 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:24.665 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4282890) allocated [ CSSD]2013-05-23 17:55:24.666 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:55:24.666 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4282890 - 1,2,3 [ CSSD]2013-05-23 17:55:24.666 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42b35c0) proc(0x7f82b4282890) pid(25666) version 11:1:1:4 [ CSSD]2013-05-23 17:55:24.683 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b4282890), client(1/0x7f82b427d4a0) [ CSSD]2013-05-23 17:55:24.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:55:24.683 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4a0 with con 0x7f82b42827d0, requested num -1 [ CSSD]2013-05-23 17:55:24.684 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:24.684 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcd90/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:55:24.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:55:24.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:24.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:55:24.691 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:55:24.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3c00) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:24.692 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3c00) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:55:24.894 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4282890 [ CSSD]2013-05-23 17:55:24.894 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4282890) con(0x7f82b42b35c0) skgpid ospid 25666 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:25.183 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:25.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:25.805 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:26.546 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:27.209 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:27.831 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:27.831 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:28.395 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:28.395 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:55:28.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03c7002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:29.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:29.898 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03c8002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:29.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:55:29.898 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:55:29.898 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:55:29.898 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:29.902 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:29.902 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:29.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03c9002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:29.905 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:55:29.905 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:55:31.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:31.908 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:31.908 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:32.712 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42d5190), client(2/0x7f82b4257830) [ CSSD]2013-05-23 17:55:32.712 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b4257830) [ CSSD]2013-05-23 17:55:32.712 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:55:32.712 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 25 [ CSSD]2013-05-23 17:55:33.231 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:33.398 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:33.398 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:33.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:33.919 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:35.284 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:35.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:35.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:36.567 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:37.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:37.931 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:37.931 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:38.402 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:38.402 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:38.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ca002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:39.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:39.928 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3960) allocated [ CSSD]2013-05-23 17:55:39.929 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:55:39.930 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3960 - 1,2,3 [ CSSD]2013-05-23 17:55:39.930 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d83e0) proc(0x7f82b42d3960) pid(25810) version 11:1:1:4 [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d3960), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42d38a0, requested num -1 [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:55:39.936 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:39.942 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:55:39.942 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:55:39.942 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:39.943 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:55:39.953 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:39.953 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:40.058 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cee80) allocated [ CSSD]2013-05-23 17:55:40.058 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:55:40.059 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cee80 - 1,2,3 [ CSSD]2013-05-23 17:55:40.059 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b42cee80) pid(25851) version 11:1:1:4 [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmRegisterClient: proc(69/0x7f82b42cee80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d38b0, requested num -1 [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fdf80/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:55:40.065 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:40.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 17:55:40.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:55:40.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cec30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:40.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cec30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:55:40.145 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3960 [ CSSD]2013-05-23 17:55:40.145 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3960) con(0x7f82b42d83e0) skgpid ospid 25810 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:40.274 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cee80 [ CSSD]2013-05-23 17:55:40.274 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cee80) con(0x7f82b42d8560) skgpid ospid 25851 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:41.406 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:41.959 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:41.959 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:43.405 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:43.406 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:43.412 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:43.956 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03cb002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:43.956 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:55:43.956 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:55:43.956 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:55:43.956 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:43.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03cc002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:43.963 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:55:43.963 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:55:43.991 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:43.991 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:45.165 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03cd002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:45.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:55:45.165 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:55:45.165 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:55:45.165 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:45.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ce002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:45.172 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:55:45.173 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:55:45.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:45.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:45.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:46.590 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:47.408 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:47.409 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:55:47.430 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:48.002 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:48.002 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:48.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03cf002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:49.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:50.031 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:50.031 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:51.487 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:52.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:52.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:52.412 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:52.412 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:53.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:54.040 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:54.040 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:55.189 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3960) allocated [ CSSD]2013-05-23 17:55:55.190 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:55:55.190 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3960 - 1,2,3 [ CSSD]2013-05-23 17:55:55.190 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe810) proc(0x7f82b42d3960) pid(25962) version 11:1:1:4 [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d3960), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42d38a0, requested num -1 [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:55:55.196 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:55:55.203 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:55:55.203 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:55:55.203 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fd2d0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:55:55.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fd2d0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:55:55.406 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3960 [ CSSD]2013-05-23 17:55:55.406 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3960) con(0x7f82b41fe810) skgpid ospid 25962 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:55:55.525 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:56.064 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:56.064 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:56.610 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:55:57.416 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:55:57.416 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:55:57.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:55:58.069 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:55:58.069 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:55:58.562 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d0002d) incarnation(174631051) [ CSSD]2013-05-23 17:55:59.536 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:00.104 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:00.104 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:00.421 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d1002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:00.421 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:00.421 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:00.421 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:56:00.421 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:00.429 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d2002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:00.429 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:00.430 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:01.588 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:02.110 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:02.110 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:02.419 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:02.419 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:03.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:04.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:04.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:05.625 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:06.208 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:06.208 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:06.421 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:06.421 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:56:06.632 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:07.631 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:08.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:08.233 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:08.586 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d3002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:09.656 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:10.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:10.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:10.450 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3960) allocated [ CSSD]2013-05-23 17:56:10.451 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:56:10.451 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3960 - 1,2,3 [ CSSD]2013-05-23 17:56:10.451 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b42d3960) pid(26119) version 11:1:1:4 [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d3960), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d83e0, requested num -1 [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fcfd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:56:10.458 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:10.466 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:56:10.466 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:56:10.466 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d3720) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:10.466 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d3720) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:56:10.669 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3960 [ CSSD]2013-05-23 17:56:10.669 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3960) con(0x7f82b42d8560) skgpid ospid 26119 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:11.425 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:11.425 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:11.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:12.349 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:12.349 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:13.713 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:14.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:14.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:15.454 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d3960) allocated [ CSSD]2013-05-23 17:56:15.454 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:56:15.455 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d3960 - 1,2,3 [ CSSD]2013-05-23 17:56:15.455 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fe810) proc(0x7f82b42d3960) pid(26192/26192) version 11:1:1:4 [ CSSD]2013-05-23 17:56:15.471 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b42d3960), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:56:15.471 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:56:15.471 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:56:15.471 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 38 [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 37 [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d3960 [ CSSD]2013-05-23 17:56:15.490 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d3960) con(0x7f82b41fe810) skgpid 26192 ospid 26192 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:15.671 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d4002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:15.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:15.671 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:15.671 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:56:15.671 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:15.678 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d5002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:15.678 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:15.678 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:15.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:16.428 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:16.428 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:16.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:16.447 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:16.677 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:17.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:18.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:18.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:18.613 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d6002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:19.757 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:20.566 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:20.566 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:21.431 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:21.431 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:21.808 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:22.572 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:22.572 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:23.070 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03d7002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:23.070 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:23.070 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:23.070 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 17:56:23.070 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:23.076 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03d8002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:23.076 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:23.076 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:23.207 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:56:23.208 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:56:23.209 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:56:23.210 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:56:23.814 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:24.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:24.604 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:25.313 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:56:25.313 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:56:25.313 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:56:25.314 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 17:56:25.314 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8d0 [ CSSD]2013-05-23 17:56:25.314 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8d0) con(0x7f82b427d8a0) skgpid 20951 ospid 20951 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:25.434 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:25.434 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:56:25.713 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:56:25.715 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:56:25.715 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:56:25.715 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(26282) version 11:1:1:4 [ CSSD]2013-05-23 17:56:25.721 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:56:25.721 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:56:25.721 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:56:25.721 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:25.721 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:56:25.722 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:56:25.722 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:25.728 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:56:25.728 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:56:25.728 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:25.729 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:56:25.826 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:25.931 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:56:25.931 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 26282 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:26.609 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:26.609 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:26.699 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:27.832 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:28.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:28.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:28.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03d9002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:29.884 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:30.437 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:30.438 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:30.625 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:30.625 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:30.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03da002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:30.926 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:30.926 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:30.926 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:56:30.926 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:30.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03db002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:30.933 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:30.933 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:31.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:32.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:32.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:33.935 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:34.704 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:34.704 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:35.441 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:35.442 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:35.936 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:36.710 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:36.710 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:36.720 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:37.961 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:38.664 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03dc002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:38.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:38.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:39.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:40.325 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:56:40.326 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:56:40.326 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:56:40.326 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(26421) version 11:1:1:4 [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a5440, requested num -1 [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:56:40.344 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:40.352 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:56:40.352 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:56:40.352 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:40.352 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:56:40.445 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:40.445 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:40.555 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:56:40.555 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 26421 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:40.727 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:40.727 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:40.974 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:56:40.974 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:56:40.975 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:56:40.975 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(26433) version 11:1:1:4 [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b42a1820) [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a1820 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:56:40.982 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:40.989 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:56:40.989 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a1820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:56:40.989 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:40.989 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:56:41.192 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:56:41.192 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 26433 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:42.000 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:42.752 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:42.752 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:44.023 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:44.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03dd002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:44.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:44.234 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:44.234 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:56:44.234 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:44.240 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03de002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:44.240 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:44.240 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:44.448 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:44.448 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:56:44.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:44.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:46.037 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:46.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03df002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:46.193 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:56:46.193 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:56:46.193 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:56:46.193 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:46.200 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e0002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:46.200 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:56:46.200 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:56:46.744 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:46.829 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:46.829 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:48.042 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:48.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e1002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:48.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:48.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:49.452 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:49.452 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:50.095 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:50.846 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:50.846 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:52.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:52.852 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:52.852 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:54.146 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:54.456 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:54.456 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:56:54.905 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:54.905 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:56.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:56.225 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:56:56.226 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:56:56.226 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:56:56.226 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(26611) version 11:1:1:4 [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b4286810) [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b42a5440, requested num -1 [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:56:56.233 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:56:56.240 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 17:56:56.240 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:56:56.240 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:56:56.240 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:56:56.442 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:56:56.442 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 26611 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:56:56.785 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:56:56.930 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:56.930 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:56:58.202 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:56:58.458 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:56:58.459 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:56:58.717 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e2002d) incarnation(174631051) [ CSSD]2013-05-23 17:56:58.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:56:58.942 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:00.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:00.949 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:00.949 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:01.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e3002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:01.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:01.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:01.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:57:01.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:01.446 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e4002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:01.446 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:01.446 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:02.238 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:02.955 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:02.955 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:03.462 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:03.462 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:04.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:04.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:04.974 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:06.299 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:06.820 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:06.980 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:06.980 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:08.304 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:08.465 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:08.465 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:08.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e5002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:08.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:08.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:10.315 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:10.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:10.999 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:11.266 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:11.267 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:57:11.268 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:11.268 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(26797) version 11:1:1:4 [ CSSD]2013-05-23 17:57:11.476 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b41feb20) allocated [ CSSD]2013-05-23 17:57:11.477 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:57:11.477 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b41feb20 - 1,2,3 [ CSSD]2013-05-23 17:57:11.477 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b41feb20) pid(26849) version 11:1:1:4 [ CSSD]2013-05-23 17:57:11.483 [1199044928] >TRACE: clssgmRegisterClient: proc(68/0x7f82b41feb20), client(1/0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4a0 with con 0x7f82b42ba970, requested num -1 [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d3b60/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:11.484 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:11.491 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:11.491 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:11.491 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fcd90) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:11.491 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fcd90) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:11.693 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b41feb20 [ CSSD]2013-05-23 17:57:11.694 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b41feb20) con(0x7f82b4257120) skgpid ospid 26849 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:12.340 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:13.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:13.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:13.468 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:13.468 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:13.736 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:13.736 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 26797 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:14.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:15.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:15.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:15.306 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:15.307 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:57:15.308 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:15.308 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(27163) version 11:1:1:4 [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:15.314 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:15.321 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:15.321 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:15.321 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:15.322 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:15.524 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:15.524 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 27163 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:16.418 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:16.687 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e6002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:16.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:16.687 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:16.687 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:57:16.687 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:16.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03e7002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:16.693 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:16.693 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:16.841 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:17.030 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:17.030 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:17.471 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:17.471 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:57:18.424 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:18.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03e8002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:19.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:19.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:20.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:21.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:21.068 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:21.937 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:57:21.938 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:57:21.939 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:57:21.940 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:57:22.020 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03e9002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:22.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:22.020 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:22.020 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 17:57:22.020 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 17:57:22.027 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ea002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:22.027 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:22.027 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:22.442 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:22.474 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:22.474 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:23.073 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:23.073 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:24.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:25.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:25.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:26.520 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:26.728 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:26.729 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:57:26.729 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:26.729 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(27258) version 11:1:1:4 [ CSSD]2013-05-23 17:57:26.735 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:57:26.735 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:57:26.735 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b42b5b40, requested num -1 [ CSSD]2013-05-23 17:57:26.735 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:26.735 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:26.736 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:26.736 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:26.742 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:57:26.742 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:26.743 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:26.743 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:26.861 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:26.945 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:26.945 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 27258 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:27.132 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:27.133 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:27.478 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:27.478 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:28.526 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:28.788 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03eb002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:29.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:29.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:30.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:31.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:31.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:31.937 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ec002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:31.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:31.937 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:31.937 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:57:31.937 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:31.943 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03ed002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:31.943 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:31.943 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:32.481 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:32.481 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:32.543 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:33.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:33.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:34.549 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:35.166 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:35.166 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:36.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:36.883 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:37.172 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:37.172 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:37.483 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:37.484 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:38.605 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:38.813 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03ee002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:39.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:39.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:40.599 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:40.600 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:57:40.600 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:40.600 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(27403) version 11:1:1:4 [ CSSD]2013-05-23 17:57:40.607 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:57:40.607 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:57:40.607 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:57:40.607 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:40.607 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:40.608 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:40.608 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:40.615 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:57:40.615 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:40.615 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:40.615 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:40.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:40.818 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:40.818 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 27403 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:41.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:41.230 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:41.990 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:41.990 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:57:41.991 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:41.991 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(27424) version 11:1:1:4 [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:41.997 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:42.004 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:57:42.004 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:42.004 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d8560) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:42.004 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d8560) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:42.207 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:42.207 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 27424 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:42.487 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:42.487 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:42.623 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:43.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:43.275 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:44.485 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ef002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:44.485 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:44.485 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:44.485 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:57:44.485 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:44.491 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f0002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:44.491 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:44.491 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:44.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:44.830 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:57:44.831 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:57:44.832 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:57:44.832 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(27486) version 11:1:1:4 [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42a2930), client(1/0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d4a0 with con 0x7f82b42d5c80, requested num -1 [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b41fe430/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:44.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:44.846 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d4a0) [ CSSD]2013-05-23 17:57:44.846 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d4a0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:44.846 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ba8a0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:44.847 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ba8a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:45.049 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:57:45.049 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 27486 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:45.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:45.347 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:46.721 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:46.906 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:47.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f1002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:47.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:57:47.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:57:47.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:57:47.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:47.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f2002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:47.198 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:57:47.198 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:57:47.352 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:47.352 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:47.490 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:47.490 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:48.746 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:48.830 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f3002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:49.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:49.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b429dca0) [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b429dca0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:57:50.764 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid 22038 ospid 22038 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:50.797 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:51.370 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:51.370 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:52.493 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:52.493 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:52.803 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:53.422 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:53.422 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:54.828 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:55.448 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:55.448 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:56.842 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:56.949 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:57:57.243 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:57:57.244 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:57:57.244 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:57:57.244 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(27587) version 11:1:1:4 [ CSSD]2013-05-23 17:57:57.250 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:57.250 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:57.250 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207ce0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:57:57.250 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:57.250 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:57:57.251 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:57:57.251 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:57:57.258 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207ce0) [ CSSD]2013-05-23 17:57:57.258 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207ce0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:57:57.258 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:57:57.258 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:57:57.454 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:57.454 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:57:57.460 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:57:57.460 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 27587 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:57:57.497 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:57:57.497 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:57:58.851 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f4002d) incarnation(174631051) [ CSSD]2013-05-23 17:57:58.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:57:59.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:57:59.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:00.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:01.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:01.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:02.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f5002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:02.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:58:02.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:58:02.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:58:02.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:02.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f6002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:02.447 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:58:02.447 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:58:02.500 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:02.500 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:02.955 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:03.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:03.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:05.007 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:05.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:05.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:06.979 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:07.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:07.504 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:07.504 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:07.554 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:07.554 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:08.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03f7002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:09.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:09.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:09.605 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:11.048 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:11.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:11.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:12.494 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:12.495 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:58:12.495 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:12.495 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(27742) version 11:1:1:4 [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4207960 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:12.502 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:12.507 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:12.507 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:12.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:58:12.509 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4207960), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:58:12.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:12.509 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:12.712 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:12.712 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 27742 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:13.053 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:13.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:13.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:15.107 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:15.629 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:15.629 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:16.510 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:16.510 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:58:17.002 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:17.113 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:17.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:17.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:17.689 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03f8002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:17.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:58:17.689 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:58:17.689 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:58:17.689 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:17.695 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03f9002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:17.695 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:58:17.695 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:58:18.911 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fa002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:19.119 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:19.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:19.666 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:21.130 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:21.514 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:21.514 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:21.672 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:21.672 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:23.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:23.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:23.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:25.208 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:25.699 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:25.699 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:26.517 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:26.518 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:27.023 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:27.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:27.705 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:27.705 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:27.746 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:27.747 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:58:27.747 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:27.747 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(27898) version 11:1:1:4 [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:27.753 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:27.760 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:58:27.760 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:58:27.760 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:27.760 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:27.963 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:27.963 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 27898 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:28.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fb002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:29.219 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:29.736 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:29.736 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:31.230 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:31.521 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:31.522 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:31.742 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:31.742 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:32.935 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03fc002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:32.935 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:58:32.935 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:58:32.935 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:58:32.935 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:32.942 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(03fd002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:32.942 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:58:32.942 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:58:33.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:33.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:33.835 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:35.308 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:35.524 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:35.525 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:58:35.841 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:35.841 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:37.044 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:37.313 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:37.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:37.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:38.972 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(03fe002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:39.319 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:39.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:39.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:40.528 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:40.528 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:40.851 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:40.851 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:58:40.852 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:40.852 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(28064) version 11:1:1:4 [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:40.867 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:40.872 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 17:58:40.872 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:58:40.872 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4285d70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:40.872 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4285d70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:41.034 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:58:41.035 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:58:41.035 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:58:41.035 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a2930) pid(28037) version 11:1:1:4 [ CSSD]2013-05-23 17:58:41.075 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:41.075 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 28064 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:41.331 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:41.595 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:58:41.595 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b427d8a0) skgpid ospid 28037 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:41.864 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:41.864 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:42.999 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:43.000 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:58:43.000 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:43.000 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(28206) version 11:1:1:4 [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b42d9350) [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42d9350 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:43.006 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:43.013 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42d9350) [ CSSD]2013-05-23 17:58:43.013 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42d9350), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:58:43.013 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b41fa050) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:43.013 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b41fa050) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:43.216 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:43.216 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 28206 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:43.336 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:43.875 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:43.875 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:44.350 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:44.350 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:58:44.351 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:44.351 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(28264) version 11:1:1:4 [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207a80), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427d5c0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:44.357 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:44.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:58:44.364 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 17:58:44.364 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 17:58:44.364 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:44.472 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:58:44.473 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:58:44.473 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:58:44.473 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a2930) pid(28269) version 11:1:1:4 [ CSSD]2013-05-23 17:58:44.488 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:58:44.490 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:58:44.492 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:58:44.493 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:58:44.494 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42ccc30) skgpid ospid 28269 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:44.566 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:44.566 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 28264 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:44.734 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(03ff002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:44.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:58:44.734 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:58:44.734 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:58:44.734 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:44.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0400002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:44.741 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:58:44.741 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:58:45.409 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:45.531 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:45.531 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:45.880 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:45.880 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:47.065 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:47.415 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:47.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:47.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:48.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0401002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:48.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:58:48.192 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:58:48.192 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:58:48.192 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:48.199 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0402002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:48.199 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:58:48.199 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:58:48.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0403002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:49.421 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:49.977 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:49.977 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:50.534 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:50.535 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:58:51.431 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:51.983 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:51.983 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:53.456 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:54.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:54.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:54.537 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:54.537 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42d9760) [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42d9760), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ae300 [ CSSD]2013-05-23 17:58:55.332 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ae300) con(0x7f82b42cbf30) skgpid 22682 ospid 22682 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42be580 [ CSSD]2013-05-23 17:58:55.345 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42be580) con(0x7f82b42aee40) skgpid 22684 ospid 22684 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:55.509 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:56.081 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:56.081 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:57.088 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:58:57.515 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:58.086 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:58:58.086 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:58:58.249 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:58:58.250 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:58:58.251 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:58:58.251 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(28387) version 11:1:1:4 [ CSSD]2013-05-23 17:58:58.257 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:58:58.257 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:58:58.257 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 17:58:58.258 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:58.258 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:58:58.258 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:58:58.258 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:58:58.264 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:58:58.264 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:58:58.264 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5ce0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:58:58.264 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5ce0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:58:58.467 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:58:58.467 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 28387 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:58:59.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0404002d) incarnation(174631051) [ CSSD]2013-05-23 17:58:59.521 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:58:59.540 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:58:59.541 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:00.139 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:00.139 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:01.551 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:02.145 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:02.145 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:03.440 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0405002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:03.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:59:03.440 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:59:03.440 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:59:03.440 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:03.447 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0406002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:03.447 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:59:03.447 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:59:03.557 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:04.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:04.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:04.543 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:04.543 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:05.610 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:06.161 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:06.161 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:07.110 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:07.616 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:08.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:08.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:09.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0407002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:09.547 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:09.547 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:09.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:10.259 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:10.259 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:11.649 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:12.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:12.265 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:13.499 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:59:13.500 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:59:13.501 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:59:13.501 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(28549) version 11:1:1:4 [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42d0350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:13.507 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:13.513 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:59:13.513 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:59:13.513 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a8c30) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:13.513 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a8c30) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:13.549 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:13.549 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:59:13.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:13.715 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 17:59:13.715 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 28549 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:14.277 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:14.277 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:15.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:16.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:16.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:17.134 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:17.473 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 17:59:17.474 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:59:17.474 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 17:59:17.474 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(28367/28367) version 11:1:1:4 [ CSSD]2013-05-23 17:59:17.480 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(1/0x7f82b4207960) [ CSSD]2013-05-23 17:59:17.480 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 17:59:17.480 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 17:59:17.480 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 17:59:17.684 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:18.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:18.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:18.552 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:18.553 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:18.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0408002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:18.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:59:18.698 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:59:18.699 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:59:18.699 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:18.706 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0409002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:18.706 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:59:18.706 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:59:19.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040a002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:19.222 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b4207a80), client(2/0x7f82b41ff1f0) [ CSSD]2013-05-23 17:59:19.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 17:59:19.222 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 17:59:19.222 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 26 [ CSSD]2013-05-23 17:59:19.690 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:20.359 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:20.359 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:21.722 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:22.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:22.365 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:23.556 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:23.556 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:23.726 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:24.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:24.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:25.740 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:26.382 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:26.382 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:27.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:27.764 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:28.435 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:28.435 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:28.560 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:28.560 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:28.759 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 17:59:28.760 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:59:28.760 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 17:59:28.760 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42a2930) pid(28705) version 11:1:1:4 [ CSSD]2013-05-23 17:59:28.767 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:59:28.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:59:28.767 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d9690, requested num -1 [ CSSD]2013-05-23 17:59:28.767 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:28.767 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:59:28.768 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:28.768 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:28.775 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:59:28.775 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:59:28.776 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4286740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:28.776 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4286740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:28.978 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 17:59:28.978 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b4257120) skgpid ospid 28705 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:29.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040b002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:29.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:30.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:30.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:31.652 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42aed80) allocated [ CSSD]2013-05-23 17:59:31.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:59:31.653 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42aed80 - 1,2,3 [ CSSD]2013-05-23 17:59:31.653 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42aed80) pid(28766) version 11:1:1:4 [ CSSD]2013-05-23 17:59:31.771 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 17:59:31.772 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:59:31.773 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 17:59:31.773 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427c5d0) proc(0x7f82b42af3a0) pid(28776) version 11:1:1:4 [ CSSD]2013-05-23 17:59:31.790 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:59:31.792 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 17:59:31.794 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 17:59:31.794 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b427c5d0) skgpid ospid 28776 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:31.823 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5364/0x7f82b427d5c0) [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5364 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b427d5c0 with con 0x7f82b4207cc0, requested num -1 [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b427e110/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:31.874 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 17:59:31.881 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5364 (0x7f82b427d5c0) [ CSSD]2013-05-23 17:59:31.881 [1199044928] >TRACE: clssgmExitGrock: client 5364 (0x7f82b427d5c0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 17:59:31.881 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 17:59:31.881 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:31.882 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42aed80 [ CSSD]2013-05-23 17:59:31.882 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42aed80) con(0x7f82b4257120) skgpid ospid 28766 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:32.466 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:32.466 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:32.562 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:32.563 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:59:33.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:33.960 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040c002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:33.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:59:33.960 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:59:33.960 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:59:33.960 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:33.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(040d002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:33.968 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:59:33.968 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:59:34.559 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:34.559 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:35.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:36.564 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:36.565 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:37.179 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:37.566 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:37.566 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:37.847 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:38.576 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:38.576 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:39.123 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(040e002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:39.919 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:40.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:40.582 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:41.115 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:59:41.116 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 17:59:41.117 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:59:41.117 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d9690) pid(28846) version 11:1:1:4 [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d9690), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a2930, requested num -1 [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:41.123 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:41.130 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 17:59:41.130 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:59:41.130 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:41.130 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:41.332 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:59:41.332 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b4257120) skgpid ospid 28846 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:41.924 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:42.569 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:42.570 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:42.588 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:42.588 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:43.930 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:44.016 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 17:59:44.017 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:59:44.017 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 17:59:44.017 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207270) proc(0x7f82b4207c10) pid(28898) version 11:1:1:4 [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4286740, requested num -1 [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:44.024 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:44.030 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 17:59:44.030 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:59:44.030 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:44.030 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:44.233 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 17:59:44.233 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b4207270) skgpid ospid 28898 with 0 clients, refcount 0 [ CSSD]2013-05-23 17:59:44.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:44.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:44.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(040f002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:44.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:59:44.990 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:59:44.990 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:59:44.990 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:44.996 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0410002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:44.996 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:59:44.996 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:59:45.941 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:46.612 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:46.612 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:47.202 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:47.573 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:47.573 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:47.947 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:48.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:48.646 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:49.163 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0411002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:49.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0412002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:49.217 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 17:59:49.217 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 17:59:49.217 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 17:59:49.217 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:49.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0413002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:49.224 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 17:59:49.224 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 17:59:50.019 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:50.651 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:50.651 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:51.576 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:51.576 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 17:59:52.025 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:52.657 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:52.657 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:54.049 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:54.669 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:54.669 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:56.060 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:56.579 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 17:59:56.579 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 17:59:56.675 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:56.675 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:57.224 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 17:59:58.066 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 17:59:58.686 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 17:59:58.686 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 17:59:59.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0414002d) incarnation(174631051) [ CSSD]2013-05-23 17:59:59.267 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42d9690) allocated [ CSSD]2013-05-23 17:59:59.268 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 17:59:59.268 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42d9690 - 1,2,3 [ CSSD]2013-05-23 17:59:59.268 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42d9690) pid(29069) version 11:1:1:4 [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42d9690), client(1/0x7f82b42a1820) [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42a1820 with con 0x7f82b42cbe70, requested num -1 [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b427e110/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 17:59:59.286 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 17:59:59.293 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 17:59:59.293 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42a1820), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 17:59:59.293 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 17:59:59.294 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 17:59:59.496 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d9690 [ CSSD]2013-05-23 17:59:59.496 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d9690) con(0x7f82b4257120) skgpid ospid 29069 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:00.120 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:00.549 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:00:00.550 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:00:00.550 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:00:00.550 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4207c10) pid(29116/29116) version 11:1:1:4 [ CSSD]2013-05-23 18:00:00.565 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:00.565 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:00.565 [1199044928] >TRACE: clssgmRegisterShared: grp DBHWPROD, mbr 0, type 1 [ CSSD]2013-05-23 18:00:00.565 [1199044928] >TRACE: clssgmRegisterShared: global grock DBHWPROD member 0 share type 1, refcount 27 [ CSSD]2013-05-23 18:00:00.566 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(2/0x7f82b42cd480) [ CSSD]2013-05-23 18:00:00.566 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 18:00:00.566 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:00:00.566 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 18:00:00.693 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:00.693 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:00.697 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:00:00.698 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:00:00.698 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:00:00.698 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42583a0) pid(27691/27691) version 11:1:1:4 [ CSSD]2013-05-23 18:00:00.714 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42583a0), client(1/0x7f82b42a1820) [ CSSD]2013-05-23 18:00:00.714 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 18:00:00.714 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:00:00.714 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 18:00:01.583 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:01.583 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:02.125 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:02.698 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:02.698 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:04.151 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:04.465 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0415002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:04.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:00:04.465 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:00:04.465 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:00:04.466 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:04.472 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0416002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:04.472 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:00:04.472 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:00:04.749 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:04.749 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:04.930 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:00:04.930 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:00:04.931 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:00:04.931 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d8560) proc(0x7f82b42ba8a0) pid(29342/29342) version 11:1:1:4 [ CSSD]2013-05-23 18:00:04.936 [1199044928] >TRACE: clssgmRegisterClient: proc(67/0x7f82b42ba8a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:00:04.936 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:00:04.936 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:00:04.936 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 37 [ CSSD]2013-05-23 18:00:05.242 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:00:05.242 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:00:05.242 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42adc50), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:00:05.243 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 36 [ CSSD]2013-05-23 18:00:05.243 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:00:05.243 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d8560) skgpid 29342 ospid 29342 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:05.447 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:05.447 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41c8ba0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 18:00:05.447 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41c8ba0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 18:00:05.447 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 26 [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b42cd480) [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:00:05.455 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a8c30) skgpid 29116 ospid 29116 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:05.477 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 18:00:05.478 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:00:05.478 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 18:00:05.478 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4286740) pid(29344/29344) version 11:1:1:4 [ CSSD]2013-05-23 18:00:05.494 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4286740), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:00:05.494 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:00:05.494 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:00:05.494 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 18:00:06.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:06.586 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:06.587 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:06.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:06.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:07.265 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 18:00:07.971 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a8c30) skgpid 29344 ospid 29344 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:08.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:08.766 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:08.766 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:09.213 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0417002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:10.220 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:10.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:10.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:11.590 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:11.590 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:12.225 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:12.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:12.777 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:14.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:14.530 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:00:14.531 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:00:14.532 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:00:14.532 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4207c10) pid(29405) version 11:1:1:4 [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b427c510, requested num -1 [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:00:14.548 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:14.556 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:00:14.556 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:00:14.556 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4286740) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:14.556 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4286740) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:00:14.758 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:00:14.758 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b41fa050) skgpid ospid 29405 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:14.789 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:14.789 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:16.242 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:16.593 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:16.594 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:16.795 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:16.795 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:17.288 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:18.268 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:18.847 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:18.847 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:19.233 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0418002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:19.725 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0419002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:19.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:00:19.725 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:00:19.725 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:00:19.725 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:19.732 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041a002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:19.732 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:00:19.732 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:00:20.321 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:20.853 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:20.853 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:21.597 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:21.597 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:22.326 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:22.858 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:22.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:24.332 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:24.869 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:24.869 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:25.600 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:25.600 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:00:26.342 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:26.874 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:26.874 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:27.314 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:28.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:28.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:28.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:29.264 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041b002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:29.792 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 18:00:29.793 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:00:29.794 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 18:00:29.794 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4286740) pid(29561) version 11:1:1:4 [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4286740), client(1/0x7f82b42af490) [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42af490 with con 0x7f82b42d9690, requested num -1 [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:00:29.800 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:29.807 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:00:29.807 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42af490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:00:29.807 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42aed80) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:29.807 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42aed80) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:00:30.009 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 18:00:30.009 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a8c30) skgpid ospid 29561 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:30.371 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:30.604 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:30.604 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:30.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:30.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:32.396 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:32.899 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:32.899 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:34.402 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:34.970 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:34.970 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:34.974 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041c002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:34.974 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:00:34.974 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:00:34.974 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:00:34.974 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:34.981 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(041d002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:34.981 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:00:34.981 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:00:35.608 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:35.608 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:36.434 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:36.976 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:36.976 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:37.343 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:38.440 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:38.988 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:38.988 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:39.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(041e002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:40.452 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:40.611 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:40.612 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:40.993 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:40.993 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:41.379 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:00:41.380 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:00:41.380 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:00:41.380 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4207c10) pid(29696) version 11:1:1:4 [ CSSD]2013-05-23 18:00:41.386 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:00:41.386 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:00:41.386 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42aed80, requested num -1 [ CSSD]2013-05-23 18:00:41.386 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:41.386 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:00:41.387 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:00:41.387 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:41.394 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:00:41.394 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:00:41.394 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:41.394 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:00:41.596 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:00:41.596 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a8c30) skgpid ospid 29696 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:42.477 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:42.998 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:42.998 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:44.483 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:44.614 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:44.615 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:00:45.051 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 18:00:45.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:45.051 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:45.052 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:00:45.052 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 18:00:45.052 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b41fa050) proc(0x7f82b4286740) pid(29735) version 11:1:1:4 [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4286740), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:00:45.058 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:45.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:00:45.065 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:00:45.065 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:00:45.065 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:00:45.242 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(041f002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:45.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:00:45.242 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:00:45.242 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:00:45.242 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:45.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0420002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:45.248 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:00:45.248 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:00:45.268 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 18:00:45.268 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b41fa050) skgpid ospid 29735 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:00:46.534 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:47.077 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:47.077 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:47.381 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:48.540 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:49.087 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:49.087 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:49.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0421002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:49.618 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:49.618 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:50.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0422002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:50.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:00:50.241 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:00:50.241 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:00:50.241 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:00:50.248 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0423002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:50.248 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:00:50.248 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:00:50.571 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:51.093 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:51.093 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:52.577 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:53.099 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:53.099 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:54.583 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:54.621 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:54.621 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:00:55.152 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:55.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:56.634 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:57.158 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:57.158 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:57.414 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:00:58.678 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:00:59.169 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:00:59.169 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:00:59.364 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0424002d) incarnation(174631051) [ CSSD]2013-05-23 18:00:59.624 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:00:59.624 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:00.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0425002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:00.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:00.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:00.120 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:00.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:00.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0426002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:00.126 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:00.126 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:00.302 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:01:00.303 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:01:00.304 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:01:00.304 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4207c10) pid(29890) version 11:1:1:4 [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a2930, requested num -1 [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:01:00.310 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:00.317 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:01:00.317 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:01:00.317 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42cbe70) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:00.318 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42cbe70) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:01:00.520 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:01:00.520 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a8c30) skgpid ospid 29890 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:00.733 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:01.175 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:01.175 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:02.739 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:03.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:03.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:04.628 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:04.628 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:04.744 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:05.202 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:05.202 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:05.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0427002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:05.490 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:05.490 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:05.490 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:05.490 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:05.497 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0428002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:05.497 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:05.497 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:06.756 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:07.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:07.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:07.452 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:08.761 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:09.260 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:09.260 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:09.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0429002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:09.631 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:09.631 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:10.773 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:11.284 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:11.284 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:12.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:13.289 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:13.289 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:14.634 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:14.634 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:14.785 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:15.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:15.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:15.554 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4286740) allocated [ CSSD]2013-05-23 18:01:15.554 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:01:15.555 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4286740 - 1,2,3 [ CSSD]2013-05-23 18:01:15.555 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4286740) pid(30036) version 11:1:1:4 [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4286740), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41c8ba0 with con 0x7f82b42cbe70, requested num -1 [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42a1cd0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:01:15.561 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:15.568 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:01:15.568 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41c8ba0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:01:15.568 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9690) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:15.568 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9690) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:01:15.770 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4286740 [ CSSD]2013-05-23 18:01:15.770 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4286740) con(0x7f82b42a8c30) skgpid ospid 30036 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:15.900 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:01:15.901 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:01:15.902 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:01:15.902 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4207c10) pid(30080/30080) version 11:1:1:4 [ CSSD]2013-05-23 18:01:15.918 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b4207c10), client(1/0x7f82b42af490) [ CSSD]2013-05-23 18:01:15.918 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:01:15.918 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:01:15.918 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 18:01:15.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:01:15.937 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42af490), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:01:15.937 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42af490), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:01:15.937 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 18:01:15.938 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:01:15.938 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a8c30) skgpid 30080 ospid 30080 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:16.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:17.307 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:17.307 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:17.488 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:18.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:19.361 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:19.361 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:19.424 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042a002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:19.637 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:19.638 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:20.739 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042b002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:20.739 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:20.739 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:20.739 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:20.739 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:20.745 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042c002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:20.745 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:20.745 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:20.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:21.366 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:21.366 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:22.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:23.358 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(042d002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:23.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:23.358 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:23.358 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 18:01:23.358 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:23.365 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(042e002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:23.365 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:23.366 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:23.372 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:23.372 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:23.498 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:01:23.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:01:23.501 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:01:23.501 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:01:24.640 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:24.640 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:24.931 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:25.364 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b4257830) [ CSSD]2013-05-23 18:01:25.364 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b4257830), grp DBHWPROD, member 0 [ CSSD]2013-05-23 18:01:25.364 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b4257830), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 18:01:25.364 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 25 [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d5190 [ CSSD]2013-05-23 18:01:25.371 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d5190) con(0x7f82b42cbd00) skgpid 24759 ospid 24759 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:25.384 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:25.384 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:26.937 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:27.390 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:27.390 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:27.524 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:28.962 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:29.400 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:29.400 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:29.443 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(042f002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:29.643 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:29.643 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:30.805 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 18:01:30.806 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:01:30.806 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 18:01:30.806 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42a2930) pid(30198) version 11:1:1:4 [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:01:30.812 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:30.819 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:01:30.819 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:01:30.819 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:30.819 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:01:30.974 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:31.021 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 18:01:31.021 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42c7cc0) skgpid ospid 30198 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:31.426 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:31.426 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:32.980 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:33.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:33.458 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:34.646 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:34.646 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:35.032 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:35.484 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:35.484 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:35.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0430002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:35.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:35.997 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:35.997 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:35.997 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:36.004 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0431002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:36.004 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:36.004 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:37.058 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:37.490 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:37.490 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:37.547 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:39.064 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:39.483 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0432002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:39.501 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:39.502 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:39.649 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:39.649 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:41.075 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:41.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:41.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:41.636 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:01:41.636 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:01:41.637 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:01:41.637 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a8c30) proc(0x7f82b4207c10) pid(30309) version 11:1:1:4 [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42c7cc0, requested num -1 [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:01:41.643 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:41.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:01:41.650 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:01:41.650 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:41.650 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:01:41.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:01:41.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42a8c30) skgpid ospid 30309 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:43.080 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:43.579 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:43.579 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:44.652 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:44.652 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:45.132 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:45.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0433002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:45.507 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:45.507 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:45.507 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:45.507 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:45.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0434002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:45.514 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:45.514 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:45.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:45.624 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:46.056 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 18:01:46.057 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:01:46.058 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 18:01:46.058 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42a2930) pid(30346) version 11:1:1:4 [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(1/0x7f82b4257830) [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:01:46.065 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:46.072 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:01:46.072 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:01:46.072 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b4207c10) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:01:46.072 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b4207c10) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:01:46.274 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a2930 [ CSSD]2013-05-23 18:01:46.274 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a2930) con(0x7f82b42c7cc0) skgpid ospid 30346 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:01:47.158 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:47.572 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:47.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:47.631 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:49.164 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:49.515 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0435002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:49.655 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:49.655 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:49.662 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:49.662 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:51.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:51.262 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0436002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:51.262 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:01:51.262 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:01:51.263 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:01:51.263 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:01:51.269 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0437002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:51.269 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:01:51.269 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:01:51.667 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:51.667 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:53.261 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:53.760 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:53.760 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:54.659 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:54.659 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:55.343 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:55.785 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:55.785 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:57.349 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:57.606 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:01:57.791 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:57.791 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:01:59.356 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:01:59.544 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0438002d) incarnation(174631051) [ CSSD]2013-05-23 18:01:59.662 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:01:59.662 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:01:59.803 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:01:59.803 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:01.308 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207c10) allocated [ CSSD]2013-05-23 18:02:01.309 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:02:01.309 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207c10 - 1,2,3 [ CSSD]2013-05-23 18:02:01.309 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b4207c10) pid(30500) version 11:1:1:4 [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b4207c10), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42a8c30, requested num -1 [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:02:01.316 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:01.322 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:01.322 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:02:01.322 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a2930) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:01.322 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a2930) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:02:01.367 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:01.525 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207c10 [ CSSD]2013-05-23 18:02:01.525 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207c10) con(0x7f82b42c7cc0) skgpid ospid 30500 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:01.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:01.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:03.372 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:03.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:03.861 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:04.665 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:04.665 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:05.383 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:05.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:05.887 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:06.521 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0439002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:06.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:06.521 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:06.521 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:06.521 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:06.528 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043a002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:06.528 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:06.528 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:07.092 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a2930) allocated [ CSSD]2013-05-23 18:02:07.093 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:02:07.094 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a2930 - 1,2,3 [ CSSD]2013-05-23 18:02:07.094 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c7cc0) proc(0x7f82b42a2930) pid(30162/30162) version 11:1:1:4 [ CSSD]2013-05-23 18:02:07.100 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42a2930), client(1/0x7f82b41c8ba0) [ CSSD]2013-05-23 18:02:07.100 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41c8ba0) [ CSSD]2013-05-23 18:02:07.100 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:02:07.100 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 18:02:07.389 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:07.663 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:07.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:07.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:09.414 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:09.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043b002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:09.669 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:09.669 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:09.904 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:09.904 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:10.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043c002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:10.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:10.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:10.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:10.151 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:10.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(043d002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:10.157 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:10.157 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:11.446 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:11.795 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:11.796 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:02:11.796 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:11.796 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(30652) version 11:1:1:4 [ CSSD]2013-05-23 18:02:11.909 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:11.909 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:13.451 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:13.961 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:13.961 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:14.418 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:14.418 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid ospid 30652 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:14.672 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:14.672 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:15.464 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:15.968 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:15.968 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:16.560 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:16.561 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:02:16.562 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:16.562 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(30986) version 11:1:1:4 [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:02:16.578 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:16.585 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:02:16.585 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:02:16.585 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:16.585 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:02:16.787 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:16.787 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid ospid 30986 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:17.468 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:17.690 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:17.992 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:17.992 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:19.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:19.605 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(043e002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:19.675 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:19.675 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:20.005 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:20.005 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:21.484 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:21.769 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(043f002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:21.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:21.769 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:21.769 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:21.769 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:21.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0440002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:21.775 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:21.776 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:22.010 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:22.010 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:22.253 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:02:22.254 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:02:22.255 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:02:22.255 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:02:22.334 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0441002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:22.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:22.334 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:22.334 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 18:02:22.334 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 18:02:22.341 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0442002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:22.341 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:22.341 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:23.489 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:23.677 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:23.678 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:02:24.012 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:24.012 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:25.584 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:26.038 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:26.038 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:27.589 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:27.714 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:27.727 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:27.727 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:02:27.728 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:27.728 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ba8a0) pid(31118/31118) version 11:1:1:4 [ CSSD]2013-05-23 18:02:27.734 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:27.734 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:27.734 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:02:27.734 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 36 [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427d5c0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 35 [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:27.764 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42aee40) skgpid 31118 ospid 31118 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:28.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:28.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:28.680 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:28.680 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:29.614 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:29.624 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0443002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:30.075 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:30.075 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:31.666 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:31.822 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:31.823 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:02:31.824 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:31.824 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ba8a0) pid(31172) version 11:1:1:4 [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b4286800, requested num -1 [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:02:31.831 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:31.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:02:31.838 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:02:31.838 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:31.839 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:02:32.041 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:32.041 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42aee40) skgpid ospid 31172 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:32.080 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:32.080 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:33.671 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:33.683 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:33.683 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:34.092 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:34.092 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:35.703 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:36.115 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:36.115 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:37.023 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0444002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:37.023 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:37.023 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:37.023 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:37.023 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:37.032 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0445002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:37.032 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:37.032 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:37.709 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:37.735 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:38.121 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:38.121 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:38.686 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:38.687 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:39.646 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0446002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:39.715 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:40.195 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:40.195 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:41.748 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:41.895 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:41.896 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:02:41.897 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:41.897 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(31280) version 11:1:1:4 [ CSSD]2013-05-23 18:02:41.904 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 18:02:41.904 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:02:41.904 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 18:02:41.904 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:41.904 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:02:41.905 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:02:41.905 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:41.913 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:02:41.913 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:02:41.913 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:41.914 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:02:42.116 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:42.116 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid ospid 31280 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:42.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:42.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:43.690 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:43.690 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:43.755 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:44.212 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:44.212 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:45.765 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0447002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:45.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:45.765 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:45.765 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:45.765 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:45.766 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:45.773 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0448002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:45.773 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:45.773 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:46.218 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:46.218 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:47.074 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:02:47.075 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:02:47.076 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:02:47.076 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42ba8a0) pid(31359) version 11:1:1:4 [ CSSD]2013-05-23 18:02:47.082 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42ba8a0), client(1/0x7f82b42af490) [ CSSD]2013-05-23 18:02:47.082 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:02:47.082 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42af490 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:02:47.082 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:47.082 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:02:47.083 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:02:47.083 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:47.089 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42af490) [ CSSD]2013-05-23 18:02:47.090 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42af490), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:02:47.090 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b429e3f0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:02:47.090 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b429e3f0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:02:47.292 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:02:47.292 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42d9750) skgpid ospid 31359 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:47.693 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:47.693 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:02:47.757 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:47.772 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:48.224 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:48.224 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:49.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0449002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:49.778 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:50.276 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:50.276 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4204870), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 34 [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42d8e90 [ CSSD]2013-05-23 18:02:50.852 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42d8e90) con(0x7f82b42a90a0) skgpid 25644 ospid 25644 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:02:51.789 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:52.275 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044a002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:52.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:02:52.276 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:02:52.276 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:02:52.276 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:02:52.282 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:52.282 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:52.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044b002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:52.283 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:02:52.283 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:02:52.696 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:52.696 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:53.815 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:54.294 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:54.294 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:55.867 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:56.318 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:56.318 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:57.699 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:02:57.700 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:02:57.781 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:02:57.873 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:02:58.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:02:58.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:02:59.696 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044c002d) incarnation(174631051) [ CSSD]2013-05-23 18:02:59.880 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:00.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:00.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:01.889 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:02.326 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:03:02.326 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:03:02.327 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:03:02.327 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ba8a0) pid(31503) version 11:1:1:4 [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42b3350/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:02.334 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:02.341 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:03:02.341 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:03:02.341 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:02.342 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:02.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:02.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:02.544 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:03:02.544 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42aee40) skgpid ospid 31503 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:02.703 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:02.703 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:03.895 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:04.393 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:04.393 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42a1820) [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42a1820), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42a1820), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:03:05.692 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4257120) skgpid 27691 ospid 27691 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:05.966 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:06.418 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:06.418 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:06.706 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:06.706 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:03:07.526 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(044d002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:07.526 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:03:07.526 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:03:07.526 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:03:07.526 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:07.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(044e002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:07.534 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:03:07.534 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:03:07.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:07.971 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:08.471 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:08.471 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:09.726 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(044f002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:09.983 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:10.477 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:10.477 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:11.709 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:11.709 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:11.989 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:12.482 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:12.482 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:13.995 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:14.575 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:14.575 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:16.018 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:16.600 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:16.600 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:16.713 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:16.713 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:17.578 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 18:03:17.579 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:03:17.579 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 18:03:17.579 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a3ea0) pid(31666) version 11:1:1:4 [ CSSD]2013-05-23 18:03:17.586 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a3ea0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:17.586 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:17.586 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:03:17.586 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:17.586 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:03:17.587 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:17.587 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:17.593 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:17.593 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:03:17.593 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:17.594 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:17.796 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 18:03:17.796 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42aee40) skgpid ospid 31666 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:17.831 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:18.024 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:18.611 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:18.611 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:19.756 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0450002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:20.055 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:20.617 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:20.617 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:21.716 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:21.717 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:22.062 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:22.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:22.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:22.776 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0451002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:22.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:03:22.776 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:03:22.776 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:03:22.776 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:22.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0452002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:22.783 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:03:22.783 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:03:24.088 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:24.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:24.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:25.719 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:25.719 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:03:26.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:26.700 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:26.700 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:27.857 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:28.124 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:28.713 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:28.713 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:29.073 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:03:29.073 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:29.074 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:03:29.074 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42c5f40) pid(31786/31786) version 11:1:1:4 [ CSSD]2013-05-23 18:03:29.090 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:29.090 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:29.090 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:03:29.090 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b427c5e0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:03:29.131 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b4257120) skgpid 31786 ospid 31786 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:29.321 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 18:03:29.321 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:29.322 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 18:03:29.322 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a3ea0) pid(31795/31795) version 11:1:1:4 [ CSSD]2013-05-23 18:03:29.339 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a3ea0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:03:29.339 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:03:29.339 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:03:29.339 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 18:03:29.387 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42aee40) skgpid 31795 ospid 31795 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:29.777 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0453002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:30.156 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:30.718 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:30.718 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:30.722 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:30.723 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:32.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:32.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:32.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:32.830 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:03:32.831 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:03:32.831 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:03:32.831 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42833d0) pid(31818) version 11:1:1:4 [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:32.838 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:32.844 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:03:32.844 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:03:32.844 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:32.844 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:33.047 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:03:33.047 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42aee40) skgpid ospid 31818 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:34.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:34.775 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:34.775 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:35.726 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:35.726 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:36.179 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:36.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:36.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:37.881 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:38.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0454002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:38.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:03:38.036 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:03:38.036 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:03:38.036 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:38.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0455002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:38.043 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:03:38.043 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:03:38.185 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:38.812 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:38.812 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:39.729 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:39.729 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:03:39.797 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0456002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:40.256 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:40.818 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:40.818 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:41.409 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:03:41.410 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:41.411 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:03:41.411 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42583a0) pid(31943) version 11:1:1:4 [ CSSD]2013-05-23 18:03:42.106 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:03:42.106 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b4257120) skgpid ospid 31943 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:42.146 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:03:42.147 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:42.148 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:03:42.148 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42833d0) pid(32044) version 11:1:1:4 [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:42.154 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:42.160 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:03:42.161 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:03:42.161 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42c5f40) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:42.161 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42c5f40) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:42.282 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:42.363 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:03:42.363 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42aee40) skgpid ospid 32044 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:42.823 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:42.823 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:44.289 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:44.645 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:03:44.646 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:44.647 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:03:44.647 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(32128) version 11:1:1:4 [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b427c5e0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:44.654 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:44.660 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:03:44.660 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 18:03:44.660 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 18:03:44.660 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:44.732 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:44.732 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:44.767 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:03:44.768 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:03:44.768 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:03:44.768 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4258490) proc(0x7f82b42ba8a0) pid(32133) version 11:1:1:4 [ CSSD]2013-05-23 18:03:44.784 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:03:44.786 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:03:44.787 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:03:44.789 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:03:44.789 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4258490) skgpid ospid 32133 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:44.863 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:03:44.863 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid ospid 32128 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:44.876 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:44.876 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:46.026 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0457002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:46.026 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:03:46.026 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:03:46.026 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:03:46.026 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:46.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0458002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:46.033 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:03:46.033 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:03:46.298 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:46.882 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:46.882 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:47.906 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:48.086 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:03:48.087 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:03:48.088 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:03:48.088 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42833d0) pid(32163) version 11:1:1:4 [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:03:48.095 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:48.102 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:03:48.102 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:03:48.102 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:03:48.102 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:03:48.305 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:48.305 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:03:48.305 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42aee40) skgpid ospid 32163 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:03:48.894 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:48.894 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:49.735 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:49.735 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:49.817 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0459002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:50.357 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:50.919 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:50.920 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:52.363 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:52.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:52.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:53.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045a002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:53.285 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:03:53.285 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:03:53.285 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:03:53.285 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:03:53.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045b002d) incarnation(174631051) [ CSSD]2013-05-23 18:03:53.292 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:03:53.292 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:03:54.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:54.738 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:54.739 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:54.926 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:54.926 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:56.380 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:56.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:56.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:57.931 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:03:58.386 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:03:58.984 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:03:58.984 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:03:59.742 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:03:59.742 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:03:59.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045c002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:00.397 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:00.990 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:00.990 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:02.443 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:02.997 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:02.997 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:03.346 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:04:03.347 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:04:03.348 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:04:03.348 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(32331) version 11:1:1:4 [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:03.354 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:03.361 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:04:03.361 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:04:03.361 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:03.361 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:03.564 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:04:03.564 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid ospid 32331 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:03.745 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:03.745 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:04:04.450 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:05.007 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:05.007 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:06.460 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:07.052 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:07.052 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:07.954 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:08.467 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:08.534 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(045d002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:08.534 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:04:08.534 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:04:08.535 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:04:08.535 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:08.541 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(045e002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:08.541 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:04:08.541 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:04:08.748 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:08.749 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:09.084 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:09.084 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:09.887 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(045f002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:10.478 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:11.090 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:11.090 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:12.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:13.096 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:13.096 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:13.752 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:13.752 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:14.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:15.108 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:15.108 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:16.601 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:17.114 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:17.114 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:18.014 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:18.597 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:04:18.598 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:04:18.598 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:04:18.598 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42833d0) pid(32483) version 11:1:1:4 [ CSSD]2013-05-23 18:04:18.605 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:18.605 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:18.605 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:04:18.606 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:18.606 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:04:18.606 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:18.606 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:18.612 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:18.612 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:04:18.612 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:18.612 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:18.626 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:18.755 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:18.755 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:18.815 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:04:18.815 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b4257120) skgpid ospid 32483 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:19.126 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:19.126 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:19.915 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0460002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:20.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:21.151 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:21.152 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:22.685 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:23.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:23.157 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:23.758 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:23.758 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:23.794 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0461002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:23.794 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:04:23.794 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:04:23.794 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:04:23.794 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:23.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0462002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:23.800 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:04:23.801 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:04:24.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:25.188 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:25.188 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:26.702 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:27.194 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:27.194 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:28.035 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:28.708 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:28.761 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:28.761 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:29.206 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:29.206 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:29.950 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0463002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:30.779 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:31.211 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:31.211 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:31.964 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:04:31.965 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:04:31.965 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:04:31.965 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(32634) version 11:1:1:4 [ CSSD]2013-05-23 18:04:32.095 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:04:32.096 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:04:32.096 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:04:32.096 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b42ba8a0) pid(32645) version 11:1:1:4 [ CSSD]2013-05-23 18:04:32.115 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:04:32.116 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:04:32.119 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:04:32.119 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4257120) skgpid ospid 32645 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5365/0x7f82b42cbf40) [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5365 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42cbf40 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42baac0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:32.193 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 18:04:32.200 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5365 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:04:32.200 [1199044928] >TRACE: clssgmExitGrock: client 5365 (0x7f82b42cbf40), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 18:04:32.200 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 18:04:32.200 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:32.201 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:04:32.201 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid ospid 32634 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:32.786 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:33.217 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:33.217 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:33.765 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:33.765 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:33.855 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 18:04:33.856 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:04:33.856 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 18:04:33.856 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(32667) version 11:1:1:4 [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a3ea0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:33.863 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:33.871 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:04:33.871 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:04:33.871 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:33.871 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:34.073 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 18:04:34.073 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid ospid 32667 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:34.792 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:35.228 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:35.228 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:36.801 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:37.234 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:37.234 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:37.767 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:37.768 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:04:38.058 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:38.807 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:39.044 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0464002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:39.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:04:39.044 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:04:39.044 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:04:39.044 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:39.051 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0465002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:39.051 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:04:39.051 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:04:39.286 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:39.286 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:39.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0466002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:40.870 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:41.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:41.292 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:42.406 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:04:42.408 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:04:42.408 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:04:42.408 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42c5f40) pid(32761) version 11:1:1:4 [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:42.415 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:42.422 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:04:42.422 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:04:42.422 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:42.422 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:42.625 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:04:42.625 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42aee40) skgpid ospid 32761 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:42.771 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:42.771 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:42.876 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:43.317 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:43.317 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:44.883 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:45.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:45.330 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:46.285 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0467002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:46.285 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:04:46.285 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:04:46.285 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:04:46.285 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:46.292 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0468002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:46.292 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:04:46.292 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:04:46.892 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:47.336 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:47.336 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:47.774 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:47.774 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:48.080 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:48.898 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:49.108 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a3ea0) allocated [ CSSD]2013-05-23 18:04:49.109 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:04:49.109 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a3ea0 - 1,2,3 [ CSSD]2013-05-23 18:04:49.109 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a3ea0) pid(354) version 11:1:1:4 [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42a3ea0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:04:49.116 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:49.124 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:04:49.124 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:04:49.124 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:04:49.124 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:04:49.327 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a3ea0 [ CSSD]2013-05-23 18:04:49.327 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a3ea0) con(0x7f82b42d9750) skgpid ospid 354 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:04:49.387 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:49.387 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:49.999 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0469002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:50.910 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:51.413 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:51.413 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:52.777 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:52.778 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:52.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:53.419 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:53.419 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:54.295 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046a002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:54.295 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:04:54.295 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:04:54.295 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:04:54.295 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:04:54.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046b002d) incarnation(174631051) [ CSSD]2013-05-23 18:04:54.303 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:04:54.303 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:04:54.968 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:55.430 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:55.430 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:56.993 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:57.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:57.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:04:57.781 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:04:57.781 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:04:58.104 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:04:58.999 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:04:59.488 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:04:59.488 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:00.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046c002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:01.011 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:01.512 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:01.512 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:02.784 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:02.784 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:03.017 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:03.523 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:03.523 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:04.374 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c5f40) allocated [ CSSD]2013-05-23 18:05:04.375 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:05:04.375 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c5f40 - 1,2,3 [ CSSD]2013-05-23 18:05:04.375 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42c5f40) pid(529) version 11:1:1:4 [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c5f40), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:05:04.382 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:04.390 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:05:04.390 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:05:04.390 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:04.390 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:05:04.554 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:05:04.555 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:05:04.556 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:05:04.556 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42ba8a0) pid(571/571) version 11:1:1:4 [ CSSD]2013-05-23 18:05:04.561 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:05:04.561 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:05:04.561 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:05:04.561 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 18:05:04.592 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c5f40 [ CSSD]2013-05-23 18:05:04.592 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c5f40) con(0x7f82b42d9750) skgpid ospid 529 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:04.864 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:05:04.864 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:05:04.864 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b42cd480), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:05:04.864 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 18:05:04.865 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:05:04.865 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42aee40) skgpid 571 ospid 571 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:05.068 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:05.529 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:05.529 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:07.074 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:07.535 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:07.535 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:07.787 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:07.788 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:08.126 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:09.101 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:09.546 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(046d002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:09.546 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:05:09.546 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:05:09.546 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:05:09.546 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:09.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(046e002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:09.553 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:05:09.553 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:05:09.557 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:09.557 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:10.047 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(046f002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:11.112 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:11.603 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:11.603 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:12.791 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:12.791 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:13.118 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:13.616 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:13.616 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:15.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:15.622 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:15.622 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:16.794 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:16.794 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:05:17.174 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:17.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:17.628 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:18.156 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:19.181 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:19.626 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:05:19.627 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:05:19.628 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:05:19.628 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42583a0) pid(678) version 11:1:1:4 [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b4257830) [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4257830 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:05:19.644 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:19.650 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4257830) [ CSSD]2013-05-23 18:05:19.650 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4257830), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:05:19.650 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:19.650 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:05:19.719 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:19.719 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:19.852 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:05:19.853 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42aee40) skgpid ospid 678 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:20.072 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0470002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:21.213 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:21.724 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:21.724 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:21.797 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:21.797 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:23.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:23.735 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:23.735 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:24.796 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0471002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:24.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:05:24.796 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:05:24.796 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:05:24.796 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:24.804 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0472002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:24.804 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:05:24.804 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:05:25.269 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:25.741 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:25.741 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:26.801 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:26.801 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:27.274 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:27.746 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:27.746 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:28.181 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:29.280 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:29.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:29.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:30.102 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0473002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:31.291 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:31.804 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:31.804 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:31.825 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:31.825 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:33.297 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:33.836 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:33.836 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:34.896 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:05:34.897 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:05:34.898 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:05:34.898 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(820) version 11:1:1:4 [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:05:34.914 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:34.921 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:05:34.921 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:05:34.921 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:34.921 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:05:35.124 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:05:35.124 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid ospid 820 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:35.370 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:35.842 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:35.842 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:36.807 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:36.807 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:37.416 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:37.867 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:37.867 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:38.208 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:39.422 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:39.900 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:39.900 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:40.046 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0474002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:40.046 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:05:40.046 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:05:40.046 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:05:40.046 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:40.053 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0475002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:40.053 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:05:40.053 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:05:40.133 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0476002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:41.473 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:41.810 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:41.810 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:41.925 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:41.925 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:42.668 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:05:42.669 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:05:42.670 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:05:42.670 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42583a0) pid(916) version 11:1:1:4 [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:05:42.676 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:42.683 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:05:42.683 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:05:42.683 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:42.684 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:05:42.886 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:05:42.886 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42aee40) skgpid ospid 916 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:43.479 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:43.936 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:43.936 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:45.490 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:45.941 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:45.941 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:46.545 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0477002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:46.545 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:05:46.545 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:05:46.545 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:05:46.545 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:46.553 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0478002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:46.553 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:05:46.553 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:05:46.814 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:46.814 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:47.496 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:47.966 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:47.966 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:48.229 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:49.523 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:50.000 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:50.000 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:50.162 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:05:50.163 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:05:50.163 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:05:50.163 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42833d0) pid(982) version 11:1:1:4 [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:05:50.170 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:50.173 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0479002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:50.177 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:05:50.177 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:05:50.177 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:05:50.177 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:05:50.380 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:05:50.380 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42d9750) skgpid ospid 982 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:05:51.574 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:51.817 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:51.817 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:05:52.025 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:52.025 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:53.600 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:54.036 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:54.036 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:55.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047a002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:55.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:05:55.296 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:05:55.296 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:05:55.296 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:05:55.303 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047b002d) incarnation(174631051) [ CSSD]2013-05-23 18:05:55.303 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:05:55.303 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:05:55.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:55.819 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:05:55.820 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:05:56.042 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:56.042 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:57.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:05:58.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:05:58.048 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:05:58.326 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:05:59.624 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:00.100 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:00.101 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:00.198 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047c002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:00.823 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:00.823 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:01.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:02.106 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:02.106 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:03.641 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:04.118 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:04.119 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:05.413 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:06:05.414 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:06:05.414 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:06:05.414 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42583a0) pid(1124) version 11:1:1:4 [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b4204870) [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:06:05.432 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:05.440 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:06:05.440 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:06:05.440 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b3cd0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:05.440 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b3cd0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:06:05.642 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:06:05.642 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42aee40) skgpid ospid 1124 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:05.692 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:05.826 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:05.826 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:06.143 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:06.143 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:07.717 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:08.148 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:08.148 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:08.349 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:09.724 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:10.201 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:10.201 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:10.230 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(047d002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:10.547 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(047e002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:10.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:10.547 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:10.547 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:06:10.548 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:10.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(047f002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:10.556 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:10.556 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:10.830 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:10.830 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:11.735 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:12.207 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:12.207 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:13.742 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:14.219 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:14.219 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:14.833 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:14.833 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:06:15.355 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42833d0) allocated [ CSSD]2013-05-23 18:06:15.355 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:06:15.356 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42833d0 - 1,2,3 [ CSSD]2013-05-23 18:06:15.356 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42833d0) pid(1236/1236) version 11:1:1:4 [ CSSD]2013-05-23 18:06:15.372 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42833d0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:06:15.372 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:06:15.372 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:06:15.372 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 18:06:15.392 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:06:15.392 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:06:15.392 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41bf650), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:06:15.392 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 33 [ CSSD]2013-05-23 18:06:15.393 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42833d0 [ CSSD]2013-05-23 18:06:15.393 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42833d0) con(0x7f82b42aee40) skgpid 1236 ospid 1236 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:15.793 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:16.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:16.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:17.799 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:18.249 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:18.249 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:18.372 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:19.806 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:19.835 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:19.836 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:20.263 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0480002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:20.302 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:20.302 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:20.676 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42583a0) allocated [ CSSD]2013-05-23 18:06:20.677 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:06:20.678 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42583a0 - 1,2,3 [ CSSD]2013-05-23 18:06:20.678 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42583a0) pid(1287) version 11:1:1:4 [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42583a0), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b4257120, requested num -1 [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:06:20.684 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:20.691 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:06:20.691 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:06:20.691 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42ae300) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:20.691 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42ae300) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:06:20.893 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42583a0 [ CSSD]2013-05-23 18:06:20.893 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42583a0) con(0x7f82b42d9750) skgpid ospid 1287 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:21.836 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:22.308 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:22.308 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:23.658 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0481002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:23.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:23.658 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:23.658 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2) [ CSSD]2013-05-23 18:06:23.658 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:23.666 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0482002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:23.666 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:23.666 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac02.+asm2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:23.796 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:06:23.796 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:06:23.798 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:06:23.798 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:06:23.862 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:24.319 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:24.319 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:24.839 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:24.839 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:25.470 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 2 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:06:25.470 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0 [ CSSD]2013-05-23 18:06:25.470 [1199044928] >TRACE: clssgmUnregisterShared: client 2 (0x7f82b41ff1f0), grp DBHWPROD, member 0, share type 1 [ CSSD]2013-05-23 18:06:25.470 [1199044928] >TRACE: clssgmUnreferenceMember: global grock DBHWPROD member 0 refcount is 24 [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b4207960) [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b4207960), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:06:25.476 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid 28367 ospid 28367 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:25.798 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0483002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:25.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:25.798 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:25.798 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:06:25.798 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:25.805 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0484002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:25.805 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:25.805 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:25.893 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:26.324 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:26.324 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:27.900 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:28.348 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:28.348 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:28.407 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:29.842 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:29.842 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:29.906 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:30.296 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0485002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:30.351 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:30.351 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:31.916 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:32.376 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:32.376 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:33.923 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:34.450 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:34.450 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:34.845 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:34.845 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:35.929 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:06:35.930 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:06:35.930 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:06:35.930 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(1442) version 11:1:1:4 [ CSSD]2013-05-23 18:06:35.934 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427c5e0 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:06:35.937 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:35.944 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:06:35.944 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427c5e0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:06:35.944 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:35.945 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:06:36.147 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:06:36.147 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 1442 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:36.455 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:36.455 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:37.979 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:38.432 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:38.507 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:38.507 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:38.848 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:38.848 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:06:39.991 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:40.322 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0486002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:40.514 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:40.514 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:41.048 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0487002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:41.048 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:41.048 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:41.048 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:06:41.048 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:41.056 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0488002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:41.056 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:41.056 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:41.997 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:42.520 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:42.520 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:42.931 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:06:42.932 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:06:42.933 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:06:42.933 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b4207a80) pid(1528) version 11:1:1:4 [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:06:42.939 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:42.947 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:06:42.947 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:06:42.947 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:42.947 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:06:43.149 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:06:43.150 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42aee40) skgpid ospid 1528 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:43.851 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:43.851 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:44.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:44.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:44.531 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:46.013 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:46.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:46.556 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:46.800 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0489002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:46.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:46.800 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:46.800 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:06:46.800 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:46.810 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048a002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:46.810 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:46.810 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:48.020 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:48.454 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:48.608 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:48.608 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:48.855 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:48.855 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:50.091 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:50.347 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048b002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:50.614 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:50.614 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:51.184 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:06:51.185 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:06:51.186 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:06:51.186 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b4207a80) pid(1613) version 11:1:1:4 [ CSSD]2013-05-23 18:06:51.191 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:06:51.191 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:06:51.191 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:06:51.192 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:51.192 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:06:51.192 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:06:51.192 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:51.198 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:06:51.198 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:06:51.198 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:06:51.198 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:06:51.401 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:06:51.401 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b427d8a0) skgpid ospid 1613 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:06:52.098 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:52.620 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:52.620 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:53.858 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:53.859 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:06:54.105 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:54.630 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:54.630 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:56.115 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:56.353 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(048c002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:56.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:06:56.353 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:06:56.353 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:06:56.353 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:06:56.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(048d002d) incarnation(174631051) [ CSSD]2013-05-23 18:06:56.360 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:06:56.360 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:06:56.655 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:56.655 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:06:57.861 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:06:57.862 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:06:58.140 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:06:58.477 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:06:58.708 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:06:58.708 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:00.192 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:00.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048e002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:00.715 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:00.715 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:02.198 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:02.721 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:02.721 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:02.865 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:02.865 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:04.205 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:04.772 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:04.772 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:06.215 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:06.438 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:07:06.439 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:07:06.439 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:07:06.439 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(1781) version 11:1:1:4 [ CSSD]2013-05-23 18:07:06.456 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42ccac0) [ CSSD]2013-05-23 18:07:06.456 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:07:06.456 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42ccac0 with con 0x7f82b42ccc30, requested num -1 [ CSSD]2013-05-23 18:07:06.456 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:06.456 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:06.457 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:06.457 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:06.464 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:07:06.464 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42ccac0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:06.464 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:06.464 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:06.667 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:07:06.667 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 1781 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:06.799 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:06.799 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:07.868 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:07.868 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:08.221 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:08.499 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:08.809 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:08.809 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:10.232 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:10.407 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(048f002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:10.815 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:10.815 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:11.451 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:07:11.452 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:07:11.452 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:07:11.452 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a5440) pid(1893) version 11:1:1:4 [ CSSD]2013-05-23 18:07:11.604 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0490002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:11.604 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:11.604 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:11.604 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:07:11.604 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:11.610 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0491002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:11.610 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:11.611 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:12.237 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:12.821 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:12.821 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:12.871 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:12.872 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:14.129 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:07:14.129 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9750) skgpid ospid 1893 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:14.243 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:14.832 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:14.832 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:15.652 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:07:15.653 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:07:15.653 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:07:15.653 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4257120) proc(0x7f82b4207a80) pid(2221) version 11:1:1:4 [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:15.671 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:15.678 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:07:15.678 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:15.678 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:15.678 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:15.880 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:07:15.880 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b4257120) skgpid ospid 2221 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:16.296 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:16.857 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:16.858 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:17.875 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:17.875 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:18.302 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:18.521 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:18.910 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:18.910 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:20.312 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:20.431 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0492002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:20.916 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:20.916 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:21.697 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:07:21.698 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:07:21.699 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:07:21.699 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b4207a80) pid(2289) version 11:1:1:4 [ CSSD]2013-05-23 18:07:21.715 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 18:07:21.715 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:07:21.715 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:07:21.715 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:21.715 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:21.716 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:21.716 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:21.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:07:21.723 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:21.723 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:21.723 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:21.925 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:07:21.925 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42c6340) skgpid ospid 2289 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:22.339 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:22.570 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:07:22.571 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:07:22.573 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:07:22.573 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:07:22.645 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0493002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:22.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:22.645 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(ORA_CLSRCSN_SRV_HWPROD2) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:22.645 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(2) grock (0x7f82ac007840/ORA_CLSRCSN_SRV_HWPROD2) [ CSSD]2013-05-23 18:07:22.645 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD2 member(0/Remote) node(2) flags 0x2 0x2 [ CSSD]2013-05-23 18:07:22.652 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0494002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:22.652 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:22.652 [1123510592] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD2, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:22.878 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:22.879 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:22.922 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:22.922 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:24.346 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:24.933 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:24.933 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:26.345 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:26.854 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0495002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:26.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:26.854 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:26.854 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:07:26.854 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:26.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(0496002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:26.861 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:26.861 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:26.958 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:26.958 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:27.881 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:27.881 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:28.351 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:28.551 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:29.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:29.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:30.404 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:30.470 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0497002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:31.016 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:31.016 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:32.410 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:32.884 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:32.885 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:33.022 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:33.022 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:34.436 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:35.033 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:35.033 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:36.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:36.959 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:07:36.960 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:07:36.960 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:07:36.960 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b4207a80) pid(2437) version 11:1:1:4 [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b4207a80), client(1/0x7f82b4204870) [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:36.966 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:36.974 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:07:36.974 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:36.974 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:36.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:37.058 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:37.059 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:37.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:07:37.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42ccc30) skgpid ospid 2437 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:37.887 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:37.888 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:38.511 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:38.581 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:39.111 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:39.111 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:40.505 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(0498002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:40.604 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:41.134 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:41.134 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:42.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(0499002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:42.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:42.121 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:42.121 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:07:42.121 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:42.128 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049a002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:42.128 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:42.129 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:42.611 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:42.890 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:42.890 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:43.140 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:43.140 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:43.190 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:07:43.191 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:07:43.191 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:07:43.191 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b42a5440) pid(2519) version 11:1:1:4 [ CSSD]2013-05-23 18:07:43.197 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:07:43.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:07:43.197 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 18:07:43.197 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:43.197 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:43.198 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:43.198 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:43.204 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:07:43.204 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:43.204 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:43.204 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:43.407 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:07:43.407 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42d9750) skgpid ospid 2519 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:44.617 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:45.154 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:45.154 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:45.172 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:07:45.173 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:07:45.173 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:07:45.173 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(2540) version 11:1:1:4 [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41ff1f0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:45.190 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:45.197 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:07:45.197 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41ff1f0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:45.197 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:45.197 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:45.400 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:07:45.400 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42aee40) skgpid ospid 2540 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:46.628 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:47.062 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049b002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:47.062 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:47.062 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:47.062 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:07:47.062 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:47.068 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049c002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:47.068 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:47.068 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:47.160 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:47.160 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:47.893 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:47.893 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:48.602 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:48.635 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:49.181 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:49.181 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:50.531 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(049d002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:50.645 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:51.187 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:51.187 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:52.214 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:07:52.215 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:07:52.215 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:07:52.215 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(2602) version 11:1:1:4 [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:07:52.222 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:52.228 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:07:52.228 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:07:52.228 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:07:52.228 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:07:52.431 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:07:52.431 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 2602 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:07:52.652 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:52.896 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:52.896 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:53.193 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:53.193 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:54.658 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:55.235 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:55.235 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:56.707 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:57.241 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:57.241 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:07:57.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(049e002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:57.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:07:57.371 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:07:57.371 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:07:57.371 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:07:57.378 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(049f002d) incarnation(174631051) [ CSSD]2013-05-23 18:07:57.378 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:07:57.378 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:07:57.899 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:07:57.899 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:07:58.624 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:07:58.732 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:07:59.252 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:07:59.252 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:00.556 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a0002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:00.846 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:01.258 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:01.258 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:02.872 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:02.902 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:02.902 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:03.283 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:03.283 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:04.879 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:05.354 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:05.354 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:06.909 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:07.360 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:07.360 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:07.464 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:08:07.466 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:08:07.466 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:08:07.466 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(2770) version 11:1:1:4 [ CSSD]2013-05-23 18:08:07.472 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b42cbf40) [ CSSD]2013-05-23 18:08:07.472 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:08:07.472 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cbf40 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:08:07.472 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:07.472 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:08:07.473 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:07.473 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:07.479 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cbf40) [ CSSD]2013-05-23 18:08:07.480 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cbf40), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:08:07.480 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:07.480 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:07.682 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:08:07.682 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 2770 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:07.906 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:07.906 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:08.646 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:08.915 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:09.371 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:09.371 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:10.582 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a1002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:10.927 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:11.377 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:11.377 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:12.621 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a2002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:12.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:08:12.621 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:08:12.621 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:08:12.621 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:12.628 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a3002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:12.628 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:08:12.629 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:08:12.909 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:12.910 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:12.952 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:13.383 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:13.383 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:15.004 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:15.436 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:15.436 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:16.912 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:16.913 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:08:17.009 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:17.441 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:17.441 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:18.679 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:19.016 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:19.453 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:19.453 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:20.636 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a4002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:21.026 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:21.458 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:21.459 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:21.916 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:21.916 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:22.716 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:08:22.717 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:08:22.717 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:08:22.717 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(2921) version 11:1:1:4 [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b4204870) [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4204870 with con 0x7f82b42aee40, requested num -1 [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:22.723 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:22.730 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4204870) [ CSSD]2013-05-23 18:08:22.730 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4204870), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:08:22.730 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:22.730 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:22.933 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:08:22.933 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid ospid 2921 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:23.052 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:23.463 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:23.463 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:25.104 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:25.493 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:25.493 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:26.919 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:26.920 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:27.110 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:27.498 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:27.498 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:27.871 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a5002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:27.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:08:27.871 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:08:27.871 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:08:27.871 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:27.877 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04a6002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:27.877 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:08:27.878 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:08:28.701 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:29.116 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:29.533 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:29.533 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:30.723 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a7002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:31.127 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:31.538 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:31.538 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:31.922 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:31.923 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:33.133 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:33.549 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:33.550 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:35.155 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:35.555 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:35.555 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:35.925 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:35.925 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:08:37.162 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:37.578 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:37.578 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:37.971 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:08:37.972 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:08:37.972 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:08:37.972 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42a5440) pid(3093) version 11:1:1:4 [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b427d5c0) [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b427d5c0 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:37.978 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:37.985 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b427d5c0) [ CSSD]2013-05-23 18:08:37.985 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b427d5c0), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:08:37.985 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a41c0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:37.985 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a41c0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:38.187 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:08:38.187 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b427d8a0) skgpid ospid 3093 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:38.726 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:39.168 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:39.634 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:39.634 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:40.520 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:08:40.520 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:40.521 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:08:40.521 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42a5440) pid(3159/3159) version 11:1:1:4 [ CSSD]2013-05-23 18:08:40.537 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 18:08:40.537 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:08:40.537 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:08:40.537 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHDRG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmUnregisterShared: Same group share client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0 [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmUnregisterShared: client 1 (0x7f82b41ff1f0), grp DG_LOCAL_DATA, member 0, share type 1 [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmUnreferenceMember: local grock DG_LOCAL_DATA member 0 refcount is 32 [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42a5440 [ CSSD]2013-05-23 18:08:40.552 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42a5440) con(0x7f82b42ccc30) skgpid 3159 ospid 3159 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:40.757 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04a8002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:40.886 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b4207a80) allocated [ CSSD]2013-05-23 18:08:40.887 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:40.887 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b4207a80 - 1,2,3 [ CSSD]2013-05-23 18:08:40.887 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42d9750) proc(0x7f82b4207a80) pid(3175) version 11:1:1:4 [ CSSD]2013-05-23 18:08:40.929 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:40.929 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:41.218 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:41.434 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b4207a80 [ CSSD]2013-05-23 18:08:41.434 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b4207a80) con(0x7f82b42d9750) skgpid ospid 3175 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:41.638 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:41.638 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:43.120 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04a9002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:43.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:08:43.120 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:08:43.120 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:08:43.120 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:43.127 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04aa002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:43.127 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:08:43.127 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:08:43.264 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:43.282 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42a5440) allocated [ CSSD]2013-05-23 18:08:43.283 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:43.284 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42a5440 - 1,2,3 [ CSSD]2013-05-23 18:08:43.284 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42aee40) proc(0x7f82b42a5440) pid(3203/3203) version 11:1:1:4 [ CSSD]2013-05-23 18:08:43.290 [1199044928] >TRACE: clssgmRegisterClient: proc(63/0x7f82b42a5440), client(1/0x7f82b427c5e0) [ CSSD]2013-05-23 18:08:43.290 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b427c5e0) [ CSSD]2013-05-23 18:08:43.290 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:08:43.290 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 33 [ CSSD]2013-05-23 18:08:43.453 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42c7b30) allocated [ CSSD]2013-05-23 18:08:43.454 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:43.455 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42c7b30 - 1,2,3 [ CSSD]2013-05-23 18:08:43.455 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42c7b30) pid(3351) version 11:1:1:4 [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42c7b30), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:43.461 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:43.468 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:08:43.468 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:08:43.468 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a3ea0) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:43.468 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a3ea0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:43.650 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:43.650 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:43.671 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42c7b30 [ CSSD]2013-05-23 18:08:43.671 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42c7b30) con(0x7f82b42ccc30) skgpid ospid 3351 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:44.947 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 18:08:44.948 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:44.949 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 18:08:44.949 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42af3a0) pid(3366) version 11:1:1:4 [ CSSD]2013-05-23 18:08:44.966 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42af3a0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 new client 0x7f82b41bf650 with con 0x7f82b42d9750, requested num -1 [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:44.967 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:44.973 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:08:44.973 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member 0 [ CSSD]2013-05-23 18:08:44.973 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42583a0) in global grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1 [ CSSD]2013-05-23 18:08:44.974 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.ASM.DATABASE.ASM.prod-rac01.+asm1, member number 0 (0x7f82b42583a0) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:45.082 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:08:45.083 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:45.084 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:08:45.084 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8a0) pid(3371) version 11:1:1:4 [ CSSD]2013-05-23 18:08:45.100 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:08:45.102 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:08:45.104 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:08:45.105 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:08:45.105 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b427d8a0) skgpid ospid 3371 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:45.176 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42af3a0 [ CSSD]2013-05-23 18:08:45.176 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42af3a0) con(0x7f82b42c6340) skgpid ospid 3366 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:45.265 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:45.656 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:45.656 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:45.932 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:45.932 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:47.271 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:47.330 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ab002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:47.330 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:08:47.330 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:08:47.330 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:08:47.330 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:47.337 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ac002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:47.337 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:08:47.338 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:08:47.661 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:47.661 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:48.749 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:49.278 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:49.674 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:49.674 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:50.783 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04ad002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:50.935 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:50.935 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:08:51.329 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:51.680 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:51.680 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:51.815 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42af3a0) allocated [ CSSD]2013-05-23 18:08:51.815 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:08:51.816 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42af3a0 - 1,2,3 [ CSSD]2013-05-23 18:08:51.816 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42ccc30) proc(0x7f82b42af3a0) pid(2594/2594) version 11:1:1:4 [ CSSD]2013-05-23 18:08:51.832 [1199044928] >TRACE: clssgmRegisterClient: proc(64/0x7f82b42af3a0), client(1/0x7f82b41ff1f0) [ CSSD]2013-05-23 18:08:51.832 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b41ff1f0) [ CSSD]2013-05-23 18:08:51.832 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:08:51.832 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 34 [ CSSD]2013-05-23 18:08:53.218 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:08:53.219 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:08:53.220 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:08:53.220 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42ba8a0) pid(3442) version 11:1:1:4 [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42adc50 with con 0x7f82b42c6340, requested num -1 [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:08:53.226 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:53.232 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:08:53.232 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42adc50), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:08:53.232 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:08:53.232 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:08:53.354 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:53.435 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:08:53.435 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b427d8a0) skgpid ospid 3442 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:08:53.731 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:53.731 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:54.937 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:54.938 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:08:55.365 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:55.737 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:55.737 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:57.392 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:57.743 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:57.743 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:58.381 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04ae002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:58.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:08:58.381 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:08:58.381 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:08:58.382 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:08:58.389 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04af002d) incarnation(174631051) [ CSSD]2013-05-23 18:08:58.389 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:08:58.389 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:08:58.773 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:08:59.398 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:08:59.755 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:08:59.755 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:08:59.940 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:08:59.940 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:00.808 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b0002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:01.429 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:01.761 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:01.761 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:03.455 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:03.781 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:03.781 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:04.943 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:04.943 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:05.465 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:05.787 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:05.787 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:07.470 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:07.792 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:07.792 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:08.479 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:09:08.480 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:09:08.481 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:09:08.481 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42ba8a0) pid(3600) version 11:1:1:4 [ CSSD]2013-05-23 18:09:08.497 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:09:08.497 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:09:08.497 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b42a3f90, requested num -1 [ CSSD]2013-05-23 18:09:08.497 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:08.497 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:09:08.498 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:08.498 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:08.505 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:09:08.505 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:09:08.505 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1760) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:08.505 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42a1760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:08.707 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:09:08.708 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b4207cd0) skgpid ospid 3600 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:08.806 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:09:09.476 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:09.845 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:09.845 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:09.946 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:09.946 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:10.835 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b1002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:11.530 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:11.870 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:11.870 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:13.537 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:13.631 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b2002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:13.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:09:13.631 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:09:13.631 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:09:13.631 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:13.637 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b3002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:13.637 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:09:13.637 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:09:13.881 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:13.881 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:14.949 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:14.949 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:15.547 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:15.888 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:15.888 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:17.592 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:17.893 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:17.893 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:18.833 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:09:18.952 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:18.952 [1165474112] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes [ CSSD]2013-05-23 18:09:19.599 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:19.946 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:19.946 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:20.861 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b4002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:21.630 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:21.952 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:21.952 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:23.637 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:23.752 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:09:23.752 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:09:23.753 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:09:23.753 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42c6340) proc(0x7f82b42ba8a0) pid(3745) version 11:1:1:4 [ CSSD]2013-05-23 18:09:23.760 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:23.761 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:23.767 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:09:23.767 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:09:23.767 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42d9290) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:23.767 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42d9290) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:23.955 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:23.955 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:23.963 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:23.963 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:23.970 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:09:23.970 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42c6340) skgpid ospid 3745 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:25.647 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:25.969 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:25.969 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:27.653 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:27.975 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:27.975 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:28.858 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:09:28.890 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b5002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:28.890 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:09:28.890 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:09:28.890 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:09:28.890 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:28.897 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04b6002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:28.897 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:09:28.897 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:09:28.958 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:28.958 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:29.659 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:29.986 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:29.986 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:30.886 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b7002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:31.669 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:32.011 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:32.011 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:32.278 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:09:32.278 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:09:32.279 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:09:32.279 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42ba8a0) pid(3865) version 11:1:1:4 [ CSSD]2013-05-23 18:09:32.400 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42b5840) allocated [ CSSD]2013-05-23 18:09:32.401 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:09:32.402 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42b5840 - 1,2,3 [ CSSD]2013-05-23 18:09:32.402 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42b5840) pid(3876) version 11:1:1:4 [ CSSD]2013-05-23 18:09:32.420 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:09:32.421 [1199044928] >TRACE: clssgmGroupState: requested group state of group prod-rac_NG, member count 2 [ CSSD]2013-05-23 18:09:32.424 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42b5840 [ CSSD]2013-05-23 18:09:32.424 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42b5840) con(0x7f82b427d8a0) skgpid ospid 3876 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:32.501 [1199044928] >TRACE: clssgmRegisterClient: proc(17/0x7f82b41ef900), client(5366/0x7f82b42ccac0) [ CSSD]2013-05-23 18:09:32.501 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 5366 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:09:32.501 [1199044928] >TRACE: clssgmJoinGrock: global grock ORA_CLSRCSN_SRV_HWPROD1 new client 0x7f82b42ccac0 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 18:09:32.502 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 18:09:32.502 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(1) grock (0x7f82b42baac0/ORA_CLSRCSN_SRV_HWPROD1) [ CSSD]2013-05-23 18:09:32.502 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(ORA_CLSRCSN_SRV_HWPROD1) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:32.502 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock ORA_CLSRCSN_SRV_HWPROD1 member(0/Local) node(1) flags 0x2 0x2 [ CSSD]2013-05-23 18:09:32.509 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 5366 (0x7f82b42ccac0) [ CSSD]2013-05-23 18:09:32.509 [1199044928] >TRACE: clssgmExitGrock: client 5366 (0x7f82b42ccac0), grock ORA_CLSRCSN_SRV_HWPROD1, member 0 [ CSSD]2013-05-23 18:09:32.509 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42a1760) in global grock ORA_CLSRCSN_SRV_HWPROD1 [ CSSD]2013-05-23 18:09:32.510 [1199044928] >TRACE: clssgmRemoveMember: grock ORA_CLSRCSN_SRV_HWPROD1, member number 0 (0x7f82b42a1760) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:32.510 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42ba8a0 [ CSSD]2013-05-23 18:09:32.510 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42ba8a0) con(0x7f82b42a3f90) skgpid ospid 3865 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:33.676 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:33.961 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:33.961 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:34.043 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:34.043 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:35.728 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:36.049 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:36.049 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:37.734 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:38.055 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:38.055 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:38.369 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42ba8a0) allocated [ CSSD]2013-05-23 18:09:38.370 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:09:38.371 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42ba8a0 - 1,2,3 [ CSSD]2013-05-23 18:09:38.371 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b42a3f90) proc(0x7f82b42ba8a0) pid(3508/3508) version 11:1:1:4 [ CSSD]2013-05-23 18:09:38.387 [1199044928] >TRACE: clssgmRegisterClient: proc(65/0x7f82b42ba8a0), client(1/0x7f82b42adc50) [ CSSD]2013-05-23 18:09:38.387 [1199044928] >TRACE: clssgmExecuteClientRequest: GRPSHREG recvd from client 1 (0x7f82b42adc50) [ CSSD]2013-05-23 18:09:38.387 [1199044928] >TRACE: clssgmRegisterShared: grp DG_LOCAL_DATA, mbr 0, type 1 [ CSSD]2013-05-23 18:09:38.387 [1199044928] >TRACE: clssgmRegisterShared: local grock DG_LOCAL_DATA member 0 share type 1, refcount 35 [ CSSD]2013-05-23 18:09:38.880 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:09:38.964 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:38.964 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:39.011 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 18:09:39.012 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:09:39.012 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 18:09:39.012 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b427d8a0) proc(0x7f82b42cfa20) pid(3935) version 11:1:1:4 [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cfa20), client(1/0x7f82b42cd480) [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b42cd480 with con 0x7f82b4207cd0, requested num -1 [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:39.021 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:39.028 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b42cd480) [ CSSD]2013-05-23 18:09:39.028 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b42cd480), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:09:39.028 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:39.029 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:39.231 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 18:09:39.231 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b427d8a0) skgpid ospid 3935 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:39.760 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:40.066 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:40.066 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:40.913 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04b8002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:41.770 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:42.091 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:42.091 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:43.705 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 18:09:43.706 [1215830336] >TRACE: Connect request from user oracle [ CSSD]2013-05-23 18:09:43.707 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 18:09:43.707 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42cfa20) pid(4005) version 11:1:1:4 [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cfa20), client(1/0x7f82b41bf650) [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b41bf650 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:43.713 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:43.719 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b41bf650) [ CSSD]2013-05-23 18:09:43.719 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b41bf650), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:09:43.719 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:43.719 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:43.777 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:43.922 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 18:09:43.922 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b4207cd0) skgpid ospid 4005 with 0 clients, refcount 0 [ CSSD]2013-05-23 18:09:43.967 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:43.967 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:44.144 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:44.144 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:44.150 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04b9002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:44.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:09:44.150 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:09:44.150 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:09:44.150 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:44.157 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04ba002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:44.158 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:09:44.158 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:09:45.829 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:46.149 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:46.149 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:47.590 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(3) src(2) dest(1) size(420) tag(04bb002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:47.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): src(2) dest(1) size(420) [ CSSD]2013-05-23 18:09:47.590 [1123510592] >TRACE: clssgmHandleMasterAdd(): grock(SRVM.DATABASE.NODEAPPS.prod-rac02) memberNo(-1) node(2) type(3). [ CSSD]2013-05-23 18:09:47.590 [1123510592] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(2) grock (0x7f82ac007840/SRVM.DATABASE.NODEAPPS.prod-rac02) [ CSSD]2013-05-23 18:09:47.590 [1123510592] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac02 member(0/Remote) node(2) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:47.597 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(4) src(2) dest(1) size(352) tag(04bc002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:47.597 [1123510592] >TRACE: clssgmHandleMasterExit(): src(2) dest(1) size(352) [ CSSD]2013-05-23 18:09:47.597 [1123510592] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac02, member number 0 (0x7f82ac007b40) node number 2 state 0x0 member refcnt 1 grock type 3 [ CSSD]2013-05-23 18:09:47.835 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:48.155 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:48.155 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:48.901 [1199044928] >TRACE: clssgmGroupState: requested group state of group DBHWPROD, member count 2 [ CSSD]2013-05-23 18:09:48.970 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:48.971 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:49.841 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:50.167 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:50.167 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:50.940 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(12) src(2) dest(1) size(360) tag(04bd002d) incarnation(174631051) [ CSSD]2013-05-23 18:09:51.852 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:52.192 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:52.192 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:53.858 [1199044928] >TRACE: clssgmExecuteClientRequest: Received data update request from client (0x7f82b41b9c90), type 1 [ CSSD]2013-05-23 18:09:53.974 [1165474112] >TRACE: clssnmSendingThread: sending status msg to all nodes [ CSSD]2013-05-23 18:09:53.974 [1165474112] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes [ CSSD]2013-05-23 18:09:54.244 [1123510592] >TRACE: clssgmDispatchCMXMSG: msg type(13) src(2) dest(1) size(123) tag(00000000) incarnation(174631051) [ CSSD]2013-05-23 18:09:54.244 [1123510592] >TRACE: clssgmHandleDataInvalid: grock HB+ASM, member 2 node 2, birth 11 [ CSSD]2013-05-23 18:09:54.281 [1199044928] >TRACE: clssgmAllocProc: (0x7f82b42cfa20) allocated [ CSSD]2013-05-23 18:09:54.282 [1215830336] >TRACE: Connect request from user root [ CSSD]2013-05-23 18:09:54.282 [1199044928] >TRACE: clssgmClientConnectMsg: properties of cmProc 0x7f82b42cfa20 - 1,2,3 [ CSSD]2013-05-23 18:09:54.282 [1199044928] >TRACE: clssgmClientConnectMsg: Connect from con(0x7f82b4207cd0) proc(0x7f82b42cfa20) pid(4105) version 11:1:1:4 [ CSSD]2013-05-23 18:09:54.299 [1199044928] >TRACE: clssgmRegisterClient: proc(66/0x7f82b42cfa20), client(1/0x7f82b4286810) [ CSSD]2013-05-23 18:09:54.299 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 18:09:54.299 [1199044928] >TRACE: clssgmJoinGrock: global grock SRVM.DATABASE.NODEAPPS.prod-rac01 new client 0x7f82b4286810 with con 0x7f82b427d8a0, requested num -1 [ CSSD]2013-05-23 18:09:54.299 [1199044928] >TRACE: clssgmAddGrockMember: adding member to grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:54.299 [1199044928] >TRACE: clssgmAddMember: granted member(0) flags(0x1) node(1) grock (0x7f82b42baac0/SRVM.DATABASE.NODEAPPS.prod-rac01) [ CSSD]2013-05-23 18:09:54.300 [1199044928] >TRACE: clssgmQueueGrockEvent: lockName(SRVM.DATABASE.NODEAPPS.prod-rac01) type(2) count (1/1) xwaiters(0) event(1) to memberNo(0) [ CSSD]2013-05-23 18:09:54.300 [1199044928] >TRACE: clssgmCommonAddMember: global lock grock SRVM.DATABASE.NODEAPPS.prod-rac01 member(0/Local) node(1) flags 0x1 0x1 [ CSSD]2013-05-23 18:09:54.306 [1199044928] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (0x7f82b4286810) [ CSSD]2013-05-23 18:09:54.306 [1199044928] >TRACE: clssgmExitGrock: client 1 (0x7f82b4286810), grock SRVM.DATABASE.NODEAPPS.prod-rac01, member 0 [ CSSD]2013-05-23 18:09:54.306 [1199044928] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (0x7f82b42b5840) in global grock SRVM.DATABASE.NODEAPPS.prod-rac01 [ CSSD]2013-05-23 18:09:54.306 [1199044928] >TRACE: clssgmRemoveMember: grock SRVM.DATABASE.NODEAPPS.prod-rac01, member number 0 (0x7f82b42b5840) node number 1 state 0x14 member refcnt 0 grock type 3 [ CSSD]2013-05-23 18:09:54.509 [1199044928] >TRACE: clssgmDeadProc: proc 0x7f82b42cfa20 [ CSSD]2013-05-23 18:09:54.509 [1199044928] >TRACE: clssgmDestroyProc: cleaning up proc(0x7f82b42cfa20) con(0x7f82b4207cd0) skgpid ospid 4105 with 0 clients, refcount 0